Jul 30 22:46:00.238270 ip-10-0-142-10 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 30 22:46:00.238281 ip-10-0-142-10 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 30 22:46:00.238288 ip-10-0-142-10 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 30 22:46:00.238523 ip-10-0-142-10 systemd[1]: Failed to start Kubernetes Kubelet. Jul 30 22:46:09.726230 ip-10-0-142-10 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 30 22:46:09.726246 ip-10-0-142-10 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 156d96c02221446ab3235b8e304205c6 -- Jul 30 22:47:52.703300 ip-10-0-142-10 systemd[1]: Starting Kubernetes Kubelet... Jul 30 22:47:53.012435 ip-10-0-142-10 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 22:47:53.012435 ip-10-0-142-10 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 30 22:47:53.012435 ip-10-0-142-10 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 22:47:53.012435 ip-10-0-142-10 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 30 22:47:53.012435 ip-10-0-142-10 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 22:47:53.014559 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.014473 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 30 22:47:53.020158 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020139 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 22:47:53.020158 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020155 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 22:47:53.020158 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020160 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 22:47:53.020158 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020166 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020173 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020179 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020183 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020187 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020191 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020195 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020200 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020204 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020208 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020213 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020217 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020221 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020225 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020229 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020233 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020237 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020257 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020262 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020267 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 22:47:53.020409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020271 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020276 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020280 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020285 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020297 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020302 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020307 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020311 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020316 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020320 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020325 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020329 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020333 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020337 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020342 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020347 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020351 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020355 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020359 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 22:47:53.021091 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020367 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020372 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020377 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020382 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020387 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020391 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020396 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020400 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020405 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020409 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020415 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020421 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020426 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020430 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020435 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020440 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020444 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020449 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020453 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020458 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 22:47:53.021582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020463 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020468 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020472 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020476 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020481 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020485 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020490 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020495 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020499 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020504 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020508 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020512 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020516 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020520 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020525 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020531 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020535 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020539 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020543 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020548 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 22:47:53.022330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020552 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 22:47:53.023133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020556 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 22:47:53.023133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020560 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 22:47:53.023133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020566 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 22:47:53.023133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020574 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 22:47:53.023133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020578 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 22:47:53.023133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020582 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 22:47:53.023133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020587 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 22:47:53.023133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020591 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 22:47:53.023133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020595 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 22:47:53.023133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020600 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 22:47:53.023133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020604 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 22:47:53.023133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020609 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 22:47:53.023133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020613 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 22:47:53.023133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020618 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 22:47:53.023133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020622 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 22:47:53.023133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.020626 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 22:47:53.024286 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024270 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 22:47:53.024286 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024285 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024299 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024303 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024306 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024310 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024312 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024315 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024318 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024320 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024323 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024326 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024329 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024332 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024334 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024337 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024340 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024342 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024345 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024347 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024350 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 22:47:53.024358 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024353 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024355 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024358 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024360 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024363 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024366 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024368 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024372 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024374 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024377 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024380 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024383 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024386 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024390 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024394 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024397 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024399 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024402 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024405 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 22:47:53.024869 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024407 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024410 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024412 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024415 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024417 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024420 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024422 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024425 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024429 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024433 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024436 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024439 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024441 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024444 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024447 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024450 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024453 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024456 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024458 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 22:47:53.025347 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024460 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024463 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024466 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024468 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024471 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024473 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024476 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024479 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024481 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024484 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024486 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024489 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024491 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024494 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024496 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024499 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024501 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024503 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024506 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024508 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 22:47:53.025821 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024511 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024513 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024516 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024518 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024522 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024524 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024527 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024530 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024533 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024539 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024544 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024547 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024550 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024553 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024556 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024559 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024561 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024564 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024567 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 22:47:53.026359 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024569 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024963 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024969 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024972 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024975 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024977 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024980 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024983 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024985 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024988 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024992 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024996 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.024999 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025002 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025006 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025008 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025011 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025014 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025017 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 22:47:53.026830 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025021 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025024 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025027 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025030 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025032 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025035 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025038 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025040 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025043 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025046 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025048 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025050 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025053 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025056 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025058 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025061 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025063 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025066 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025068 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 22:47:53.027330 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025071 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025074 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025076 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025078 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025081 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025084 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025086 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025089 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025091 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025094 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025097 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025099 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025102 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025105 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025108 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025111 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025113 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025116 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025119 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025121 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 22:47:53.027835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025124 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025127 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025129 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025131 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025134 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025137 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025139 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025142 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025145 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025148 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025150 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025153 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025155 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025158 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025160 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025163 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025165 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025168 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025172 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025175 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 22:47:53.028350 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025178 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025182 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025186 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025189 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025192 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025195 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025198 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025201 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025203 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025206 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025208 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025211 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025213 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025217 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025220 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025222 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025225 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025227 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025230 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025232 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 22:47:53.028889 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025234 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025237 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025305 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025312 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025317 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025324 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025330 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025337 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025344 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025349 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025352 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025355 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025358 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025362 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025365 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025368 2576 flags.go:64] FLAG: --cgroup-root="" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025371 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025374 2576 flags.go:64] FLAG: --client-ca-file="" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025378 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025382 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025387 2576 flags.go:64] FLAG: --cluster-domain="" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025390 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025393 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025396 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 30 22:47:53.029388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025399 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025403 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025406 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025409 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025412 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025415 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025418 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025421 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025424 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025427 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025431 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025434 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025437 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025439 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025442 2576 flags.go:64] FLAG: --enable-server="true" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025445 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025449 2576 flags.go:64] FLAG: --event-burst="100" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025453 2576 flags.go:64] FLAG: --event-qps="50" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025455 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025458 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025461 2576 flags.go:64] FLAG: --eviction-hard="" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025465 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025467 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025471 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025474 2576 flags.go:64] FLAG: --eviction-soft="" Jul 30 22:47:53.029998 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025477 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025480 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025483 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025486 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025489 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025492 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025495 2576 flags.go:64] FLAG: --feature-gates="" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025503 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025506 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025509 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025512 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025515 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025518 2576 flags.go:64] FLAG: --help="false" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025521 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025524 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025527 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025529 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025533 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025536 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025539 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025542 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025544 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025547 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 30 22:47:53.030609 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025550 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025553 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025555 2576 flags.go:64] FLAG: --kube-reserved="" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025558 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025561 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025564 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025566 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025569 2576 flags.go:64] FLAG: --lock-file="" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025572 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025575 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025578 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025583 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025587 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025589 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025592 2576 flags.go:64] FLAG: --logging-format="text" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025595 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025598 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025601 2576 flags.go:64] FLAG: --manifest-url="" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025604 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025608 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025611 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025615 2576 flags.go:64] FLAG: --max-pods="110" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025618 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025621 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025623 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 30 22:47:53.031237 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025626 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025629 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025632 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025635 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025642 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025645 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025647 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025650 2576 flags.go:64] FLAG: --pod-cidr="" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025653 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025659 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025662 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025665 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025667 2576 flags.go:64] FLAG: --port="10250" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025670 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025673 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d5dfa5d72e94c477" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025676 2576 flags.go:64] FLAG: --qos-reserved="" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025682 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025685 2576 flags.go:64] FLAG: --register-node="true" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025687 2576 flags.go:64] FLAG: --register-with-taints="" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025691 2576 flags.go:64] FLAG: --registry-burst="10" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025695 2576 flags.go:64] FLAG: --registry-qps="5" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025698 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025701 2576 flags.go:64] FLAG: --reserved-memory="" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025704 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025707 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 30 22:47:53.032016 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025710 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025713 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025716 2576 flags.go:64] FLAG: --runonce="false" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025719 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025722 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025725 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025728 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025730 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025733 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025736 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025739 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025742 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025744 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025747 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025750 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025753 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025756 2576 flags.go:64] FLAG: --system-cgroups="" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025758 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025764 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025766 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025769 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025774 2576 flags.go:64] FLAG: --tls-min-version="" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025776 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025781 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025784 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 30 22:47:53.033145 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025787 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025790 2576 flags.go:64] FLAG: --v="2" Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025794 2576 flags.go:64] FLAG: --version="false" Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025798 2576 flags.go:64] FLAG: --vmodule="" Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025802 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.025805 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025931 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025936 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025940 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025944 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025948 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025951 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025954 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025957 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025960 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025963 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025965 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025968 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025971 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025973 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 22:47:53.034133 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025976 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025978 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025981 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025983 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025986 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025988 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025991 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025994 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025996 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.025999 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026004 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026006 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026009 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026013 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026016 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026020 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026024 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026027 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026030 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 22:47:53.034676 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026033 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026036 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026039 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026041 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026044 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026047 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026049 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026052 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026054 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026057 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026060 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026062 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026065 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026067 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026070 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026073 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026075 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026077 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026080 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026083 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 22:47:53.035656 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026085 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026087 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026090 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026093 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026096 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026099 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026104 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026106 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026109 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026112 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026115 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026117 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026120 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026122 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026125 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026128 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026130 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026133 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026135 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026138 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 22:47:53.036366 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026141 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026143 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026146 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026149 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026151 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026154 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026156 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026159 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026161 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026164 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026166 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026169 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026172 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026175 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026178 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026182 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026185 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026187 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026191 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 22:47:53.037096 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026194 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 22:47:53.037906 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026197 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 22:47:53.037906 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026199 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 22:47:53.037906 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026202 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 22:47:53.037906 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026205 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 22:47:53.037906 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026207 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 22:47:53.037906 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.026210 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 22:47:53.037906 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.026709 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 22:47:53.037906 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.033954 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 30 22:47:53.037906 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.033973 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 30 22:47:53.037906 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.034606 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 30 22:47:53.037906 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.034618 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 30 22:47:53.037906 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034707 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 22:47:53.037906 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034715 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 22:47:53.037906 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034720 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 22:47:53.037906 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034724 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034730 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034735 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034742 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034746 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034750 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034755 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034760 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034764 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034768 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034772 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034776 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034781 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034785 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034789 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034795 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034802 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034807 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034812 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034816 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 22:47:53.038351 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034820 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034824 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034829 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034833 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034837 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034841 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034849 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034853 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034877 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034883 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034887 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034891 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034895 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034899 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034903 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034907 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034910 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034914 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034917 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 22:47:53.039049 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034921 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034925 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034928 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034932 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034936 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034940 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034943 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034948 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034951 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034955 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034958 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034962 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034966 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034969 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034973 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034977 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034981 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034987 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034992 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 22:47:53.039541 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.034998 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035004 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035008 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035013 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035017 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035021 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035026 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035030 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035034 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035039 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035043 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035048 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035052 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035056 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035060 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035065 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035069 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035073 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035077 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 22:47:53.040079 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035082 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035086 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035090 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035094 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035098 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035102 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035106 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035110 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035114 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035119 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035123 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035127 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035131 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035137 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035141 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035147 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035151 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035155 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 22:47:53.040620 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035160 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 22:47:53.041124 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.035168 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 22:47:53.041124 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035379 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 22:47:53.041124 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035386 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 22:47:53.041124 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035391 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 22:47:53.041124 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035396 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 22:47:53.041124 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035400 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 22:47:53.041124 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035405 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 22:47:53.041124 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035410 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 22:47:53.041124 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035415 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 22:47:53.041124 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035419 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 22:47:53.041124 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035423 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 22:47:53.041124 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035427 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 22:47:53.041124 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035431 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 22:47:53.041124 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035435 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 22:47:53.041124 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035439 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035444 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035448 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035452 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035456 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035460 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035464 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035469 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035473 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035477 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035482 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035485 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035490 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035495 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035499 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035504 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035508 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035513 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035517 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035521 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 22:47:53.041515 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035525 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035529 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035533 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035537 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035542 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035546 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035550 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035554 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035558 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035562 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035566 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035570 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035577 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035582 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035587 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035591 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035596 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035601 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035605 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 30 22:47:53.042142 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035609 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035613 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035617 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035622 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035626 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035630 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035634 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035638 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035643 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035649 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035654 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035658 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035662 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035665 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035669 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035673 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035677 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035681 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035686 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 22:47:53.042959 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035690 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035694 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035698 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035702 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035706 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035711 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035715 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035719 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035723 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035727 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035732 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035736 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035740 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035744 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035748 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035752 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035759 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035766 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035771 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 22:47:53.043756 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035778 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 22:47:53.044447 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035784 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 22:47:53.044447 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035788 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 22:47:53.044447 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035793 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 22:47:53.044447 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035798 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 22:47:53.044447 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035802 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 22:47:53.044447 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035806 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 22:47:53.044447 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035810 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 22:47:53.044447 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:53.035814 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 22:47:53.044447 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.035822 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 22:47:53.044447 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.036011 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 30 22:47:53.044447 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.038562 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 30 22:47:53.044447 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.039787 2576 server.go:1019] "Starting client certificate rotation" Jul 30 22:47:53.044447 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.039887 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 30 22:47:53.044447 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.039923 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 30 22:47:53.044805 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.042453 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 30 22:47:53.044805 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.044215 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 30 22:47:53.053448 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.053429 2576 log.go:25] "Validated CRI v1 runtime API" Jul 30 22:47:53.055571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.055557 2576 log.go:25] "Validated CRI v1 image API" Jul 30 22:47:53.056561 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.056543 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 30 22:47:53.058914 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.058896 2576 fs.go:135] Filesystem UUIDs: map[479d700b-3e67-4a82-b272-4dd721324a92:/dev/nvme0n1p4 4adc3bff-9988-455b-aac6-a3970bb11cb6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 30 22:47:53.058971 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.058914 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 30 22:47:53.063772 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.063664 2576 manager.go:216] Machine: {Timestamp:2026-07-30 22:47:53.062456492 +0000 UTC m=+0.266275716 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093849 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f0c7c93208e15aa52ca4bbb4a39c1 SystemUUID:ec2f0c7c-9320-8e15-aa52-ca4bbb4a39c1 BootID:156d96c0-2221-446a-b323-5b8e304205c6 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c3:20:2a:ca:05 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c3:20:2a:ca:05 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:3f:66:c1:54:bf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 30 22:47:53.063772 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.063762 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 30 22:47:53.063915 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.063873 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 30 22:47:53.066167 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.066143 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 30 22:47:53.066333 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.066168 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-10.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 30 22:47:53.066798 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.066787 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 30 22:47:53.066798 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.066790 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 30 22:47:53.066914 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.066803 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 30 22:47:53.066914 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.066813 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 30 22:47:53.066914 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.066834 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 30 22:47:53.067643 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.067631 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 30 22:47:53.071528 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.071514 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 30 22:47:53.071663 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.071652 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 30 22:47:53.071725 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.071699 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 30 22:47:53.071725 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.071722 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 30 22:47:53.071813 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.071738 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 30 22:47:53.071813 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.071752 2576 kubelet.go:398] "Adding apiserver pod source" Jul 30 22:47:53.071813 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.071765 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 30 22:47:53.072166 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.072153 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 30 22:47:53.072227 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.072176 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 30 22:47:53.073988 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.073964 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 30 22:47:53.075357 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.075343 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 30 22:47:53.075415 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.075374 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 30 22:47:53.076377 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.076366 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 30 22:47:53.076420 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.076382 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 30 22:47:53.076420 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.076388 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 30 22:47:53.076420 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.076395 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 30 22:47:53.076420 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.076408 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 30 22:47:53.076420 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.076416 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 30 22:47:53.076555 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.076428 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 30 22:47:53.076555 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.076436 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 30 22:47:53.076555 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.076458 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 30 22:47:53.076555 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.076467 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 30 22:47:53.076555 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.076483 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 30 22:47:53.076555 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.076488 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 30 22:47:53.077078 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.077069 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 30 22:47:53.077078 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.077079 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 30 22:47:53.080367 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.080352 2576 server.go:1268] "Started kubelet" Jul 30 22:47:53.080444 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.080411 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 30 22:47:53.080502 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.080444 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 30 22:47:53.080546 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.080511 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 30 22:47:53.081236 ip-10-0-142-10 systemd[1]: Started Kubernetes Kubelet. Jul 30 22:47:53.084513 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.083905 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 30 22:47:53.084513 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.084312 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-10.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 30 22:47:53.084513 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.084389 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-10.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 30 22:47:53.084513 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.084439 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 30 22:47:53.085770 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.085544 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 30 22:47:53.087325 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.087301 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 30 22:47:53.089708 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.088846 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-10.ec2.internal.18c732d6419455db default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-10.ec2.internal,UID:ip-10-0-142-10.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-10.ec2.internal,},FirstTimestamp:2026-07-30 22:47:53.080321499 +0000 UTC m=+0.284140724,LastTimestamp:2026-07-30 22:47:53.080321499 +0000 UTC m=+0.284140724,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-10.ec2.internal,}" Jul 30 22:47:53.089814 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.089791 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 30 22:47:53.089814 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.089792 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 30 22:47:53.089916 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.089899 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found" Jul 30 22:47:53.090324 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.090305 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 30 22:47:53.090324 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.090327 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 30 22:47:53.090455 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.090314 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 30 22:47:53.090513 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.090473 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 30 22:47:53.090513 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.090481 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 30 22:47:53.090738 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.090721 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 30 22:47:53.090738 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.090736 2576 factory.go:55] Registering systemd factory Jul 30 22:47:53.090738 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.090745 2576 factory.go:223] Registration of the systemd container factory successfully Jul 30 22:47:53.090958 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.090943 2576 factory.go:153] Registering CRI-O factory Jul 30 22:47:53.091004 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.090962 2576 factory.go:223] Registration of the crio container factory successfully Jul 30 22:47:53.091004 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.090985 2576 factory.go:103] Registering Raw factory Jul 30 22:47:53.091004 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.090999 2576 manager.go:1196] Started watching for new ooms in manager Jul 30 22:47:53.091418 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.091407 2576 manager.go:349] Starting recovery of all containers Jul 30 22:47:53.095526 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.095503 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-10.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 30 22:47:53.095642 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.095608 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 30 22:47:53.096026 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.095996 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b7v76" Jul 30 22:47:53.097987 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.097938 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 30 22:47:53.102255 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.102232 2576 manager.go:354] Recovery completed Jul 30 22:47:53.104369 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.104340 2576 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": readdirent /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 30 22:47:53.104547 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.104534 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b7v76" Jul 30 22:47:53.107549 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.107535 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 22:47:53.110884 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.110867 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientMemory" Jul 30 22:47:53.110945 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.110896 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 22:47:53.110945 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.110911 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientPID" Jul 30 22:47:53.112060 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.112046 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 30 22:47:53.112060 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.112058 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 30 22:47:53.112191 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.112074 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 30 22:47:53.112191 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.112091 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 22:47:53.112815 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.112802 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientMemory" Jul 30 22:47:53.112908 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.112829 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 22:47:53.112908 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.112842 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientPID" Jul 30 22:47:53.113105 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.113034 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-10.ec2.internal.18c732d64366a5e3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-10.ec2.internal,UID:ip-10-0-142-10.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-10.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-10.ec2.internal,},FirstTimestamp:2026-07-30 22:47:53.110881763 +0000 UTC m=+0.314700987,LastTimestamp:2026-07-30 22:47:53.110881763 +0000 UTC m=+0.314700987,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-10.ec2.internal,}" Jul 30 22:47:53.114050 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.114037 2576 policy_none.go:49] "None policy: Start" Jul 30 22:47:53.114102 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.114053 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 30 22:47:53.114102 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.114064 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 30 22:47:53.116019 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.116008 2576 policy_none.go:47] "Start" Jul 30 22:47:53.156617 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.156468 2576 manager.go:337] "Starting Device Plugin manager" Jul 30 22:47:53.156727 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.156636 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 30 22:47:53.156727 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.156650 2576 server.go:87] "Starting device plugin registration server" Jul 30 22:47:53.156914 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.156901 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 30 22:47:53.156973 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.156917 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 30 22:47:53.157035 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.157006 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 30 22:47:53.157113 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.157094 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 30 22:47:53.157113 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.157112 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 30 22:47:53.157629 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.157612 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 30 22:47:53.157697 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.157654 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-10.ec2.internal\" not found" Jul 30 22:47:53.229746 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.229719 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 30 22:47:53.232002 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.229764 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 30 22:47:53.232002 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.229814 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 30 22:47:53.232002 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.229849 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 30 22:47:53.232338 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.232320 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 22:47:53.257407 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.257384 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 22:47:53.258245 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.258226 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientMemory" Jul 30 22:47:53.258339 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.258264 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 22:47:53.258339 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.258280 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientPID" Jul 30 22:47:53.258339 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.258310 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.267229 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.267177 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.267229 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.267202 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-10.ec2.internal\": node \"ip-10-0-142-10.ec2.internal\" not found" Jul 30 22:47:53.286086 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.286065 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found" Jul 30 22:47:53.330169 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.330142 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal"] Jul 30 22:47:53.330241 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.330209 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 22:47:53.331147 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.331133 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientMemory" Jul 30 22:47:53.331209 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.331160 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 22:47:53.331209 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.331170 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientPID" Jul 30 22:47:53.333491 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.333478 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 22:47:53.333621 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.333605 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.333662 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.333639 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 22:47:53.334204 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.334190 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientMemory" Jul 30 22:47:53.334271 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.334212 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 22:47:53.334271 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.334197 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientMemory" Jul 30 22:47:53.334271 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.334222 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientPID" Jul 30 22:47:53.334271 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.334240 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 22:47:53.334271 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.334252 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientPID" Jul 30 22:47:53.336668 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.336654 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.336717 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.336679 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 22:47:53.337446 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.337429 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientMemory" Jul 30 22:47:53.337504 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.337461 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 22:47:53.337504 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.337477 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientPID" Jul 30 22:47:53.356451 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.356428 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-10.ec2.internal\" not found" node="ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.360532 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.360518 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-10.ec2.internal\" not found" node="ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.386233 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.386206 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found" Jul 30 22:47:53.392264 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.392245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37c5ea9b707c6dfdf55342b71f73c37b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal\" (UID: \"37c5ea9b707c6dfdf55342b71f73c37b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.392325 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.392271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37c5ea9b707c6dfdf55342b71f73c37b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal\" (UID: \"37c5ea9b707c6dfdf55342b71f73c37b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.392325 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.392287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85fd0607521b56acd9e31e115458dcc6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-10.ec2.internal\" (UID: \"85fd0607521b56acd9e31e115458dcc6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.487128 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.487107 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found" Jul 30 22:47:53.492851 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.492835 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37c5ea9b707c6dfdf55342b71f73c37b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal\" (UID: \"37c5ea9b707c6dfdf55342b71f73c37b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.492908 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.492859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37c5ea9b707c6dfdf55342b71f73c37b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal\" (UID: \"37c5ea9b707c6dfdf55342b71f73c37b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.492908 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.492899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85fd0607521b56acd9e31e115458dcc6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-10.ec2.internal\" (UID: \"85fd0607521b56acd9e31e115458dcc6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.492993 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.492943 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85fd0607521b56acd9e31e115458dcc6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-10.ec2.internal\" (UID: \"85fd0607521b56acd9e31e115458dcc6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.492993 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.492948 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37c5ea9b707c6dfdf55342b71f73c37b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal\" (UID: \"37c5ea9b707c6dfdf55342b71f73c37b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.492993 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.492966 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37c5ea9b707c6dfdf55342b71f73c37b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal\" (UID: \"37c5ea9b707c6dfdf55342b71f73c37b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.587303 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.587228 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found" Jul 30 22:47:53.661674 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.661649 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.662806 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.662789 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal" Jul 30 22:47:53.688117 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.688093 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found" Jul 30 22:47:53.788296 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.788245 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found" Jul 30 22:47:53.889240 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:53.889207 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found" Jul 30 22:47:53.923353 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.923329 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 22:47:53.955975 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.955953 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 22:47:53.991015 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:53.990988 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal" Jul 30 22:47:54.002780 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.002764 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 30 22:47:54.003627 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.003613 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal" Jul 30 22:47:54.016292 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.016275 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 30 22:47:54.039172 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.039147 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 30 22:47:54.039291 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.039274 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 30 22:47:54.039336 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.039274 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 30 22:47:54.039336 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.039296 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 30 22:47:54.073118 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.073099 2576 apiserver.go:52] "Watching apiserver" Jul 30 22:47:54.090044 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.090021 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 30 22:47:54.092630 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.092610 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 30 22:47:54.094370 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.094349 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-bk6hf","kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4","openshift-image-registry/node-ca-kdwq6","openshift-multus/multus-additional-cni-plugins-zsjdm","openshift-multus/multus-t9b54","openshift-multus/network-metrics-daemon-j8q5t","openshift-network-diagnostics/network-check-target-jtwng","kube-system/global-pull-secret-syncer-r96n6","openshift-cluster-node-tuning-operator/tuned-87pww","openshift-dns/node-resolver-ctblf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal","openshift-network-operator/iptables-alerter-xhn6n","openshift-ovn-kubernetes/ovnkube-node-cm48d"] Jul 30 22:47:54.096972 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.096955 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:47:54.097072 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.097035 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:47:54.099168 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.099151 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xhn6n" Jul 30 22:47:54.100531 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.100514 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 30 22:47:54.102189 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.101704 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.102189 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.101761 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bmgmq\"" Jul 30 22:47:54.102344 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.102261 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 30 22:47:54.102546 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.102525 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 30 22:47:54.102698 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.102679 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 30 22:47:54.104325 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.104304 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 30 22:47:54.104489 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.104467 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 30 22:47:54.104566 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.104473 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 30 22:47:54.104566 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.104508 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jdjh7\"" Jul 30 22:47:54.105209 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.105186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kdwq6" Jul 30 22:47:54.107452 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.107431 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 30 22:47:54.107557 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.107494 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 30 22:47:54.107618 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.107610 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 30 22:47:54.107674 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.107613 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.107724 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.107691 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qwbkl\"" Jul 30 22:47:54.109549 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.109514 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 22:42:53 +0000 UTC" deadline="2028-01-09 20:57:06.992627789 +0000 UTC" Jul 30 22:47:54.109610 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.109548 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12670h9m12.883082505s" Jul 30 22:47:54.109757 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.109743 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 30 22:47:54.109940 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.109927 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 30 22:47:54.110007 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.109931 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.110185 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.110162 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 30 22:47:54.110299 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.110284 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 30 22:47:54.110348 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.110313 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 30 22:47:54.110389 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.110361 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g2hsb\"" Jul 30 22:47:54.112305 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.112281 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:47:54.112379 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.112361 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:47:54.112432 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.112418 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 30 22:47:54.113012 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.112996 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hzw64\"" Jul 30 22:47:54.114619 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.114606 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bk6hf" Jul 30 22:47:54.117276 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.117262 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.117827 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.117809 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r2khm\"" Jul 30 22:47:54.117918 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.117809 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 30 22:47:54.118838 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.118825 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 30 22:47:54.119542 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.119529 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.120975 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.120957 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 30 22:47:54.121052 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.120964 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 30 22:47:54.121926 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.121911 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ctblf" Jul 30 22:47:54.122204 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.122134 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 30 22:47:54.122363 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.122349 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 30 22:47:54.122430 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.122354 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 30 22:47:54.122485 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.122465 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v9266\"" Jul 30 22:47:54.122528 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.122489 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 30 22:47:54.122599 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.122584 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 30 22:47:54.122741 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.122729 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s45r8\"" Jul 30 22:47:54.122832 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.122817 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 30 22:47:54.124301 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.124286 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v6fg8\"" Jul 30 22:47:54.124359 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.124340 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:47:54.124394 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.124381 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:47:54.124593 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.124581 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 30 22:47:54.125419 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.125404 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 30 22:47:54.136943 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.136928 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bjg5s" Jul 30 22:47:54.147598 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.147544 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bjg5s" Jul 30 22:47:54.191666 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.191646 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 30 22:47:54.197457 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197437 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-multus-cni-dir\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.197532 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-etc-kubernetes\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.197532 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-etc-openvswitch\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.197532 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197507 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.197532 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197525 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-kubernetes\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.197673 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-sysctl-conf\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.197673 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-systemd\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.197673 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197611 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/427879a1-93d6-444c-bd25-a03652257f13-etc-tuned\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.197673 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197626 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20eeae26-7b8c-4b13-976f-45be0ec631ff-kubelet-config\") pod \"global-pull-secret-syncer-r96n6\" (UID: \"20eeae26-7b8c-4b13-976f-45be0ec631ff\") " pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:47:54.197673 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197640 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-cni-netd\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.197673 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.197673 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-var-lib-kubelet\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.197906 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-multus-conf-dir\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.197906 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-modprobe-d\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.197906 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-sys\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.197906 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-host\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.197906 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-log-socket\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.197906 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197809 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26-hosts-file\") pod \"node-resolver-ctblf\" (UID: \"b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26\") " pod="openshift-dns/node-resolver-ctblf" Jul 30 22:47:54.197906 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-device-dir\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.197906 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d541cd49-d536-4578-b699-eb53c81b1ad8-os-release\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.197906 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197868 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/039c09b9-d19e-480b-a820-fce0e4b7dfca-multus-daemon-config\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.197906 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197888 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-run-multus-certs\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.198259 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-sysctl-d\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.198259 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197933 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c27mf\" (UniqueName: \"kubernetes.io/projected/427879a1-93d6-444c-bd25-a03652257f13-kube-api-access-c27mf\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.198259 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197956 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20eeae26-7b8c-4b13-976f-45be0ec631ff-dbus\") pod \"global-pull-secret-syncer-r96n6\" (UID: \"20eeae26-7b8c-4b13-976f-45be0ec631ff\") " pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:47:54.198259 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197969 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d304fc21-0e59-4cce-bf8d-880efd5e5ce4-konnectivity-ca\") pod \"konnectivity-agent-bk6hf\" (UID: \"d304fc21-0e59-4cce-bf8d-880efd5e5ce4\") " pod="kube-system/konnectivity-agent-bk6hf" Jul 30 22:47:54.198259 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197982 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-run-openvswitch\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.198259 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.197996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-run-k8s-cni-cncf-io\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.198259 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-757lz\" (UniqueName: \"kubernetes.io/projected/ee4984a2-9082-4730-a056-597f24a92af7-kube-api-access-757lz\") pod \"network-metrics-daemon-j8q5t\" (UID: \"ee4984a2-9082-4730-a056-597f24a92af7\") " pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:47:54.198259 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99d0098f-5c85-48d4-8c74-9507b34e99bc-ovnkube-config\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.198259 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198058 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tgcm\" (UniqueName: \"kubernetes.io/projected/bea329e0-01bb-4de9-8ef7-7e9e76d0a27a-kube-api-access-5tgcm\") pod \"iptables-alerter-xhn6n\" (UID: \"bea329e0-01bb-4de9-8ef7-7e9e76d0a27a\") " pod="openshift-network-operator/iptables-alerter-xhn6n" Jul 30 22:47:54.198259 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198074 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-socket-dir\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.198259 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198089 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xch82\" (UniqueName: \"kubernetes.io/projected/d541cd49-d536-4578-b699-eb53c81b1ad8-kube-api-access-xch82\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.198259 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-system-cni-dir\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.198259 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-multus-socket-dir-parent\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.198259 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/427879a1-93d6-444c-bd25-a03652257f13-tmp\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.198259 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret\") pod \"global-pull-secret-syncer-r96n6\" (UID: \"20eeae26-7b8c-4b13-976f-45be0ec631ff\") " pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:47:54.198259 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198182 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99d0098f-5c85-48d4-8c74-9507b34e99bc-env-overrides\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.198849 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99d0098f-5c85-48d4-8c74-9507b34e99bc-ovnkube-script-lib\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.198849 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7lk2\" (UniqueName: \"kubernetes.io/projected/b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26-kube-api-access-p7lk2\") pod \"node-resolver-ctblf\" (UID: \"b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26\") " pod="openshift-dns/node-resolver-ctblf" Jul 30 22:47:54.198849 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-kubelet\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.198849 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-run-ovn\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.198849 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bea329e0-01bb-4de9-8ef7-7e9e76d0a27a-host-slash\") pod \"iptables-alerter-xhn6n\" (UID: \"bea329e0-01bb-4de9-8ef7-7e9e76d0a27a\") " pod="openshift-network-operator/iptables-alerter-xhn6n" Jul 30 22:47:54.198849 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d541cd49-d536-4578-b699-eb53c81b1ad8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.198849 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-cnibin\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.198849 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-os-release\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.198849 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198344 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2cb5e16-6273-4726-b8d1-ab09e229d0c8-serviceca\") pod \"node-ca-kdwq6\" (UID: \"f2cb5e16-6273-4726-b8d1-ab09e229d0c8\") " pod="openshift-image-registry/node-ca-kdwq6" Jul 30 22:47:54.198849 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198361 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.198849 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d541cd49-d536-4578-b699-eb53c81b1ad8-cni-binary-copy\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.198849 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-var-lib-cni-bin\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.198849 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-sys-fs\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.198849 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198419 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2g2m\" (UniqueName: \"kubernetes.io/projected/99d0098f-5c85-48d4-8c74-9507b34e99bc-kube-api-access-f2g2m\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.198849 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198434 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-var-lib-cni-multus\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.198849 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hv8k\" (UniqueName: \"kubernetes.io/projected/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-kube-api-access-2hv8k\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.199440 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198461 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-slash\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.199440 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-run-netns\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.199440 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-run\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.199440 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198526 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbqm6\" (UniqueName: \"kubernetes.io/projected/f2cb5e16-6273-4726-b8d1-ab09e229d0c8-kube-api-access-xbqm6\") pod \"node-ca-kdwq6\" (UID: \"f2cb5e16-6273-4726-b8d1-ab09e229d0c8\") " pod="openshift-image-registry/node-ca-kdwq6" Jul 30 22:47:54.199440 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-run-netns\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.199440 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-node-log\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.199440 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198582 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.199440 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198596 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99d0098f-5c85-48d4-8c74-9507b34e99bc-ovn-node-metrics-cert\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.199440 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js86h\" (UniqueName: \"kubernetes.io/projected/039c09b9-d19e-480b-a820-fce0e4b7dfca-kube-api-access-js86h\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.199440 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-hostroot\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.199440 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl8wn\" (UniqueName: \"kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn\") pod \"network-check-target-jtwng\" (UID: \"a9f3bd63-f053-41d2-b0ea-7e2770e4315b\") " pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:47:54.199440 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198652 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2cb5e16-6273-4726-b8d1-ab09e229d0c8-host\") pod \"node-ca-kdwq6\" (UID: \"f2cb5e16-6273-4726-b8d1-ab09e229d0c8\") " pod="openshift-image-registry/node-ca-kdwq6" Jul 30 22:47:54.199440 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-run-systemd\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.199440 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-cni-bin\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.199440 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bea329e0-01bb-4de9-8ef7-7e9e76d0a27a-iptables-alerter-script\") pod \"iptables-alerter-xhn6n\" (UID: \"bea329e0-01bb-4de9-8ef7-7e9e76d0a27a\") " pod="openshift-network-operator/iptables-alerter-xhn6n" Jul 30 22:47:54.199440 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198709 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-registration-dir\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.199959 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d541cd49-d536-4578-b699-eb53c81b1ad8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.199959 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/039c09b9-d19e-480b-a820-fce0e4b7dfca-cni-binary-copy\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.199959 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-lib-modules\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.199959 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d304fc21-0e59-4cce-bf8d-880efd5e5ce4-agent-certs\") pod \"konnectivity-agent-bk6hf\" (UID: \"d304fc21-0e59-4cce-bf8d-880efd5e5ce4\") " pod="kube-system/konnectivity-agent-bk6hf" Jul 30 22:47:54.199959 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-var-lib-openvswitch\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.199959 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198848 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26-tmp-dir\") pod \"node-resolver-ctblf\" (UID: \"b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26\") " pod="openshift-dns/node-resolver-ctblf" Jul 30 22:47:54.199959 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-sysconfig\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.199959 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198906 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-var-lib-kubelet\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.199959 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198939 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs\") pod \"network-metrics-daemon-j8q5t\" (UID: \"ee4984a2-9082-4730-a056-597f24a92af7\") " pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:47:54.199959 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-systemd-units\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.199959 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.198993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d541cd49-d536-4578-b699-eb53c81b1ad8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.199959 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.199007 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d541cd49-d536-4578-b699-eb53c81b1ad8-system-cni-dir\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.199959 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.199052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d541cd49-d536-4578-b699-eb53c81b1ad8-cnibin\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.299927 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.299899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-kubernetes\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.299927 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.299927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-sysctl-conf\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.300138 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.299941 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-systemd\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.300138 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.299955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/427879a1-93d6-444c-bd25-a03652257f13-etc-tuned\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.300138 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.299969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20eeae26-7b8c-4b13-976f-45be0ec631ff-kubelet-config\") pod \"global-pull-secret-syncer-r96n6\" (UID: \"20eeae26-7b8c-4b13-976f-45be0ec631ff\") " pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:47:54.300138 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300032 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-kubernetes\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.300138 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-cni-netd\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.300138 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300050 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-sysctl-conf\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.300138 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300047 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-systemd\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.300138 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300032 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20eeae26-7b8c-4b13-976f-45be0ec631ff-kubelet-config\") pod \"global-pull-secret-syncer-r96n6\" (UID: \"20eeae26-7b8c-4b13-976f-45be0ec631ff\") " pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:47:54.300138 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.300138 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300075 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-cni-netd\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300096 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300146 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-var-lib-kubelet\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300177 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-var-lib-kubelet\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-multus-conf-dir\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-modprobe-d\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300228 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-multus-conf-dir\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-sys\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300250 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300296 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-sys\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300302 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-host\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300302 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-modprobe-d\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300269 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-host\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-log-socket\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26-hosts-file\") pod \"node-resolver-ctblf\" (UID: \"b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26\") " pod="openshift-dns/node-resolver-ctblf" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300404 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-device-dir\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d541cd49-d536-4578-b699-eb53c81b1ad8-os-release\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300430 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-log-socket\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.300529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300447 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/039c09b9-d19e-480b-a820-fce0e4b7dfca-multus-daemon-config\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.301246 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300472 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-run-multus-certs\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.301246 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300492 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26-hosts-file\") pod \"node-resolver-ctblf\" (UID: \"b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26\") " pod="openshift-dns/node-resolver-ctblf" Jul 30 22:47:54.301246 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300499 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-sysctl-d\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.301246 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300508 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d541cd49-d536-4578-b699-eb53c81b1ad8-os-release\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.301246 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300528 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c27mf\" (UniqueName: \"kubernetes.io/projected/427879a1-93d6-444c-bd25-a03652257f13-kube-api-access-c27mf\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.301246 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300557 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-run-multus-certs\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.301246 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20eeae26-7b8c-4b13-976f-45be0ec631ff-dbus\") pod \"global-pull-secret-syncer-r96n6\" (UID: \"20eeae26-7b8c-4b13-976f-45be0ec631ff\") " pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:47:54.301246 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300586 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-sysctl-d\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.301246 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d304fc21-0e59-4cce-bf8d-880efd5e5ce4-konnectivity-ca\") pod \"konnectivity-agent-bk6hf\" (UID: \"d304fc21-0e59-4cce-bf8d-880efd5e5ce4\") " pod="kube-system/konnectivity-agent-bk6hf" Jul 30 22:47:54.301246 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-run-openvswitch\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.301246 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300737 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20eeae26-7b8c-4b13-976f-45be0ec631ff-dbus\") pod \"global-pull-secret-syncer-r96n6\" (UID: \"20eeae26-7b8c-4b13-976f-45be0ec631ff\") " pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:47:54.301246 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300476 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-device-dir\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.301246 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300909 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-run-k8s-cni-cncf-io\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.301884 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.300662 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-run-k8s-cni-cncf-io\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.301884 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.301440 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-757lz\" (UniqueName: \"kubernetes.io/projected/ee4984a2-9082-4730-a056-597f24a92af7-kube-api-access-757lz\") pod \"network-metrics-daemon-j8q5t\" (UID: \"ee4984a2-9082-4730-a056-597f24a92af7\") " pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:47:54.301884 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.301469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99d0098f-5c85-48d4-8c74-9507b34e99bc-ovnkube-config\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.301884 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.301502 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tgcm\" (UniqueName: \"kubernetes.io/projected/bea329e0-01bb-4de9-8ef7-7e9e76d0a27a-kube-api-access-5tgcm\") pod \"iptables-alerter-xhn6n\" (UID: \"bea329e0-01bb-4de9-8ef7-7e9e76d0a27a\") " pod="openshift-network-operator/iptables-alerter-xhn6n" Jul 30 22:47:54.301884 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.301538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-socket-dir\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.301884 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.301572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xch82\" (UniqueName: \"kubernetes.io/projected/d541cd49-d536-4578-b699-eb53c81b1ad8-kube-api-access-xch82\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.301884 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.301608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-system-cni-dir\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.301884 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.301379 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-run-openvswitch\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.301884 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.301817 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d304fc21-0e59-4cce-bf8d-880efd5e5ce4-konnectivity-ca\") pod \"konnectivity-agent-bk6hf\" (UID: \"d304fc21-0e59-4cce-bf8d-880efd5e5ce4\") " pod="kube-system/konnectivity-agent-bk6hf" Jul 30 22:47:54.301884 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.301883 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-system-cni-dir\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.302386 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.301608 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/039c09b9-d19e-480b-a820-fce0e4b7dfca-multus-daemon-config\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.302386 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-multus-socket-dir-parent\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.302386 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302102 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/427879a1-93d6-444c-bd25-a03652257f13-tmp\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.302386 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret\") pod \"global-pull-secret-syncer-r96n6\" (UID: \"20eeae26-7b8c-4b13-976f-45be0ec631ff\") " pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:47:54.302386 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302176 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99d0098f-5c85-48d4-8c74-9507b34e99bc-env-overrides\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.302386 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.302253 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 22:47:54.302386 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.302381 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret podName:20eeae26-7b8c-4b13-976f-45be0ec631ff nodeName:}" failed. No retries permitted until 2026-07-30 22:47:54.8023315 +0000 UTC m=+2.006150729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret") pod "global-pull-secret-syncer-r96n6" (UID: "20eeae26-7b8c-4b13-976f-45be0ec631ff") : object "kube-system"/"original-pull-secret" not registered Jul 30 22:47:54.302723 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99d0098f-5c85-48d4-8c74-9507b34e99bc-ovnkube-script-lib\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.302723 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302451 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99d0098f-5c85-48d4-8c74-9507b34e99bc-ovnkube-config\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.302723 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7lk2\" (UniqueName: \"kubernetes.io/projected/b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26-kube-api-access-p7lk2\") pod \"node-resolver-ctblf\" (UID: \"b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26\") " pod="openshift-dns/node-resolver-ctblf" Jul 30 22:47:54.302723 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302554 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-socket-dir\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.302723 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302559 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99d0098f-5c85-48d4-8c74-9507b34e99bc-env-overrides\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.302723 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-kubelet\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.302723 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302677 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-run-ovn\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.302723 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bea329e0-01bb-4de9-8ef7-7e9e76d0a27a-host-slash\") pod \"iptables-alerter-xhn6n\" (UID: \"bea329e0-01bb-4de9-8ef7-7e9e76d0a27a\") " pod="openshift-network-operator/iptables-alerter-xhn6n" Jul 30 22:47:54.303125 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302749 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d541cd49-d536-4578-b699-eb53c81b1ad8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.303125 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-cnibin\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.303125 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302807 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-os-release\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.303125 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302840 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2cb5e16-6273-4726-b8d1-ab09e229d0c8-serviceca\") pod \"node-ca-kdwq6\" (UID: \"f2cb5e16-6273-4726-b8d1-ab09e229d0c8\") " pod="openshift-image-registry/node-ca-kdwq6" Jul 30 22:47:54.303125 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302908 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.303125 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302942 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d541cd49-d536-4578-b699-eb53c81b1ad8-cni-binary-copy\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.303125 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-var-lib-cni-bin\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.303125 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.302998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-sys-fs\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.303125 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303007 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bea329e0-01bb-4de9-8ef7-7e9e76d0a27a-host-slash\") pod \"iptables-alerter-xhn6n\" (UID: \"bea329e0-01bb-4de9-8ef7-7e9e76d0a27a\") " pod="openshift-network-operator/iptables-alerter-xhn6n" Jul 30 22:47:54.303125 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2g2m\" (UniqueName: \"kubernetes.io/projected/99d0098f-5c85-48d4-8c74-9507b34e99bc-kube-api-access-f2g2m\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.303125 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303086 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-var-lib-cni-multus\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.303638 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hv8k\" (UniqueName: \"kubernetes.io/projected/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-kube-api-access-2hv8k\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.303638 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303164 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-slash\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.303638 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-run-netns\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.303638 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-run\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.303638 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbqm6\" (UniqueName: \"kubernetes.io/projected/f2cb5e16-6273-4726-b8d1-ab09e229d0c8-kube-api-access-xbqm6\") pod \"node-ca-kdwq6\" (UID: \"f2cb5e16-6273-4726-b8d1-ab09e229d0c8\") " pod="openshift-image-registry/node-ca-kdwq6" Jul 30 22:47:54.303638 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-run-netns\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.303638 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303324 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-node-log\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.303638 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.303638 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99d0098f-5c85-48d4-8c74-9507b34e99bc-ovn-node-metrics-cert\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.303638 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js86h\" (UniqueName: \"kubernetes.io/projected/039c09b9-d19e-480b-a820-fce0e4b7dfca-kube-api-access-js86h\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.303638 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303477 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.303638 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-hostroot\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.303638 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303558 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99d0098f-5c85-48d4-8c74-9507b34e99bc-ovnkube-script-lib\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.303638 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303567 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-multus-socket-dir-parent\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.303638 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303581 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-hostroot\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.303638 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303640 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-cnibin\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303657 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-var-lib-cni-bin\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303701 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d541cd49-d536-4578-b699-eb53c81b1ad8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303712 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-os-release\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303715 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-kubelet\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303798 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-var-lib-cni-multus\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303933 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-run-netns\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.303993 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-node-log\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304017 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-slash\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304043 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304075 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-host-run-netns\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304129 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-run\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304128 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2cb5e16-6273-4726-b8d1-ab09e229d0c8-serviceca\") pod \"node-ca-kdwq6\" (UID: \"f2cb5e16-6273-4726-b8d1-ab09e229d0c8\") " pod="openshift-image-registry/node-ca-kdwq6" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304178 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d541cd49-d536-4578-b699-eb53c81b1ad8-cni-binary-copy\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304258 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-run-ovn\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304298 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl8wn\" (UniqueName: \"kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn\") pod \"network-check-target-jtwng\" (UID: \"a9f3bd63-f053-41d2-b0ea-7e2770e4315b\") " pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2cb5e16-6273-4726-b8d1-ab09e229d0c8-host\") pod \"node-ca-kdwq6\" (UID: \"f2cb5e16-6273-4726-b8d1-ab09e229d0c8\") " pod="openshift-image-registry/node-ca-kdwq6" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-run-systemd\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.304437 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304409 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-run-systemd\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.305310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304419 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2cb5e16-6273-4726-b8d1-ab09e229d0c8-host\") pod \"node-ca-kdwq6\" (UID: \"f2cb5e16-6273-4726-b8d1-ab09e229d0c8\") " pod="openshift-image-registry/node-ca-kdwq6" Jul 30 22:47:54.305310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304459 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-sys-fs\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.305310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-cni-bin\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.305310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304502 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bea329e0-01bb-4de9-8ef7-7e9e76d0a27a-iptables-alerter-script\") pod \"iptables-alerter-xhn6n\" (UID: \"bea329e0-01bb-4de9-8ef7-7e9e76d0a27a\") " pod="openshift-network-operator/iptables-alerter-xhn6n" Jul 30 22:47:54.305310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-registration-dir\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.305310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304556 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-host-cni-bin\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.305310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d541cd49-d536-4578-b699-eb53c81b1ad8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.305310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/039c09b9-d19e-480b-a820-fce0e4b7dfca-cni-binary-copy\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.305310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304628 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-lib-modules\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.305310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d304fc21-0e59-4cce-bf8d-880efd5e5ce4-agent-certs\") pod \"konnectivity-agent-bk6hf\" (UID: \"d304fc21-0e59-4cce-bf8d-880efd5e5ce4\") " pod="kube-system/konnectivity-agent-bk6hf" Jul 30 22:47:54.305310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-var-lib-openvswitch\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.305310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26-tmp-dir\") pod \"node-resolver-ctblf\" (UID: \"b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26\") " pod="openshift-dns/node-resolver-ctblf" Jul 30 22:47:54.305310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-sysconfig\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.305310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-var-lib-kubelet\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.305310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs\") pod \"network-metrics-daemon-j8q5t\" (UID: \"ee4984a2-9082-4730-a056-597f24a92af7\") " pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:47:54.305310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304842 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-systemd-units\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.305310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304888 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d541cd49-d536-4578-b699-eb53c81b1ad8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d541cd49-d536-4578-b699-eb53c81b1ad8-system-cni-dir\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d541cd49-d536-4578-b699-eb53c81b1ad8-cnibin\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.304980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-multus-cni-dir\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305010 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-etc-kubernetes\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-etc-openvswitch\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305079 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d541cd49-d536-4578-b699-eb53c81b1ad8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305107 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bea329e0-01bb-4de9-8ef7-7e9e76d0a27a-iptables-alerter-script\") pod \"iptables-alerter-xhn6n\" (UID: \"bea329e0-01bb-4de9-8ef7-7e9e76d0a27a\") " pod="openshift-network-operator/iptables-alerter-xhn6n" Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305288 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d541cd49-d536-4578-b699-eb53c81b1ad8-system-cni-dir\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305308 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/427879a1-93d6-444c-bd25-a03652257f13-tmp\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305338 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-multus-cni-dir\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305437 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d541cd49-d536-4578-b699-eb53c81b1ad8-cnibin\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305480 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/427879a1-93d6-444c-bd25-a03652257f13-etc-tuned\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305489 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-var-lib-kubelet\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305572 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-registration-dir\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305610 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26-tmp-dir\") pod \"node-resolver-ctblf\" (UID: \"b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26\") " pod="openshift-dns/node-resolver-ctblf" Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.305665 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 22:47:54.306143 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305676 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/039c09b9-d19e-480b-a820-fce0e4b7dfca-etc-kubernetes\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.306994 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305735 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-etc-openvswitch\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.306994 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305770 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.306994 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305824 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-etc-sysconfig\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.306994 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305847 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/427879a1-93d6-444c-bd25-a03652257f13-lib-modules\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.306994 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305886 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-systemd-units\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.306994 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.305923 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs podName:ee4984a2-9082-4730-a056-597f24a92af7 nodeName:}" failed. No retries permitted until 2026-07-30 22:47:54.80590326 +0000 UTC m=+2.009722476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs") pod "network-metrics-daemon-j8q5t" (UID: "ee4984a2-9082-4730-a056-597f24a92af7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 22:47:54.306994 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.305940 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99d0098f-5c85-48d4-8c74-9507b34e99bc-var-lib-openvswitch\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.306994 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.306307 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d541cd49-d536-4578-b699-eb53c81b1ad8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.306994 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.306494 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/039c09b9-d19e-480b-a820-fce0e4b7dfca-cni-binary-copy\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.307633 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.307609 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99d0098f-5c85-48d4-8c74-9507b34e99bc-ovn-node-metrics-cert\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.307916 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.307896 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d304fc21-0e59-4cce-bf8d-880efd5e5ce4-agent-certs\") pod \"konnectivity-agent-bk6hf\" (UID: \"d304fc21-0e59-4cce-bf8d-880efd5e5ce4\") " pod="kube-system/konnectivity-agent-bk6hf" Jul 30 22:47:54.310488 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.310456 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-757lz\" (UniqueName: \"kubernetes.io/projected/ee4984a2-9082-4730-a056-597f24a92af7-kube-api-access-757lz\") pod \"network-metrics-daemon-j8q5t\" (UID: \"ee4984a2-9082-4730-a056-597f24a92af7\") " pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:47:54.310831 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.310813 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tgcm\" (UniqueName: \"kubernetes.io/projected/bea329e0-01bb-4de9-8ef7-7e9e76d0a27a-kube-api-access-5tgcm\") pod \"iptables-alerter-xhn6n\" (UID: \"bea329e0-01bb-4de9-8ef7-7e9e76d0a27a\") " pod="openshift-network-operator/iptables-alerter-xhn6n" Jul 30 22:47:54.310912 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.310898 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c27mf\" (UniqueName: \"kubernetes.io/projected/427879a1-93d6-444c-bd25-a03652257f13-kube-api-access-c27mf\") pod \"tuned-87pww\" (UID: \"427879a1-93d6-444c-bd25-a03652257f13\") " pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.311333 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.311308 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xch82\" (UniqueName: \"kubernetes.io/projected/d541cd49-d536-4578-b699-eb53c81b1ad8-kube-api-access-xch82\") pod \"multus-additional-cni-plugins-zsjdm\" (UID: \"d541cd49-d536-4578-b699-eb53c81b1ad8\") " pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.314694 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.314677 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 22:47:54.314694 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.314695 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 22:47:54.314807 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.314705 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fl8wn for pod openshift-network-diagnostics/network-check-target-jtwng: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 22:47:54.314807 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.314747 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn podName:a9f3bd63-f053-41d2-b0ea-7e2770e4315b nodeName:}" failed. No retries permitted until 2026-07-30 22:47:54.814733575 +0000 UTC m=+2.018552787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fl8wn" (UniqueName: "kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn") pod "network-check-target-jtwng" (UID: "a9f3bd63-f053-41d2-b0ea-7e2770e4315b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 22:47:54.317344 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.317316 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2g2m\" (UniqueName: \"kubernetes.io/projected/99d0098f-5c85-48d4-8c74-9507b34e99bc-kube-api-access-f2g2m\") pod \"ovnkube-node-cm48d\" (UID: \"99d0098f-5c85-48d4-8c74-9507b34e99bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.317551 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.317526 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7lk2\" (UniqueName: \"kubernetes.io/projected/b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26-kube-api-access-p7lk2\") pod \"node-resolver-ctblf\" (UID: \"b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26\") " pod="openshift-dns/node-resolver-ctblf" Jul 30 22:47:54.317662 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.317642 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbqm6\" (UniqueName: \"kubernetes.io/projected/f2cb5e16-6273-4726-b8d1-ab09e229d0c8-kube-api-access-xbqm6\") pod \"node-ca-kdwq6\" (UID: \"f2cb5e16-6273-4726-b8d1-ab09e229d0c8\") " pod="openshift-image-registry/node-ca-kdwq6" Jul 30 22:47:54.317729 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.317712 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hv8k\" (UniqueName: \"kubernetes.io/projected/7ac93fd2-a00e-47b5-85b2-69bd46ae71cd-kube-api-access-2hv8k\") pod \"aws-ebs-csi-driver-node-6d7t4\" (UID: \"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.318035 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.318016 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js86h\" (UniqueName: \"kubernetes.io/projected/039c09b9-d19e-480b-a820-fce0e4b7dfca-kube-api-access-js86h\") pod \"multus-t9b54\" (UID: \"039c09b9-d19e-480b-a820-fce0e4b7dfca\") " pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.334768 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:54.334738 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85fd0607521b56acd9e31e115458dcc6.slice/crio-050eb7607dc30e507a51676b37d9bae85be500319b55b7ef553ea4c5bdff6fdc WatchSource:0}: Error finding container 050eb7607dc30e507a51676b37d9bae85be500319b55b7ef553ea4c5bdff6fdc: Status 404 returned error can't find the container with id 050eb7607dc30e507a51676b37d9bae85be500319b55b7ef553ea4c5bdff6fdc Jul 30 22:47:54.335215 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:54.335198 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c5ea9b707c6dfdf55342b71f73c37b.slice/crio-0bbf6253388ab06421206f2e444fe8d715280d2efcee99e8842b58b1d9831089 WatchSource:0}: Error finding container 0bbf6253388ab06421206f2e444fe8d715280d2efcee99e8842b58b1d9831089: Status 404 returned error can't find the container with id 0bbf6253388ab06421206f2e444fe8d715280d2efcee99e8842b58b1d9831089 Jul 30 22:47:54.340402 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.340377 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 22:47:54.429771 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.429700 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xhn6n" Jul 30 22:47:54.438522 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:54.438496 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea329e0_01bb_4de9_8ef7_7e9e76d0a27a.slice/crio-cc3f95b1eb24d7d92f7564d741679434d6c3228e3727ff12598f10907c7bfd1a WatchSource:0}: Error finding container cc3f95b1eb24d7d92f7564d741679434d6c3228e3727ff12598f10907c7bfd1a: Status 404 returned error can't find the container with id cc3f95b1eb24d7d92f7564d741679434d6c3228e3727ff12598f10907c7bfd1a Jul 30 22:47:54.451322 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.451306 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" Jul 30 22:47:54.458555 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:54.458535 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ac93fd2_a00e_47b5_85b2_69bd46ae71cd.slice/crio-66ebec96e21623e1d2a7f2f3358f13ea57dbc972f6cba44c7ddd620072a31297 WatchSource:0}: Error finding container 66ebec96e21623e1d2a7f2f3358f13ea57dbc972f6cba44c7ddd620072a31297: Status 404 returned error can't find the container with id 66ebec96e21623e1d2a7f2f3358f13ea57dbc972f6cba44c7ddd620072a31297 Jul 30 22:47:54.469059 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.469044 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kdwq6" Jul 30 22:47:54.476481 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:54.476461 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2cb5e16_6273_4726_b8d1_ab09e229d0c8.slice/crio-c61a1d4449f7a6a5b3cba0f8acf269c6c721ee431da25f8606aff142960dae9f WatchSource:0}: Error finding container c61a1d4449f7a6a5b3cba0f8acf269c6c721ee431da25f8606aff142960dae9f: Status 404 returned error can't find the container with id c61a1d4449f7a6a5b3cba0f8acf269c6c721ee431da25f8606aff142960dae9f Jul 30 22:47:54.493464 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.493443 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zsjdm" Jul 30 22:47:54.501419 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:54.501402 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd541cd49_d536_4578_b699_eb53c81b1ad8.slice/crio-e6903ff5c0d79b2a48b482503721470b5d17ef868ab4137d25d6e788f8ee4ac5 WatchSource:0}: Error finding container e6903ff5c0d79b2a48b482503721470b5d17ef868ab4137d25d6e788f8ee4ac5: Status 404 returned error can't find the container with id e6903ff5c0d79b2a48b482503721470b5d17ef868ab4137d25d6e788f8ee4ac5 Jul 30 22:47:54.507386 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.507370 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t9b54" Jul 30 22:47:54.514488 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:54.514472 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039c09b9_d19e_480b_a820_fce0e4b7dfca.slice/crio-5158cf14fdabd47e441bd900580930cc1c5115e5ef99b5828226f78722d9d19e WatchSource:0}: Error finding container 5158cf14fdabd47e441bd900580930cc1c5115e5ef99b5828226f78722d9d19e: Status 404 returned error can't find the container with id 5158cf14fdabd47e441bd900580930cc1c5115e5ef99b5828226f78722d9d19e Jul 30 22:47:54.529468 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.529452 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bk6hf" Jul 30 22:47:54.536996 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:54.536976 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd304fc21_0e59_4cce_bf8d_880efd5e5ce4.slice/crio-53adda469674a5c802d06b83e48189660f622cf1eadec6760ff947c43e4d35e1 WatchSource:0}: Error finding container 53adda469674a5c802d06b83e48189660f622cf1eadec6760ff947c43e4d35e1: Status 404 returned error can't find the container with id 53adda469674a5c802d06b83e48189660f622cf1eadec6760ff947c43e4d35e1 Jul 30 22:47:54.544082 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.544065 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:47:54.551137 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:54.551115 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99d0098f_5c85_48d4_8c74_9507b34e99bc.slice/crio-06d1d21198506e6cc6346cbfd64e1bd4bb524b0c001230c0180f5942a325800f WatchSource:0}: Error finding container 06d1d21198506e6cc6346cbfd64e1bd4bb524b0c001230c0180f5942a325800f: Status 404 returned error can't find the container with id 06d1d21198506e6cc6346cbfd64e1bd4bb524b0c001230c0180f5942a325800f Jul 30 22:47:54.562524 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.562509 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-87pww" Jul 30 22:47:54.567198 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.567185 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ctblf" Jul 30 22:47:54.569616 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:54.569597 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427879a1_93d6_444c_bd25_a03652257f13.slice/crio-8ebdfedee75241ee2c655f6622c9d44f50a64e24e74fca31f0f133c2067e32d5 WatchSource:0}: Error finding container 8ebdfedee75241ee2c655f6622c9d44f50a64e24e74fca31f0f133c2067e32d5: Status 404 returned error can't find the container with id 8ebdfedee75241ee2c655f6622c9d44f50a64e24e74fca31f0f133c2067e32d5 Jul 30 22:47:54.575275 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:47:54.575255 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f4f25a_2e4b_4ce2_a8cc_cfe94a097f26.slice/crio-65c2fa718c7ba0011985111db614be9e83b85f058cfae29f6f1eef4222b063b9 WatchSource:0}: Error finding container 65c2fa718c7ba0011985111db614be9e83b85f058cfae29f6f1eef4222b063b9: Status 404 returned error can't find the container with id 65c2fa718c7ba0011985111db614be9e83b85f058cfae29f6f1eef4222b063b9 Jul 30 22:47:54.604086 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.604069 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 22:47:54.808179 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.808101 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret\") pod \"global-pull-secret-syncer-r96n6\" (UID: \"20eeae26-7b8c-4b13-976f-45be0ec631ff\") " pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:47:54.808179 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.808167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs\") pod \"network-metrics-daemon-j8q5t\" (UID: \"ee4984a2-9082-4730-a056-597f24a92af7\") " pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:47:54.808385 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.808245 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 22:47:54.808385 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.808255 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 22:47:54.808385 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.808318 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret podName:20eeae26-7b8c-4b13-976f-45be0ec631ff nodeName:}" failed. No retries permitted until 2026-07-30 22:47:55.808298836 +0000 UTC m=+3.012118050 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret") pod "global-pull-secret-syncer-r96n6" (UID: "20eeae26-7b8c-4b13-976f-45be0ec631ff") : object "kube-system"/"original-pull-secret" not registered Jul 30 22:47:54.808385 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.808337 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs podName:ee4984a2-9082-4730-a056-597f24a92af7 nodeName:}" failed. No retries permitted until 2026-07-30 22:47:55.808327595 +0000 UTC m=+3.012146813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs") pod "network-metrics-daemon-j8q5t" (UID: "ee4984a2-9082-4730-a056-597f24a92af7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 22:47:54.909447 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.909412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl8wn\" (UniqueName: \"kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn\") pod \"network-check-target-jtwng\" (UID: \"a9f3bd63-f053-41d2-b0ea-7e2770e4315b\") " pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:47:54.909641 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.909620 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 22:47:54.909641 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.909640 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 22:47:54.909763 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.909652 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fl8wn for pod openshift-network-diagnostics/network-check-target-jtwng: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 22:47:54.909763 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:54.909705 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn podName:a9f3bd63-f053-41d2-b0ea-7e2770e4315b nodeName:}" failed. No retries permitted until 2026-07-30 22:47:55.909686391 +0000 UTC m=+3.113505608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fl8wn" (UniqueName: "kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn") pod "network-check-target-jtwng" (UID: "a9f3bd63-f053-41d2-b0ea-7e2770e4315b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 22:47:54.993806 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:54.993780 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 22:47:55.150728 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:55.150580 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 22:42:54 +0000 UTC" deadline="2028-05-14 18:48:57.846092098 +0000 UTC" Jul 30 22:47:55.150728 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:55.150674 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15692h1m2.695422086s" Jul 30 22:47:55.233379 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:55.233345 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:47:55.233543 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:55.233476 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:47:55.284828 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:55.282798 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-87pww" event={"ID":"427879a1-93d6-444c-bd25-a03652257f13","Type":"ContainerStarted","Data":"8ebdfedee75241ee2c655f6622c9d44f50a64e24e74fca31f0f133c2067e32d5"} Jul 30 22:47:55.288210 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:55.288108 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bk6hf" event={"ID":"d304fc21-0e59-4cce-bf8d-880efd5e5ce4","Type":"ContainerStarted","Data":"53adda469674a5c802d06b83e48189660f622cf1eadec6760ff947c43e4d35e1"} Jul 30 22:47:55.302019 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:55.301990 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t9b54" event={"ID":"039c09b9-d19e-480b-a820-fce0e4b7dfca","Type":"ContainerStarted","Data":"5158cf14fdabd47e441bd900580930cc1c5115e5ef99b5828226f78722d9d19e"} Jul 30 22:47:55.315933 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:55.315870 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kdwq6" event={"ID":"f2cb5e16-6273-4726-b8d1-ab09e229d0c8","Type":"ContainerStarted","Data":"c61a1d4449f7a6a5b3cba0f8acf269c6c721ee431da25f8606aff142960dae9f"} Jul 30 22:47:55.321280 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:55.321121 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal" event={"ID":"37c5ea9b707c6dfdf55342b71f73c37b","Type":"ContainerStarted","Data":"0bbf6253388ab06421206f2e444fe8d715280d2efcee99e8842b58b1d9831089"} Jul 30 22:47:55.340329 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:55.340299 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ctblf" event={"ID":"b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26","Type":"ContainerStarted","Data":"65c2fa718c7ba0011985111db614be9e83b85f058cfae29f6f1eef4222b063b9"} Jul 30 22:47:55.355179 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:55.355153 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" event={"ID":"99d0098f-5c85-48d4-8c74-9507b34e99bc","Type":"ContainerStarted","Data":"06d1d21198506e6cc6346cbfd64e1bd4bb524b0c001230c0180f5942a325800f"} Jul 30 22:47:55.362480 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:55.362455 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsjdm" event={"ID":"d541cd49-d536-4578-b699-eb53c81b1ad8","Type":"ContainerStarted","Data":"e6903ff5c0d79b2a48b482503721470b5d17ef868ab4137d25d6e788f8ee4ac5"} Jul 30 22:47:55.365715 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:55.365691 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" event={"ID":"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd","Type":"ContainerStarted","Data":"66ebec96e21623e1d2a7f2f3358f13ea57dbc972f6cba44c7ddd620072a31297"} Jul 30 22:47:55.373072 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:55.373048 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xhn6n" event={"ID":"bea329e0-01bb-4de9-8ef7-7e9e76d0a27a","Type":"ContainerStarted","Data":"cc3f95b1eb24d7d92f7564d741679434d6c3228e3727ff12598f10907c7bfd1a"} Jul 30 22:47:55.388337 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:55.388312 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal" event={"ID":"85fd0607521b56acd9e31e115458dcc6","Type":"ContainerStarted","Data":"050eb7607dc30e507a51676b37d9bae85be500319b55b7ef553ea4c5bdff6fdc"} Jul 30 22:47:55.816380 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:55.816351 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs\") pod \"network-metrics-daemon-j8q5t\" (UID: \"ee4984a2-9082-4730-a056-597f24a92af7\") " pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:47:55.816555 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:55.816429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret\") pod \"global-pull-secret-syncer-r96n6\" (UID: \"20eeae26-7b8c-4b13-976f-45be0ec631ff\") " pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:47:55.816555 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:55.816541 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 22:47:55.816656 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:55.816598 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret podName:20eeae26-7b8c-4b13-976f-45be0ec631ff nodeName:}" failed. No retries permitted until 2026-07-30 22:47:57.816580332 +0000 UTC m=+5.020399561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret") pod "global-pull-secret-syncer-r96n6" (UID: "20eeae26-7b8c-4b13-976f-45be0ec631ff") : object "kube-system"/"original-pull-secret" not registered Jul 30 22:47:55.817058 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:55.817036 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 22:47:55.817166 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:55.817091 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs podName:ee4984a2-9082-4730-a056-597f24a92af7 nodeName:}" failed. No retries permitted until 2026-07-30 22:47:57.817077069 +0000 UTC m=+5.020896284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs") pod "network-metrics-daemon-j8q5t" (UID: "ee4984a2-9082-4730-a056-597f24a92af7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 22:47:55.922254 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:55.922224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl8wn\" (UniqueName: \"kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn\") pod \"network-check-target-jtwng\" (UID: \"a9f3bd63-f053-41d2-b0ea-7e2770e4315b\") " pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:47:55.922471 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:55.922452 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 22:47:55.922542 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:55.922480 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 22:47:55.922542 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:55.922501 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fl8wn for pod openshift-network-diagnostics/network-check-target-jtwng: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 22:47:55.922647 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:55.922578 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn podName:a9f3bd63-f053-41d2-b0ea-7e2770e4315b nodeName:}" failed. No retries permitted until 2026-07-30 22:47:57.922552605 +0000 UTC m=+5.126371820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fl8wn" (UniqueName: "kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn") pod "network-check-target-jtwng" (UID: "a9f3bd63-f053-41d2-b0ea-7e2770e4315b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 22:47:56.147834 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:56.147805 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 22:47:56.151202 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:56.151156 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 22:42:54 +0000 UTC" deadline="2028-02-27 10:14:54.139700988 +0000 UTC" Jul 30 22:47:56.151202 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:56.151202 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13835h26m57.988503304s" Jul 30 22:47:56.230634 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:56.230605 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:47:56.230804 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:56.230750 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:47:56.231163 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:56.231146 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:47:56.231253 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:56.231238 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:47:57.187039 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:57.187012 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 22:47:57.231981 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:57.230849 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:47:57.231981 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:57.230987 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:47:57.839925 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:57.839370 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs\") pod \"network-metrics-daemon-j8q5t\" (UID: \"ee4984a2-9082-4730-a056-597f24a92af7\") " pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:47:57.839925 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:57.839434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret\") pod \"global-pull-secret-syncer-r96n6\" (UID: \"20eeae26-7b8c-4b13-976f-45be0ec631ff\") " pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:47:57.839925 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:57.839551 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 22:47:57.839925 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:57.839610 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret podName:20eeae26-7b8c-4b13-976f-45be0ec631ff nodeName:}" failed. No retries permitted until 2026-07-30 22:48:01.839590797 +0000 UTC m=+9.043410012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret") pod "global-pull-secret-syncer-r96n6" (UID: "20eeae26-7b8c-4b13-976f-45be0ec631ff") : object "kube-system"/"original-pull-secret" not registered Jul 30 22:47:57.839925 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:57.839821 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 22:47:57.839925 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:57.839894 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs podName:ee4984a2-9082-4730-a056-597f24a92af7 nodeName:}" failed. No retries permitted until 2026-07-30 22:48:01.839876954 +0000 UTC m=+9.043696187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs") pod "network-metrics-daemon-j8q5t" (UID: "ee4984a2-9082-4730-a056-597f24a92af7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 22:47:57.940352 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:57.940319 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl8wn\" (UniqueName: \"kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn\") pod \"network-check-target-jtwng\" (UID: \"a9f3bd63-f053-41d2-b0ea-7e2770e4315b\") " pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:47:57.940532 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:57.940498 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 22:47:57.940532 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:57.940519 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 22:47:57.940643 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:57.940533 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fl8wn for pod openshift-network-diagnostics/network-check-target-jtwng: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 22:47:57.940643 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:57.940589 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn podName:a9f3bd63-f053-41d2-b0ea-7e2770e4315b nodeName:}" failed. No retries permitted until 2026-07-30 22:48:01.940570212 +0000 UTC m=+9.144389436 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fl8wn" (UniqueName: "kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn") pod "network-check-target-jtwng" (UID: "a9f3bd63-f053-41d2-b0ea-7e2770e4315b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 22:47:58.231407 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:58.230967 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:47:58.231407 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:58.230990 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:47:58.231407 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:58.231100 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:47:58.231407 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:58.231322 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:47:59.230738 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:47:59.230261 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:47:59.230738 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:47:59.230392 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:00.230827 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:00.230793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:00.231260 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:00.230808 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:00.231260 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:00.230949 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:00.231260 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:00.231023 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:01.234374 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:01.233916 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:01.234374 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:01.234036 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:01.871226 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:01.870910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret\") pod \"global-pull-secret-syncer-r96n6\" (UID: \"20eeae26-7b8c-4b13-976f-45be0ec631ff\") " pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:01.871226 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:01.871001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs\") pod \"network-metrics-daemon-j8q5t\" (UID: \"ee4984a2-9082-4730-a056-597f24a92af7\") " pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:01.871226 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:01.871096 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 22:48:01.871226 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:01.871110 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 22:48:01.871226 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:01.871177 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs podName:ee4984a2-9082-4730-a056-597f24a92af7 nodeName:}" failed. No retries permitted until 2026-07-30 22:48:09.87115709 +0000 UTC m=+17.074976321 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs") pod "network-metrics-daemon-j8q5t" (UID: "ee4984a2-9082-4730-a056-597f24a92af7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 22:48:01.871226 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:01.871198 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret podName:20eeae26-7b8c-4b13-976f-45be0ec631ff nodeName:}" failed. No retries permitted until 2026-07-30 22:48:09.87118886 +0000 UTC m=+17.075008071 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret") pod "global-pull-secret-syncer-r96n6" (UID: "20eeae26-7b8c-4b13-976f-45be0ec631ff") : object "kube-system"/"original-pull-secret" not registered Jul 30 22:48:01.971877 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:01.971828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl8wn\" (UniqueName: \"kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn\") pod \"network-check-target-jtwng\" (UID: \"a9f3bd63-f053-41d2-b0ea-7e2770e4315b\") " pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:01.972053 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:01.972009 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 22:48:01.972053 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:01.972034 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 22:48:01.972053 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:01.972044 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fl8wn for pod openshift-network-diagnostics/network-check-target-jtwng: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 22:48:01.972211 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:01.972099 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn podName:a9f3bd63-f053-41d2-b0ea-7e2770e4315b nodeName:}" failed. No retries permitted until 2026-07-30 22:48:09.972085797 +0000 UTC m=+17.175905013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fl8wn" (UniqueName: "kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn") pod "network-check-target-jtwng" (UID: "a9f3bd63-f053-41d2-b0ea-7e2770e4315b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 22:48:02.231279 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:02.230878 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:02.231279 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:02.230986 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:02.231279 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:02.230994 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:02.231279 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:02.231072 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:03.232154 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:03.231697 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:03.232154 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:03.231813 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:04.230811 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:04.230771 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:04.231018 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:04.230774 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:04.231018 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:04.230936 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:04.231018 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:04.230977 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:05.233746 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:05.233720 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:05.234166 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:05.233843 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:06.230087 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:06.230049 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:06.230333 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:06.230108 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:06.230333 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:06.230203 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:06.230450 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:06.230324 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:07.230232 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:07.230198 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:07.230667 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:07.230324 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:08.230633 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:08.230599 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:08.230633 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:08.230624 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:08.231147 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:08.230713 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:08.231147 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:08.230842 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:09.230916 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:09.230886 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:09.231388 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:09.231010 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:09.930752 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:09.930721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret\") pod \"global-pull-secret-syncer-r96n6\" (UID: \"20eeae26-7b8c-4b13-976f-45be0ec631ff\") " pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:09.930923 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:09.930770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs\") pod \"network-metrics-daemon-j8q5t\" (UID: \"ee4984a2-9082-4730-a056-597f24a92af7\") " pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:09.930923 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:09.930870 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 22:48:09.930923 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:09.930874 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 22:48:09.930923 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:09.930917 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs podName:ee4984a2-9082-4730-a056-597f24a92af7 nodeName:}" failed. No retries permitted until 2026-07-30 22:48:25.930904667 +0000 UTC m=+33.134723878 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs") pod "network-metrics-daemon-j8q5t" (UID: "ee4984a2-9082-4730-a056-597f24a92af7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 22:48:09.931073 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:09.930931 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret podName:20eeae26-7b8c-4b13-976f-45be0ec631ff nodeName:}" failed. No retries permitted until 2026-07-30 22:48:25.930924776 +0000 UTC m=+33.134743988 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret") pod "global-pull-secret-syncer-r96n6" (UID: "20eeae26-7b8c-4b13-976f-45be0ec631ff") : object "kube-system"/"original-pull-secret" not registered Jul 30 22:48:10.031932 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:10.031899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl8wn\" (UniqueName: \"kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn\") pod \"network-check-target-jtwng\" (UID: \"a9f3bd63-f053-41d2-b0ea-7e2770e4315b\") " pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:10.032092 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:10.032069 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 22:48:10.032092 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:10.032091 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 22:48:10.032205 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:10.032103 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fl8wn for pod openshift-network-diagnostics/network-check-target-jtwng: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 22:48:10.032205 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:10.032156 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn podName:a9f3bd63-f053-41d2-b0ea-7e2770e4315b nodeName:}" failed. No retries permitted until 2026-07-30 22:48:26.032139116 +0000 UTC m=+33.235958329 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fl8wn" (UniqueName: "kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn") pod "network-check-target-jtwng" (UID: "a9f3bd63-f053-41d2-b0ea-7e2770e4315b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 22:48:10.230174 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:10.230140 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:10.230373 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:10.230183 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:10.230373 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:10.230270 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:10.230479 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:10.230419 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:11.230729 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:11.230696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:11.231319 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:11.230830 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:12.230401 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:12.230357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:12.230578 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:12.230357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:12.230578 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:12.230499 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:12.230685 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:12.230613 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:13.231923 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:13.231886 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:13.232311 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:13.232034 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:14.230809 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:14.230651 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:14.230909 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:14.230656 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:14.230955 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:14.230901 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:14.230994 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:14.230953 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:14.438585 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:14.438477 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" event={"ID":"99d0098f-5c85-48d4-8c74-9507b34e99bc","Type":"ContainerStarted","Data":"785d45c2e897b0c62c8f7bc4ee1e6ca52df2d0cbb2b53ea06b76157f06f8afc7"} Jul 30 22:48:14.438585 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:14.438571 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" event={"ID":"99d0098f-5c85-48d4-8c74-9507b34e99bc","Type":"ContainerStarted","Data":"f7f97b13c94aaf13d6bd58cdd658e90a00017226e7712e49300350a4c4f659c9"} Jul 30 22:48:14.439009 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:14.438621 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" event={"ID":"99d0098f-5c85-48d4-8c74-9507b34e99bc","Type":"ContainerStarted","Data":"d660d3d9182b42eda7ce5a0c9f3c0db786c5213924c70e1feadb061d28ad214a"} Jul 30 22:48:14.442710 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:14.442680 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal" event={"ID":"85fd0607521b56acd9e31e115458dcc6","Type":"ContainerStarted","Data":"d57a146faa6805241bb3596403e3695af88d85cc83ac10635633d4a6d1b95214"} Jul 30 22:48:14.446674 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:14.446619 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-87pww" event={"ID":"427879a1-93d6-444c-bd25-a03652257f13","Type":"ContainerStarted","Data":"3a484fdde54321991eb95e9598a02a831f4c2548de0eb7a17292e7853b71a574"} Jul 30 22:48:14.450592 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:14.450544 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t9b54" event={"ID":"039c09b9-d19e-480b-a820-fce0e4b7dfca","Type":"ContainerStarted","Data":"dbea9931181dcd0df594c41dd1bfd24afee81ab8c067e45bf8c4b030832d821c"} Jul 30 22:48:14.460158 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:14.459739 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal" podStartSLOduration=20.459720148 podStartE2EDuration="20.459720148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:14.459292024 +0000 UTC m=+21.663111260" watchObservedRunningTime="2026-07-30 22:48:14.459720148 +0000 UTC m=+21.663539385" Jul 30 22:48:14.478409 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:14.478368 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-87pww" podStartSLOduration=2.166555155 podStartE2EDuration="21.478312421s" totalImagesPullingTime="19.311757266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:14.477778323 +0000 UTC m=+21.681597561" watchObservedRunningTime="2026-07-30 22:48:14.478312421 +0000 UTC m=+21.682131654" Jul 30 22:48:14.500709 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:14.500528 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t9b54" podStartSLOduration=2.092650385 podStartE2EDuration="21.500509806s" totalImagesPullingTime="19.407859421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:14.499840275 +0000 UTC m=+21.703659513" watchObservedRunningTime="2026-07-30 22:48:14.500509806 +0000 UTC m=+21.704329039" Jul 30 22:48:15.230596 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.230568 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:15.230721 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:15.230693 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:15.453662 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.453577 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bk6hf" event={"ID":"d304fc21-0e59-4cce-bf8d-880efd5e5ce4","Type":"ContainerStarted","Data":"3035f173c345c2cc692c657aa506bce1babe52cbcb4549f81dff8b4f539aa778"} Jul 30 22:48:15.455102 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.455079 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kdwq6" event={"ID":"f2cb5e16-6273-4726-b8d1-ab09e229d0c8","Type":"ContainerStarted","Data":"3f612e3849026f3790fe2e2459cf6680242cf3463c9182b54976cfcc9c0e3fb2"} Jul 30 22:48:15.456449 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.456426 2576 generic.go:356] "Generic (PLEG): container finished" podID="37c5ea9b707c6dfdf55342b71f73c37b" containerID="f65694507226ff4d34c402fc0c51fbfceff35ab21fda9c70b19e434778414793" exitCode=0 Jul 30 22:48:15.456546 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.456494 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal" event={"ID":"37c5ea9b707c6dfdf55342b71f73c37b","Type":"ContainerDied","Data":"f65694507226ff4d34c402fc0c51fbfceff35ab21fda9c70b19e434778414793"} Jul 30 22:48:15.457893 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.457869 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ctblf" event={"ID":"b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26","Type":"ContainerStarted","Data":"3e5510d48b6e617d26e51f15218b357a8d5d8240a61894d95b7f786035492bb5"} Jul 30 22:48:15.460417 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.460399 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 22:48:15.460733 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.460713 2576 generic.go:356] "Generic (PLEG): container finished" podID="99d0098f-5c85-48d4-8c74-9507b34e99bc" containerID="f7f97b13c94aaf13d6bd58cdd658e90a00017226e7712e49300350a4c4f659c9" exitCode=1 Jul 30 22:48:15.460791 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.460773 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" event={"ID":"99d0098f-5c85-48d4-8c74-9507b34e99bc","Type":"ContainerDied","Data":"f7f97b13c94aaf13d6bd58cdd658e90a00017226e7712e49300350a4c4f659c9"} Jul 30 22:48:15.460847 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.460832 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" event={"ID":"99d0098f-5c85-48d4-8c74-9507b34e99bc","Type":"ContainerStarted","Data":"2d22dff1281b94949a6adf1ee3703888dd9f85b3bfc778c2fdf1441608eae5cf"} Jul 30 22:48:15.460911 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.460899 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" event={"ID":"99d0098f-5c85-48d4-8c74-9507b34e99bc","Type":"ContainerStarted","Data":"953b5f784c164ce9ed1f7d9d8c20c79526323bbf7688a749b40fb60d37ac8dcc"} Jul 30 22:48:15.460965 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.460940 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" event={"ID":"99d0098f-5c85-48d4-8c74-9507b34e99bc","Type":"ContainerStarted","Data":"9cbe135f0031a8eeda60a464e4d6e9e8ad6cf54ab22469359fff023b56a92612"} Jul 30 22:48:15.462075 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.462055 2576 generic.go:356] "Generic (PLEG): container finished" podID="d541cd49-d536-4578-b699-eb53c81b1ad8" containerID="12f847fb65c4690ba5fe1fcaab16210ef2a40414bc4c7c336f67536f0bd792fa" exitCode=0 Jul 30 22:48:15.462160 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.462115 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsjdm" event={"ID":"d541cd49-d536-4578-b699-eb53c81b1ad8","Type":"ContainerDied","Data":"12f847fb65c4690ba5fe1fcaab16210ef2a40414bc4c7c336f67536f0bd792fa"} Jul 30 22:48:15.463581 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.463554 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" event={"ID":"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd","Type":"ContainerStarted","Data":"348e4634654a6dc97274f3cba74bdfabf22f3e65f104e5a8a76865c4e82a5ccb"} Jul 30 22:48:15.464961 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.464935 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xhn6n" event={"ID":"bea329e0-01bb-4de9-8ef7-7e9e76d0a27a","Type":"ContainerStarted","Data":"f77c571f1941400ee925c7dcc3cae519fa4b20c13f8ad91c89234ea3a47fbb38"} Jul 30 22:48:15.470876 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.470821 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bk6hf" podStartSLOduration=3.141668639 podStartE2EDuration="22.470804876s" totalImagesPullingTime="19.329136237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:15.470771985 +0000 UTC m=+22.674591220" watchObservedRunningTime="2026-07-30 22:48:15.470804876 +0000 UTC m=+22.674624111" Jul 30 22:48:15.519694 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.519645 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kdwq6" podStartSLOduration=3.129251435 podStartE2EDuration="22.519629328s" totalImagesPullingTime="19.390377893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:15.487679516 +0000 UTC m=+22.691498751" watchObservedRunningTime="2026-07-30 22:48:15.519629328 +0000 UTC m=+22.723448562" Jul 30 22:48:15.537545 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.537490 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xhn6n" podStartSLOduration=3.109950841 podStartE2EDuration="22.537474471s" totalImagesPullingTime="19.42752363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:15.537117642 +0000 UTC m=+22.740936875" watchObservedRunningTime="2026-07-30 22:48:15.537474471 +0000 UTC m=+22.741293732" Jul 30 22:48:15.563835 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.563784 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ctblf" podStartSLOduration=3.272745362 podStartE2EDuration="22.563769011s" totalImagesPullingTime="19.291023649s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:15.563235745 +0000 UTC m=+22.767055004" watchObservedRunningTime="2026-07-30 22:48:15.563769011 +0000 UTC m=+22.767588244" Jul 30 22:48:15.643496 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.643468 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bk6hf_d304fc21-0e59-4cce-bf8d-880efd5e5ce4/konnectivity-agent/0.log" limit=1024 Jul 30 22:48:15.737007 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.736816 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bk6hf_d304fc21-0e59-4cce-bf8d-880efd5e5ce4/konnectivity-agent/0.log" limit=1024 Jul 30 22:48:15.962691 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.962665 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bk6hf" Jul 30 22:48:15.963327 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.963308 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bk6hf" Jul 30 22:48:15.979608 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:15.979571 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bk6hf_d304fc21-0e59-4cce-bf8d-880efd5e5ce4/konnectivity-agent/0.log" limit=1024 Jul 30 22:48:16.003110 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:16.003089 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 30 22:48:16.104900 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:16.104850 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bk6hf_d304fc21-0e59-4cce-bf8d-880efd5e5ce4/konnectivity-agent/0.log" limit=1024 Jul 30 22:48:16.168914 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:16.168779 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T22:48:16.003103893Z","UUID":"161ba7f8-e5db-487c-b71b-8ae61c7b0887","Handler":null,"Name":"","Endpoint":""} Jul 30 22:48:16.170239 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:16.170220 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 30 22:48:16.170327 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:16.170255 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 30 22:48:16.230825 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:16.230720 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:16.230825 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:16.230745 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:16.231070 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:16.230841 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:16.231070 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:16.231020 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:16.469772 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:16.469738 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" event={"ID":"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd","Type":"ContainerStarted","Data":"b886278f503a2f378a9ba7564f903b3dd59bff2937fca98c6a2d843e9e95c239"} Jul 30 22:48:16.471941 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:16.471896 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal" event={"ID":"37c5ea9b707c6dfdf55342b71f73c37b","Type":"ContainerStarted","Data":"8f7704ca5d180c006d85be044d626e42bdf506b25ddd14ff92abe7b644370863"} Jul 30 22:48:16.473993 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:16.473966 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bk6hf" Jul 30 22:48:16.474509 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:16.474490 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bk6hf" Jul 30 22:48:16.499845 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:16.499752 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal" podStartSLOduration=22.499739197 podStartE2EDuration="22.499739197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:16.49967915 +0000 UTC m=+23.703498384" watchObservedRunningTime="2026-07-30 22:48:16.499739197 +0000 UTC m=+23.703558431" Jul 30 22:48:16.588296 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:16.588267 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bk6hf_d304fc21-0e59-4cce-bf8d-880efd5e5ce4/konnectivity-agent/0.log" limit=1024 Jul 30 22:48:16.795774 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:16.795699 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bk6hf_d304fc21-0e59-4cce-bf8d-880efd5e5ce4/konnectivity-agent/0.log" limit=1024 Jul 30 22:48:17.175193 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:17.175149 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bk6hf_d304fc21-0e59-4cce-bf8d-880efd5e5ce4/konnectivity-agent/0.log" limit=1024 Jul 30 22:48:17.230264 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:17.230241 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:17.230395 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:17.230372 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:17.276943 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:17.276897 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bk6hf_d304fc21-0e59-4cce-bf8d-880efd5e5ce4/konnectivity-agent/0.log" limit=1024 Jul 30 22:48:17.476231 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:17.476155 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 22:48:17.476570 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:17.476509 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" event={"ID":"99d0098f-5c85-48d4-8c74-9507b34e99bc","Type":"ContainerStarted","Data":"dd2eb818a591cddb9f744bf2e02fef75b8265a213d7e58e1f9268b5e776a1ded"} Jul 30 22:48:17.478725 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:17.478695 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" event={"ID":"7ac93fd2-a00e-47b5-85b2-69bd46ae71cd","Type":"ContainerStarted","Data":"493fa7bd0976cbab2a825c3c5527e2c7441c91896f4213946d223e7ced1d97ce"} Jul 30 22:48:17.499108 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:17.499066 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6d7t4" podStartSLOduration=2.694597576 podStartE2EDuration="24.499049498s" totalImagesPullingTime="21.804451922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:17.498370056 +0000 UTC m=+24.702189291" watchObservedRunningTime="2026-07-30 22:48:17.499049498 +0000 UTC m=+24.702868726" Jul 30 22:48:18.230499 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:18.230459 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:18.230499 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:18.230478 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:18.230778 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:18.230597 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:18.230778 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:18.230730 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:18.642661 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:18.642633 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bk6hf_d304fc21-0e59-4cce-bf8d-880efd5e5ce4/konnectivity-agent/0.log" limit=1024 Jul 30 22:48:18.752032 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:18.752002 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bk6hf_d304fc21-0e59-4cce-bf8d-880efd5e5ce4/konnectivity-agent/0.log" limit=1024 Jul 30 22:48:19.230323 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:19.230294 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:19.230488 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:19.230433 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:20.218514 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:20.218487 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ctblf_b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26/dns-node-resolver/0.log" Jul 30 22:48:20.230739 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:20.230709 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:20.230900 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:20.230836 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:20.230900 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:20.230890 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:20.230989 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:20.230969 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:20.488699 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:20.488529 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 22:48:20.489049 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:20.489019 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" event={"ID":"99d0098f-5c85-48d4-8c74-9507b34e99bc","Type":"ContainerStarted","Data":"1796a65ebeac8e73825655c43fa4083003c88c1e9f825609c5a29fa8d1aabb93"} Jul 30 22:48:20.489285 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:20.489269 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:48:20.489452 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:20.489439 2576 scope.go:117] "RemoveContainer" containerID="f7f97b13c94aaf13d6bd58cdd658e90a00017226e7712e49300350a4c4f659c9" Jul 30 22:48:20.505254 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:20.505233 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:48:21.230426 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:21.230396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:21.231033 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:21.230526 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:21.497407 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:21.497379 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 22:48:21.497757 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:21.497735 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" event={"ID":"99d0098f-5c85-48d4-8c74-9507b34e99bc","Type":"ContainerStarted","Data":"de699f4b12de58e0952e9ecdd9357c9cfdb404de938c171efccecdd6f0ee319f"} Jul 30 22:48:21.498086 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:21.498063 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:48:21.498221 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:21.498128 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:48:21.499694 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:21.499673 2576 generic.go:356] "Generic (PLEG): container finished" podID="d541cd49-d536-4578-b699-eb53c81b1ad8" containerID="2db3060bc9d3b3405f27eeb5a1cf16ac0cd3e7d5ceeb07828a9415b39307ca2e" exitCode=0 Jul 30 22:48:21.499796 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:21.499710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsjdm" event={"ID":"d541cd49-d536-4578-b699-eb53c81b1ad8","Type":"ContainerDied","Data":"2db3060bc9d3b3405f27eeb5a1cf16ac0cd3e7d5ceeb07828a9415b39307ca2e"} Jul 30 22:48:21.513734 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:21.513716 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:48:21.526132 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:21.526095 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" podStartSLOduration=9.138006699 podStartE2EDuration="28.52608381s" totalImagesPullingTime="19.388077111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:21.524577521 +0000 UTC m=+28.728396754" watchObservedRunningTime="2026-07-30 22:48:21.52608381 +0000 UTC m=+28.729903044" Jul 30 22:48:21.618214 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:21.618180 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kdwq6_f2cb5e16-6273-4726-b8d1-ab09e229d0c8/node-ca/0.log" Jul 30 22:48:22.230613 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:22.230472 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:22.231075 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:22.230536 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:22.231075 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:22.230720 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:22.231075 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:22.230785 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:22.380595 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:22.380566 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r96n6"] Jul 30 22:48:22.380758 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:22.380713 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:22.380851 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:22.380827 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:22.384999 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:22.384974 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jtwng"] Jul 30 22:48:22.385551 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:22.385529 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j8q5t"] Jul 30 22:48:22.501615 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:22.501532 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:22.501743 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:22.501615 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:22.501743 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:22.501703 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:22.501812 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:22.501772 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:23.506751 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:23.506720 2576 generic.go:356] "Generic (PLEG): container finished" podID="d541cd49-d536-4578-b699-eb53c81b1ad8" containerID="edcc4d9e6077ec03f141058fd98fdbdf0ab75d8a54a8cf748af8928fd9620756" exitCode=0 Jul 30 22:48:23.507119 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:23.506800 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsjdm" event={"ID":"d541cd49-d536-4578-b699-eb53c81b1ad8","Type":"ContainerDied","Data":"edcc4d9e6077ec03f141058fd98fdbdf0ab75d8a54a8cf748af8928fd9620756"} Jul 30 22:48:24.230949 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:24.230915 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:24.230949 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:24.230943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:24.231159 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:24.230922 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:24.231159 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:24.231031 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:24.231159 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:24.231100 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:24.231260 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:24.231155 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:25.513416 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:25.513375 2576 generic.go:356] "Generic (PLEG): container finished" podID="d541cd49-d536-4578-b699-eb53c81b1ad8" containerID="aaf19c88d32930ff7e8b7e54e30696e7f9f51d4ec841024c168c7d0908faed79" exitCode=0 Jul 30 22:48:25.513762 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:25.513453 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsjdm" event={"ID":"d541cd49-d536-4578-b699-eb53c81b1ad8","Type":"ContainerDied","Data":"aaf19c88d32930ff7e8b7e54e30696e7f9f51d4ec841024c168c7d0908faed79"} Jul 30 22:48:25.952304 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:25.952276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret\") pod \"global-pull-secret-syncer-r96n6\" (UID: \"20eeae26-7b8c-4b13-976f-45be0ec631ff\") " pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:25.952468 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:25.952327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs\") pod \"network-metrics-daemon-j8q5t\" (UID: \"ee4984a2-9082-4730-a056-597f24a92af7\") " pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:25.952468 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:25.952414 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 22:48:25.952468 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:25.952461 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs podName:ee4984a2-9082-4730-a056-597f24a92af7 nodeName:}" failed. No retries permitted until 2026-07-30 22:48:57.952449067 +0000 UTC m=+65.156268278 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs") pod "network-metrics-daemon-j8q5t" (UID: "ee4984a2-9082-4730-a056-597f24a92af7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 22:48:25.952598 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:25.952415 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 22:48:25.952598 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:25.952532 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret podName:20eeae26-7b8c-4b13-976f-45be0ec631ff nodeName:}" failed. No retries permitted until 2026-07-30 22:48:57.952518097 +0000 UTC m=+65.156337309 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret") pod "global-pull-secret-syncer-r96n6" (UID: "20eeae26-7b8c-4b13-976f-45be0ec631ff") : object "kube-system"/"original-pull-secret" not registered Jul 30 22:48:26.053560 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:26.053523 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl8wn\" (UniqueName: \"kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn\") pod \"network-check-target-jtwng\" (UID: \"a9f3bd63-f053-41d2-b0ea-7e2770e4315b\") " pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:26.053718 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:26.053670 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 22:48:26.053718 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:26.053688 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 22:48:26.053718 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:26.053699 2576 projected.go:196] Error preparing data for projected volume kube-api-access-fl8wn for pod openshift-network-diagnostics/network-check-target-jtwng: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 22:48:26.053849 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:26.053762 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn podName:a9f3bd63-f053-41d2-b0ea-7e2770e4315b nodeName:}" failed. No retries permitted until 2026-07-30 22:48:58.053748709 +0000 UTC m=+65.257567920 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fl8wn" (UniqueName: "kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn") pod "network-check-target-jtwng" (UID: "a9f3bd63-f053-41d2-b0ea-7e2770e4315b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 22:48:26.230690 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:26.230624 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:26.230831 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:26.230624 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:26.230831 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:26.230738 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:26.230831 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:26.230624 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:26.230831 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:26.230786 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:26.230989 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:26.230883 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:28.230812 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:28.230623 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:28.230812 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:28.230670 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:28.230812 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:28.230743 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:28.230812 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:28.230759 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:28.231427 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:28.230868 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:28.231427 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:28.230959 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:30.230221 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:30.230026 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:30.230605 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:30.230053 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:30.230605 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:30.230278 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:30.230605 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:30.230382 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:30.230605 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:30.230054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:30.230605 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:30.230488 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:30.528685 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:30.528604 2576 generic.go:356] "Generic (PLEG): container finished" podID="d541cd49-d536-4578-b699-eb53c81b1ad8" containerID="66628e0bd47feb8e7dbb8af7a5ed57fc411660fafdf89d2130cf495a3a6bb4d1" exitCode=0 Jul 30 22:48:30.528685 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:30.528654 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsjdm" event={"ID":"d541cd49-d536-4578-b699-eb53c81b1ad8","Type":"ContainerDied","Data":"66628e0bd47feb8e7dbb8af7a5ed57fc411660fafdf89d2130cf495a3a6bb4d1"} Jul 30 22:48:31.533918 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:31.533885 2576 generic.go:356] "Generic (PLEG): container finished" podID="d541cd49-d536-4578-b699-eb53c81b1ad8" containerID="e909c9e2bb592cd8e9d27ab777cd60cf8657656ae02ef46a9459387f12e09502" exitCode=0 Jul 30 22:48:31.534284 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:31.533939 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsjdm" event={"ID":"d541cd49-d536-4578-b699-eb53c81b1ad8","Type":"ContainerDied","Data":"e909c9e2bb592cd8e9d27ab777cd60cf8657656ae02ef46a9459387f12e09502"} Jul 30 22:48:32.231017 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:32.230933 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:32.231185 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:32.230934 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:32.231185 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:32.231054 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:32.231185 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:32.230939 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:32.231185 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:32.231111 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:32.231185 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:32.231184 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:32.539439 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:32.539360 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zsjdm" event={"ID":"d541cd49-d536-4578-b699-eb53c81b1ad8","Type":"ContainerStarted","Data":"f212fd90a28e10febe6fc885d7b90fb676c2516e194e290f6cfae16a4aecb968"} Jul 30 22:48:32.564448 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:32.564403 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zsjdm" podStartSLOduration=8.576807855 podStartE2EDuration="39.564386045s" totalImagesPullingTime="30.98757819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:32.563809601 +0000 UTC m=+39.767628836" watchObservedRunningTime="2026-07-30 22:48:32.564386045 +0000 UTC m=+39.768205278" Jul 30 22:48:34.230877 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:34.230839 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:34.231345 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:34.230839 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:34.231345 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:34.230974 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:34.231345 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:34.230839 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:34.231345 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:34.231087 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:34.231345 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:34.231157 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:36.230530 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:36.230501 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:36.231014 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:36.230632 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:36.231014 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:36.230673 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:36.231014 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:36.230687 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:36.231014 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:36.230755 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:36.231014 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:36.230817 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:38.230829 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:38.230789 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:38.230829 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:38.230813 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:38.231372 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:38.230789 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:38.231372 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:38.230937 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:38.231372 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:38.230968 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:38.231372 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:38.231047 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:40.230950 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:40.230916 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:40.231414 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:40.230915 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:40.231414 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:40.231060 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:40.231414 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:40.230916 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:40.231414 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:40.231094 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:40.231414 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:40.231158 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:42.230193 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:42.230157 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:42.230654 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:42.230253 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:42.230654 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:42.230261 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:42.230654 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:42.230256 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r96n6" podUID="20eeae26-7b8c-4b13-976f-45be0ec631ff" Jul 30 22:48:42.230654 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:42.230361 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jtwng" podUID="a9f3bd63-f053-41d2-b0ea-7e2770e4315b" Jul 30 22:48:42.230654 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:48:42.230457 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j8q5t" podUID="ee4984a2-9082-4730-a056-597f24a92af7" Jul 30 22:48:43.122790 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.122767 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeReady" Jul 30 22:48:43.122979 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.122904 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 30 22:48:43.170472 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.170442 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d98d88b4f-rbnfd"] Jul 30 22:48:43.173287 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.173271 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.177285 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.177262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-ca-trust-extracted\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.177402 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.177295 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-installation-pull-secrets\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.177402 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.177311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-trusted-ca\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.177475 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.177418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-registry-tls\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.177475 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.177445 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-bound-sa-token\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.177540 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.177494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj8xd\" (UniqueName: \"kubernetes.io/projected/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-kube-api-access-dj8xd\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.177540 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.177524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-image-registry-private-configuration\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.177603 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.177541 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-registry-certificates\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.178195 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.178178 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 30 22:48:43.178195 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.178190 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 30 22:48:43.178338 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.178296 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m4zn7\"" Jul 30 22:48:43.178406 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.178391 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 30 22:48:43.183726 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.183710 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 30 22:48:43.186534 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.186508 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d4d7l"] Jul 30 22:48:43.189228 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.189214 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d4d7l" Jul 30 22:48:43.190955 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.190937 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d98d88b4f-rbnfd"] Jul 30 22:48:43.192597 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.192579 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4z2vv\"" Jul 30 22:48:43.192683 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.192591 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 30 22:48:43.192683 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.192661 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 30 22:48:43.192807 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.192718 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 30 22:48:43.193027 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.193011 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 30 22:48:43.197534 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.197516 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2xj2r"] Jul 30 22:48:43.201187 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.201167 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2xj2r" Jul 30 22:48:43.202535 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.202514 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d4d7l"] Jul 30 22:48:43.203805 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.203790 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g5cvn\"" Jul 30 22:48:43.204035 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.204022 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 30 22:48:43.204115 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.204048 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 30 22:48:43.215495 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.215475 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2xj2r"] Jul 30 22:48:43.278759 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.278725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-registry-tls\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.278759 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.278759 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-bound-sa-token\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.279266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.278801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj8xd\" (UniqueName: \"kubernetes.io/projected/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-kube-api-access-dj8xd\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.279266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.278830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtm28\" (UniqueName: \"kubernetes.io/projected/cc460f34-9567-42f0-9b21-d75ec3db45c7-kube-api-access-jtm28\") pod \"insights-runtime-extractor-d4d7l\" (UID: \"cc460f34-9567-42f0-9b21-d75ec3db45c7\") " pod="openshift-insights/insights-runtime-extractor-d4d7l" Jul 30 22:48:43.279266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.278853 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60aa8c35-1f16-4ac0-8923-659f5cbfb56a-config-volume\") pod \"dns-default-2xj2r\" (UID: \"60aa8c35-1f16-4ac0-8923-659f5cbfb56a\") " pod="openshift-dns/dns-default-2xj2r" Jul 30 22:48:43.279266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.278897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60aa8c35-1f16-4ac0-8923-659f5cbfb56a-tmp-dir\") pod \"dns-default-2xj2r\" (UID: \"60aa8c35-1f16-4ac0-8923-659f5cbfb56a\") " pod="openshift-dns/dns-default-2xj2r" Jul 30 22:48:43.279266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.278927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-image-registry-private-configuration\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.279266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.278951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-registry-certificates\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.279266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.278972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60aa8c35-1f16-4ac0-8923-659f5cbfb56a-metrics-tls\") pod \"dns-default-2xj2r\" (UID: \"60aa8c35-1f16-4ac0-8923-659f5cbfb56a\") " pod="openshift-dns/dns-default-2xj2r" Jul 30 22:48:43.279266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.278997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgvjx\" (UniqueName: \"kubernetes.io/projected/60aa8c35-1f16-4ac0-8923-659f5cbfb56a-kube-api-access-lgvjx\") pod \"dns-default-2xj2r\" (UID: \"60aa8c35-1f16-4ac0-8923-659f5cbfb56a\") " pod="openshift-dns/dns-default-2xj2r" Jul 30 22:48:43.279266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.279071 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-ca-trust-extracted\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.279266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.279139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-installation-pull-secrets\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.279266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.279167 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc460f34-9567-42f0-9b21-d75ec3db45c7-crio-socket\") pod \"insights-runtime-extractor-d4d7l\" (UID: \"cc460f34-9567-42f0-9b21-d75ec3db45c7\") " pod="openshift-insights/insights-runtime-extractor-d4d7l" Jul 30 22:48:43.279266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.279195 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc460f34-9567-42f0-9b21-d75ec3db45c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d4d7l\" (UID: \"cc460f34-9567-42f0-9b21-d75ec3db45c7\") " pod="openshift-insights/insights-runtime-extractor-d4d7l" Jul 30 22:48:43.279266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.279220 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-trusted-ca\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.279266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.279244 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc460f34-9567-42f0-9b21-d75ec3db45c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d4d7l\" (UID: \"cc460f34-9567-42f0-9b21-d75ec3db45c7\") " pod="openshift-insights/insights-runtime-extractor-d4d7l" Jul 30 22:48:43.279771 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.279314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc460f34-9567-42f0-9b21-d75ec3db45c7-data-volume\") pod \"insights-runtime-extractor-d4d7l\" (UID: \"cc460f34-9567-42f0-9b21-d75ec3db45c7\") " pod="openshift-insights/insights-runtime-extractor-d4d7l" Jul 30 22:48:43.279771 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.279468 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-ca-trust-extracted\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.279771 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.279756 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-registry-certificates\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.280070 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.280046 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-trusted-ca\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.282872 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.282839 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-installation-pull-secrets\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.282975 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.282933 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-registry-tls\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.283046 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.283024 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-image-registry-private-configuration\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.288084 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.288065 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d47jw"] Jul 30 22:48:43.291907 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.291891 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d47jw" Jul 30 22:48:43.293255 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.293235 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-bound-sa-token\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.293764 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.293741 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj8xd\" (UniqueName: \"kubernetes.io/projected/f2b8d98f-be8b-49ff-88a1-0cee4fbc4244-kube-api-access-dj8xd\") pod \"image-registry-6d98d88b4f-rbnfd\" (UID: \"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244\") " pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.294847 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.294827 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zlg2h\"" Jul 30 22:48:43.294847 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.294839 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 30 22:48:43.295012 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.294877 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 30 22:48:43.295012 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.294897 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 30 22:48:43.301160 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.301142 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d47jw"] Jul 30 22:48:43.380543 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.380455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xpw4\" (UniqueName: \"kubernetes.io/projected/13ed87f8-efb7-42b3-b630-8ed4c86ea19d-kube-api-access-7xpw4\") pod \"ingress-canary-d47jw\" (UID: \"13ed87f8-efb7-42b3-b630-8ed4c86ea19d\") " pod="openshift-ingress-canary/ingress-canary-d47jw" Jul 30 22:48:43.380543 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.380492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtm28\" (UniqueName: \"kubernetes.io/projected/cc460f34-9567-42f0-9b21-d75ec3db45c7-kube-api-access-jtm28\") pod \"insights-runtime-extractor-d4d7l\" (UID: \"cc460f34-9567-42f0-9b21-d75ec3db45c7\") " pod="openshift-insights/insights-runtime-extractor-d4d7l" Jul 30 22:48:43.380543 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.380509 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60aa8c35-1f16-4ac0-8923-659f5cbfb56a-config-volume\") pod \"dns-default-2xj2r\" (UID: \"60aa8c35-1f16-4ac0-8923-659f5cbfb56a\") " pod="openshift-dns/dns-default-2xj2r" Jul 30 22:48:43.380796 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.380619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60aa8c35-1f16-4ac0-8923-659f5cbfb56a-tmp-dir\") pod \"dns-default-2xj2r\" (UID: \"60aa8c35-1f16-4ac0-8923-659f5cbfb56a\") " pod="openshift-dns/dns-default-2xj2r" Jul 30 22:48:43.380796 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.380661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60aa8c35-1f16-4ac0-8923-659f5cbfb56a-metrics-tls\") pod \"dns-default-2xj2r\" (UID: \"60aa8c35-1f16-4ac0-8923-659f5cbfb56a\") " pod="openshift-dns/dns-default-2xj2r" Jul 30 22:48:43.380796 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.380689 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgvjx\" (UniqueName: \"kubernetes.io/projected/60aa8c35-1f16-4ac0-8923-659f5cbfb56a-kube-api-access-lgvjx\") pod \"dns-default-2xj2r\" (UID: \"60aa8c35-1f16-4ac0-8923-659f5cbfb56a\") " pod="openshift-dns/dns-default-2xj2r" Jul 30 22:48:43.380796 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.380767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc460f34-9567-42f0-9b21-d75ec3db45c7-crio-socket\") pod \"insights-runtime-extractor-d4d7l\" (UID: \"cc460f34-9567-42f0-9b21-d75ec3db45c7\") " pod="openshift-insights/insights-runtime-extractor-d4d7l" Jul 30 22:48:43.380796 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.380793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc460f34-9567-42f0-9b21-d75ec3db45c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d4d7l\" (UID: \"cc460f34-9567-42f0-9b21-d75ec3db45c7\") " pod="openshift-insights/insights-runtime-extractor-d4d7l" Jul 30 22:48:43.381063 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.380827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc460f34-9567-42f0-9b21-d75ec3db45c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d4d7l\" (UID: \"cc460f34-9567-42f0-9b21-d75ec3db45c7\") " pod="openshift-insights/insights-runtime-extractor-d4d7l" Jul 30 22:48:43.381063 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.380882 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc460f34-9567-42f0-9b21-d75ec3db45c7-data-volume\") pod \"insights-runtime-extractor-d4d7l\" (UID: \"cc460f34-9567-42f0-9b21-d75ec3db45c7\") " pod="openshift-insights/insights-runtime-extractor-d4d7l" Jul 30 22:48:43.381063 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.380897 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc460f34-9567-42f0-9b21-d75ec3db45c7-crio-socket\") pod \"insights-runtime-extractor-d4d7l\" (UID: \"cc460f34-9567-42f0-9b21-d75ec3db45c7\") " pod="openshift-insights/insights-runtime-extractor-d4d7l" Jul 30 22:48:43.381063 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.380926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13ed87f8-efb7-42b3-b630-8ed4c86ea19d-cert\") pod \"ingress-canary-d47jw\" (UID: \"13ed87f8-efb7-42b3-b630-8ed4c86ea19d\") " pod="openshift-ingress-canary/ingress-canary-d47jw" Jul 30 22:48:43.381255 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.381075 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60aa8c35-1f16-4ac0-8923-659f5cbfb56a-tmp-dir\") pod \"dns-default-2xj2r\" (UID: \"60aa8c35-1f16-4ac0-8923-659f5cbfb56a\") " pod="openshift-dns/dns-default-2xj2r" Jul 30 22:48:43.381310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.381264 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60aa8c35-1f16-4ac0-8923-659f5cbfb56a-config-volume\") pod \"dns-default-2xj2r\" (UID: \"60aa8c35-1f16-4ac0-8923-659f5cbfb56a\") " pod="openshift-dns/dns-default-2xj2r" Jul 30 22:48:43.381415 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.381396 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc460f34-9567-42f0-9b21-d75ec3db45c7-data-volume\") pod \"insights-runtime-extractor-d4d7l\" (UID: \"cc460f34-9567-42f0-9b21-d75ec3db45c7\") " pod="openshift-insights/insights-runtime-extractor-d4d7l" Jul 30 22:48:43.381555 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.381540 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc460f34-9567-42f0-9b21-d75ec3db45c7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d4d7l\" (UID: \"cc460f34-9567-42f0-9b21-d75ec3db45c7\") " pod="openshift-insights/insights-runtime-extractor-d4d7l" Jul 30 22:48:43.382925 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.382903 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60aa8c35-1f16-4ac0-8923-659f5cbfb56a-metrics-tls\") pod \"dns-default-2xj2r\" (UID: \"60aa8c35-1f16-4ac0-8923-659f5cbfb56a\") " pod="openshift-dns/dns-default-2xj2r" Jul 30 22:48:43.383027 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.382963 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc460f34-9567-42f0-9b21-d75ec3db45c7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d4d7l\" (UID: \"cc460f34-9567-42f0-9b21-d75ec3db45c7\") " pod="openshift-insights/insights-runtime-extractor-d4d7l" Jul 30 22:48:43.389315 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.389296 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtm28\" (UniqueName: \"kubernetes.io/projected/cc460f34-9567-42f0-9b21-d75ec3db45c7-kube-api-access-jtm28\") pod \"insights-runtime-extractor-d4d7l\" (UID: \"cc460f34-9567-42f0-9b21-d75ec3db45c7\") " pod="openshift-insights/insights-runtime-extractor-d4d7l" Jul 30 22:48:43.389501 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.389485 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgvjx\" (UniqueName: \"kubernetes.io/projected/60aa8c35-1f16-4ac0-8923-659f5cbfb56a-kube-api-access-lgvjx\") pod \"dns-default-2xj2r\" (UID: \"60aa8c35-1f16-4ac0-8923-659f5cbfb56a\") " pod="openshift-dns/dns-default-2xj2r" Jul 30 22:48:43.481752 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.481723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13ed87f8-efb7-42b3-b630-8ed4c86ea19d-cert\") pod \"ingress-canary-d47jw\" (UID: \"13ed87f8-efb7-42b3-b630-8ed4c86ea19d\") " pod="openshift-ingress-canary/ingress-canary-d47jw" Jul 30 22:48:43.481878 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.481770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xpw4\" (UniqueName: \"kubernetes.io/projected/13ed87f8-efb7-42b3-b630-8ed4c86ea19d-kube-api-access-7xpw4\") pod \"ingress-canary-d47jw\" (UID: \"13ed87f8-efb7-42b3-b630-8ed4c86ea19d\") " pod="openshift-ingress-canary/ingress-canary-d47jw" Jul 30 22:48:43.482155 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.482140 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:43.484051 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.484035 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13ed87f8-efb7-42b3-b630-8ed4c86ea19d-cert\") pod \"ingress-canary-d47jw\" (UID: \"13ed87f8-efb7-42b3-b630-8ed4c86ea19d\") " pod="openshift-ingress-canary/ingress-canary-d47jw" Jul 30 22:48:43.491258 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.491234 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xpw4\" (UniqueName: \"kubernetes.io/projected/13ed87f8-efb7-42b3-b630-8ed4c86ea19d-kube-api-access-7xpw4\") pod \"ingress-canary-d47jw\" (UID: \"13ed87f8-efb7-42b3-b630-8ed4c86ea19d\") " pod="openshift-ingress-canary/ingress-canary-d47jw" Jul 30 22:48:43.499040 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.499019 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d4d7l" Jul 30 22:48:43.510186 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.510165 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2xj2r" Jul 30 22:48:43.588925 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.588890 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-756df4b7f-8t7zk"] Jul 30 22:48:43.605535 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.605429 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.609355 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.608750 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 30 22:48:43.609355 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.605894 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-756df4b7f-8t7zk"] Jul 30 22:48:43.609355 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.609085 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 30 22:48:43.609355 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.609301 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 30 22:48:43.609598 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.609400 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 30 22:48:43.609854 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.609674 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mqq6q\"" Jul 30 22:48:43.609854 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.609715 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 30 22:48:43.609854 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.609846 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d47jw" Jul 30 22:48:43.610621 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.610569 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 30 22:48:43.616021 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.612146 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 30 22:48:43.651617 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.651579 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d98d88b4f-rbnfd"] Jul 30 22:48:43.658409 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:48:43.658337 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2b8d98f_be8b_49ff_88a1_0cee4fbc4244.slice/crio-b5a5df5316945aaa358c879a462b6a44ac7f1cebddde30f229b8ecf1da33bfde WatchSource:0}: Error finding container b5a5df5316945aaa358c879a462b6a44ac7f1cebddde30f229b8ecf1da33bfde: Status 404 returned error can't find the container with id b5a5df5316945aaa358c879a462b6a44ac7f1cebddde30f229b8ecf1da33bfde Jul 30 22:48:43.680760 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.680733 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2xj2r"] Jul 30 22:48:43.683628 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.683608 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-oauth-config\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.683722 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.683642 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-oauth-serving-cert\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.683722 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.683679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-serving-cert\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.683835 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.683743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-config\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.683835 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.683771 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-service-ca\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.683835 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:48:43.683689 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60aa8c35_1f16_4ac0_8923_659f5cbfb56a.slice/crio-b3f1a7b52c6bd3550a28c786bdc118bae6eeb0e8d3de4f61b479e6abd1784155 WatchSource:0}: Error finding container b3f1a7b52c6bd3550a28c786bdc118bae6eeb0e8d3de4f61b479e6abd1784155: Status 404 returned error can't find the container with id b3f1a7b52c6bd3550a28c786bdc118bae6eeb0e8d3de4f61b479e6abd1784155 Jul 30 22:48:43.683835 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.683797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f9wz\" (UniqueName: \"kubernetes.io/projected/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-kube-api-access-8f9wz\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.749312 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.749281 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d47jw"] Jul 30 22:48:43.751566 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:48:43.751542 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13ed87f8_efb7_42b3_b630_8ed4c86ea19d.slice/crio-d9a608e40bbf11571a7074b63c65a5a7cdd2c1af457df32d533ffa2aca29c2bc WatchSource:0}: Error finding container d9a608e40bbf11571a7074b63c65a5a7cdd2c1af457df32d533ffa2aca29c2bc: Status 404 returned error can't find the container with id d9a608e40bbf11571a7074b63c65a5a7cdd2c1af457df32d533ffa2aca29c2bc Jul 30 22:48:43.784440 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.784409 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-serving-cert\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.784574 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.784477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-config\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.784574 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.784499 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-service-ca\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.784574 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.784524 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f9wz\" (UniqueName: \"kubernetes.io/projected/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-kube-api-access-8f9wz\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.784683 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.784583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-oauth-config\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.784683 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.784608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-oauth-serving-cert\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.785207 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.785182 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-config\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.785330 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.785230 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-service-ca\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.785452 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.785428 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-oauth-serving-cert\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.786688 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.786651 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-serving-cert\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.786800 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.786783 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-oauth-config\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.793407 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.793388 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f9wz\" (UniqueName: \"kubernetes.io/projected/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-kube-api-access-8f9wz\") pod \"console-756df4b7f-8t7zk\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:43.869046 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.869012 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d4d7l"] Jul 30 22:48:43.872155 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:48:43.872114 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc460f34_9567_42f0_9b21_d75ec3db45c7.slice/crio-3f5de9380943432a13d1fceb2de38438d0e69b9bca2d228b9bebdb2dd8653818 WatchSource:0}: Error finding container 3f5de9380943432a13d1fceb2de38438d0e69b9bca2d228b9bebdb2dd8653818: Status 404 returned error can't find the container with id 3f5de9380943432a13d1fceb2de38438d0e69b9bca2d228b9bebdb2dd8653818 Jul 30 22:48:43.923660 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:43.923636 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:44.057217 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.057185 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-756df4b7f-8t7zk"] Jul 30 22:48:44.059897 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:48:44.059870 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd79af4c_00c4_4aa0_8378_57ea4f3a206b.slice/crio-358b2d211ecc878e9346c975a00742a68ac286119bf589c7855da68df2f0759a WatchSource:0}: Error finding container 358b2d211ecc878e9346c975a00742a68ac286119bf589c7855da68df2f0759a: Status 404 returned error can't find the container with id 358b2d211ecc878e9346c975a00742a68ac286119bf589c7855da68df2f0759a Jul 30 22:48:44.230981 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.230900 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:44.230981 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.230927 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:44.230981 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.230946 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:44.234103 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.234074 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 30 22:48:44.234261 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.234151 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 30 22:48:44.234261 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.234188 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6fgjp\"" Jul 30 22:48:44.234394 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.234341 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 30 22:48:44.234659 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.234636 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ghwvz\"" Jul 30 22:48:44.234721 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.234668 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 30 22:48:44.567923 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.567894 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d47jw" event={"ID":"13ed87f8-efb7-42b3-b630-8ed4c86ea19d","Type":"ContainerStarted","Data":"d9a608e40bbf11571a7074b63c65a5a7cdd2c1af457df32d533ffa2aca29c2bc"} Jul 30 22:48:44.571141 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.571113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d4d7l" event={"ID":"cc460f34-9567-42f0-9b21-d75ec3db45c7","Type":"ContainerStarted","Data":"f8fb242901eecd1dea9034aec086f35ed4f515280091766fce4b62be534494fd"} Jul 30 22:48:44.571250 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.571178 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d4d7l" event={"ID":"cc460f34-9567-42f0-9b21-d75ec3db45c7","Type":"ContainerStarted","Data":"3f5de9380943432a13d1fceb2de38438d0e69b9bca2d228b9bebdb2dd8653818"} Jul 30 22:48:44.573734 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.573705 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-756df4b7f-8t7zk" event={"ID":"dd79af4c-00c4-4aa0-8378-57ea4f3a206b","Type":"ContainerStarted","Data":"358b2d211ecc878e9346c975a00742a68ac286119bf589c7855da68df2f0759a"} Jul 30 22:48:44.575270 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.575236 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2xj2r" event={"ID":"60aa8c35-1f16-4ac0-8923-659f5cbfb56a","Type":"ContainerStarted","Data":"b3f1a7b52c6bd3550a28c786bdc118bae6eeb0e8d3de4f61b479e6abd1784155"} Jul 30 22:48:44.577885 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.577816 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" event={"ID":"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244","Type":"ContainerStarted","Data":"8c3e50cd1612a657f14c7dc80f5ad49fabfdd77021f1f75f2b8b25159906251a"} Jul 30 22:48:44.577885 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.577854 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" event={"ID":"f2b8d98f-be8b-49ff-88a1-0cee4fbc4244","Type":"ContainerStarted","Data":"b5a5df5316945aaa358c879a462b6a44ac7f1cebddde30f229b8ecf1da33bfde"} Jul 30 22:48:44.578239 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.578186 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:48:44.783746 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.783621 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" podStartSLOduration=2.783598403 podStartE2EDuration="2.783598403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:48:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:44.59949149 +0000 UTC m=+51.803310746" watchObservedRunningTime="2026-07-30 22:48:44.783598403 +0000 UTC m=+51.987417638" Jul 30 22:48:44.784678 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.784651 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74b8c4b577-nlf9f"] Jul 30 22:48:44.787990 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.787963 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.794748 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.794720 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-oauth-serving-cert\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.794852 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.794772 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ce9858-f40c-4517-8520-36f0d158865f-console-serving-cert\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.794852 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.794807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ce9858-f40c-4517-8520-36f0d158865f-console-oauth-config\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.794852 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.794834 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-service-ca\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.795039 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.794904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-trusted-ca-bundle\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.795099 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.795032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gvx2\" (UniqueName: \"kubernetes.io/projected/26ce9858-f40c-4517-8520-36f0d158865f-kube-api-access-8gvx2\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.795099 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.795086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-console-config\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.803113 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.803049 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 30 22:48:44.803582 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.803562 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74b8c4b577-nlf9f"] Jul 30 22:48:44.896247 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.896210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-console-config\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.896247 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.896258 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-oauth-serving-cert\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.896484 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.896288 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ce9858-f40c-4517-8520-36f0d158865f-console-serving-cert\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.896484 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.896313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ce9858-f40c-4517-8520-36f0d158865f-console-oauth-config\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.896484 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.896338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-service-ca\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.896484 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.896367 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-trusted-ca-bundle\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.896484 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.896399 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gvx2\" (UniqueName: \"kubernetes.io/projected/26ce9858-f40c-4517-8520-36f0d158865f-kube-api-access-8gvx2\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.898060 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.897546 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-console-config\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.898060 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.897711 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-trusted-ca-bundle\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.898060 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.897752 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-service-ca\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.898451 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.898424 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-oauth-serving-cert\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.900748 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.900706 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ce9858-f40c-4517-8520-36f0d158865f-console-oauth-config\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.902258 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.902216 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ce9858-f40c-4517-8520-36f0d158865f-console-serving-cert\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:44.904968 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:44.904946 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gvx2\" (UniqueName: \"kubernetes.io/projected/26ce9858-f40c-4517-8520-36f0d158865f-kube-api-access-8gvx2\") pod \"console-74b8c4b577-nlf9f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:45.101042 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:45.100950 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:45.585356 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:45.585233 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d4d7l" event={"ID":"cc460f34-9567-42f0-9b21-d75ec3db45c7","Type":"ContainerStarted","Data":"639ceac4fb8e22b0bc23d40b96e5464bbb5413cbb7588bc84c6d97c5ff76319d"} Jul 30 22:48:45.611764 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:45.611097 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74b8c4b577-nlf9f"] Jul 30 22:48:46.150605 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:46.150569 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xf2nb"] Jul 30 22:48:46.154312 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:46.154284 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xf2nb" Jul 30 22:48:46.157301 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:46.156888 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 30 22:48:46.157301 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:46.157153 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jdzh6\"" Jul 30 22:48:46.161471 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:46.161415 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xf2nb"] Jul 30 22:48:46.208345 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:46.208297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7e83836f-ff87-4eec-8903-49d91747e99c-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-xf2nb\" (UID: \"7e83836f-ff87-4eec-8903-49d91747e99c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xf2nb" Jul 30 22:48:46.309935 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:46.309897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7e83836f-ff87-4eec-8903-49d91747e99c-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-xf2nb\" (UID: \"7e83836f-ff87-4eec-8903-49d91747e99c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xf2nb" Jul 30 22:48:46.312815 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:46.312785 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7e83836f-ff87-4eec-8903-49d91747e99c-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-xf2nb\" (UID: \"7e83836f-ff87-4eec-8903-49d91747e99c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xf2nb" Jul 30 22:48:46.465756 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:46.465715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xf2nb" Jul 30 22:48:46.511770 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:48:46.511745 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ce9858_f40c_4517_8520_36f0d158865f.slice/crio-40be47381fc3857c8cc9b11c66becb79e5c8b41621331207df2b4f878eb3d241 WatchSource:0}: Error finding container 40be47381fc3857c8cc9b11c66becb79e5c8b41621331207df2b4f878eb3d241: Status 404 returned error can't find the container with id 40be47381fc3857c8cc9b11c66becb79e5c8b41621331207df2b4f878eb3d241 Jul 30 22:48:46.589634 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:46.589592 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2xj2r" event={"ID":"60aa8c35-1f16-4ac0-8923-659f5cbfb56a","Type":"ContainerStarted","Data":"a8b6861752e602a1d80830ebe53824abd53470923467c85162da8fa16458881a"} Jul 30 22:48:46.591005 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:46.590980 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b8c4b577-nlf9f" event={"ID":"26ce9858-f40c-4517-8520-36f0d158865f","Type":"ContainerStarted","Data":"40be47381fc3857c8cc9b11c66becb79e5c8b41621331207df2b4f878eb3d241"} Jul 30 22:48:48.122077 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:48.121964 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xf2nb"] Jul 30 22:48:48.130800 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:48:48.128329 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e83836f_ff87_4eec_8903_49d91747e99c.slice/crio-0109ea49c2fb6ae593ae2ec32c18850a82630b3f3394f7abdf591ec565324f2d WatchSource:0}: Error finding container 0109ea49c2fb6ae593ae2ec32c18850a82630b3f3394f7abdf591ec565324f2d: Status 404 returned error can't find the container with id 0109ea49c2fb6ae593ae2ec32c18850a82630b3f3394f7abdf591ec565324f2d Jul 30 22:48:48.598874 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:48.598817 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d47jw" event={"ID":"13ed87f8-efb7-42b3-b630-8ed4c86ea19d","Type":"ContainerStarted","Data":"c552627f0b6908257aedcc34ae0109c5724c0ffaa3cfcfa96bbd3832bbfc47d7"} Jul 30 22:48:48.600827 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:48.600805 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d4d7l" event={"ID":"cc460f34-9567-42f0-9b21-d75ec3db45c7","Type":"ContainerStarted","Data":"4949c8893e283ed0b8d6d29bf8fbaaf617f868fb7b19a33bfa01f01770a02b57"} Jul 30 22:48:48.602295 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:48.602276 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-756df4b7f-8t7zk" event={"ID":"dd79af4c-00c4-4aa0-8378-57ea4f3a206b","Type":"ContainerStarted","Data":"15ab595649a0283d9b621c8c177e61fcaeb144304c08474b4535d4d6e4084eb1"} Jul 30 22:48:48.603975 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:48.603943 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2xj2r" event={"ID":"60aa8c35-1f16-4ac0-8923-659f5cbfb56a","Type":"ContainerStarted","Data":"55fe89615aee7bd1b26c9e228ae6336e95c4686e74ae5b1fb013c095f9682c16"} Jul 30 22:48:48.604102 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:48.604070 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2xj2r" Jul 30 22:48:48.605288 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:48.605267 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b8c4b577-nlf9f" event={"ID":"26ce9858-f40c-4517-8520-36f0d158865f","Type":"ContainerStarted","Data":"5fa0716e0e304487834c169d9054c63c9a1336bf9934091c55a0d5023cea2b82"} Jul 30 22:48:48.606316 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:48.606296 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xf2nb" event={"ID":"7e83836f-ff87-4eec-8903-49d91747e99c","Type":"ContainerStarted","Data":"0109ea49c2fb6ae593ae2ec32c18850a82630b3f3394f7abdf591ec565324f2d"} Jul 30 22:48:48.616960 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:48.616921 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d47jw" podStartSLOduration=1.392594616 podStartE2EDuration="5.616908984s" totalImagesPullingTime="4.224314368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:48.615832126 +0000 UTC m=+55.819651358" watchObservedRunningTime="2026-07-30 22:48:48.616908984 +0000 UTC m=+55.820728196" Jul 30 22:48:48.633949 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:48.633907 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d4d7l" podStartSLOduration=1.643566169 podStartE2EDuration="5.633888908s" totalImagesPullingTime="3.990322739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:48:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:48.632986764 +0000 UTC m=+55.836805999" watchObservedRunningTime="2026-07-30 22:48:48.633888908 +0000 UTC m=+55.837708142" Jul 30 22:48:48.650693 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:48.650648 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74b8c4b577-nlf9f" podStartSLOduration=3.155389442 podStartE2EDuration="4.650635363s" totalImagesPullingTime="1.495245921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:48:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:48.649662817 +0000 UTC m=+55.853482064" watchObservedRunningTime="2026-07-30 22:48:48.650635363 +0000 UTC m=+55.854454597" Jul 30 22:48:48.669586 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:48.669538 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-756df4b7f-8t7zk" podStartSLOduration=1.74593873 podStartE2EDuration="5.669522922s" totalImagesPullingTime="3.923584192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:48.668142461 +0000 UTC m=+55.871961726" watchObservedRunningTime="2026-07-30 22:48:48.669522922 +0000 UTC m=+55.873342156" Jul 30 22:48:48.684902 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:48.684840 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2xj2r" podStartSLOduration=3.85642116 podStartE2EDuration="5.684817844s" totalImagesPullingTime="1.828396684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:48.684734161 +0000 UTC m=+55.888553397" watchObservedRunningTime="2026-07-30 22:48:48.684817844 +0000 UTC m=+55.888637075" Jul 30 22:48:49.610916 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:49.610792 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xf2nb" event={"ID":"7e83836f-ff87-4eec-8903-49d91747e99c","Type":"ContainerStarted","Data":"e71a6d08e22fc9cdf2bbaeb0988a2de09781ae4742d21984fd001fa0c0750de9"} Jul 30 22:48:49.611815 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:49.611791 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xf2nb" Jul 30 22:48:49.615652 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:49.615632 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xf2nb" Jul 30 22:48:49.627114 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:49.627074 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-xf2nb" podStartSLOduration=2.5918974390000002 podStartE2EDuration="3.627059931s" totalImagesPullingTime="1.035162492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:48:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:49.626187843 +0000 UTC m=+56.830007071" watchObservedRunningTime="2026-07-30 22:48:49.627059931 +0000 UTC m=+56.830879188" Jul 30 22:48:53.516578 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:53.516543 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cm48d" Jul 30 22:48:53.924548 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:53.924506 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:53.924813 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:53.924572 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:48:53.926083 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:53.926062 2576 patch_prober.go:28] interesting pod/console-756df4b7f-8t7zk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.10:8443/health\": dial tcp 10.133.0.10:8443: connect: connection refused" start-of-body= Jul 30 22:48:53.926149 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:53.926105 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-756df4b7f-8t7zk" podUID="dd79af4c-00c4-4aa0-8378-57ea4f3a206b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.10:8443/health\": dial tcp 10.133.0.10:8443: connect: connection refused" Jul 30 22:48:55.101377 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:55.101337 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:55.101753 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:55.101403 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:48:55.102718 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:55.102693 2576 patch_prober.go:28] interesting pod/console-74b8c4b577-nlf9f container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" start-of-body= Jul 30 22:48:55.102813 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:55.102733 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-74b8c4b577-nlf9f" podUID="26ce9858-f40c-4517-8520-36f0d158865f" containerName="console" probeResult="failure" output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" Jul 30 22:48:55.613540 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:55.613512 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2xj2r" Jul 30 22:48:56.568429 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.568396 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9"] Jul 30 22:48:56.574911 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.574886 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" Jul 30 22:48:56.577547 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.577518 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4wzkq\"" Jul 30 22:48:56.577682 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.577552 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 30 22:48:56.578677 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.578654 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 30 22:48:56.578772 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.578677 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 30 22:48:56.578772 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.578734 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 30 22:48:56.578772 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.578760 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 30 22:48:56.589149 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.589116 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f"] Jul 30 22:48:56.592054 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.592036 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9"] Jul 30 22:48:56.592152 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.592118 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.594946 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.594927 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 30 22:48:56.595045 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.595003 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 30 22:48:56.595045 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.595008 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-c5qpj\"" Jul 30 22:48:56.595267 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.595249 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 30 22:48:56.605036 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.605018 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f"] Jul 30 22:48:56.607170 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.607152 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fqm7n"] Jul 30 22:48:56.610181 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.610165 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.612498 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.612484 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 30 22:48:56.613064 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.613046 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8rdn7\"" Jul 30 22:48:56.613128 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.613064 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 30 22:48:56.613128 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.613086 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 30 22:48:56.687515 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.687486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.687637 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.687518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f894415-f174-4b40-8546-014769b398e6-root\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.687637 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.687543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f894415-f174-4b40-8546-014769b398e6-metrics-client-ca\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.687637 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.687569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f894415-f174-4b40-8546-014769b398e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.687637 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.687627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv4pt\" (UniqueName: \"kubernetes.io/projected/2f894415-f174-4b40-8546-014769b398e6-kube-api-access-wv4pt\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.687840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.687670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f894415-f174-4b40-8546-014769b398e6-sys\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.687840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.687693 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f894415-f174-4b40-8546-014769b398e6-node-exporter-wtmp\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.687840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.687720 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbb39a4a-2163-4900-80a8-1847ceb34a17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-hqnk9\" (UID: \"fbb39a4a-2163-4900-80a8-1847ceb34a17\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" Jul 30 22:48:56.687840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.687746 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbb39a4a-2163-4900-80a8-1847ceb34a17-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-hqnk9\" (UID: \"fbb39a4a-2163-4900-80a8-1847ceb34a17\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" Jul 30 22:48:56.687840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.687768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f894415-f174-4b40-8546-014769b398e6-node-exporter-textfile\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.687840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.687831 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbb39a4a-2163-4900-80a8-1847ceb34a17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-hqnk9\" (UID: \"fbb39a4a-2163-4900-80a8-1847ceb34a17\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" Jul 30 22:48:56.688075 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.687897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.688075 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.687931 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.688075 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.687968 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.688075 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.688005 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f894415-f174-4b40-8546-014769b398e6-node-exporter-tls\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.688075 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.688025 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f894415-f174-4b40-8546-014769b398e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.688075 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.688043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.688075 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.688063 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2txqz\" (UniqueName: \"kubernetes.io/projected/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-kube-api-access-2txqz\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.688299 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.688080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7j78\" (UniqueName: \"kubernetes.io/projected/fbb39a4a-2163-4900-80a8-1847ceb34a17-kube-api-access-d7j78\") pod \"openshift-state-metrics-6bb4d7b4dd-hqnk9\" (UID: \"fbb39a4a-2163-4900-80a8-1847ceb34a17\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" Jul 30 22:48:56.788953 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.788929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7j78\" (UniqueName: \"kubernetes.io/projected/fbb39a4a-2163-4900-80a8-1847ceb34a17-kube-api-access-d7j78\") pod \"openshift-state-metrics-6bb4d7b4dd-hqnk9\" (UID: \"fbb39a4a-2163-4900-80a8-1847ceb34a17\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" Jul 30 22:48:56.789062 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.788961 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.789062 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.788979 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f894415-f174-4b40-8546-014769b398e6-root\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.789062 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.788995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f894415-f174-4b40-8546-014769b398e6-metrics-client-ca\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.789062 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789020 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f894415-f174-4b40-8546-014769b398e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.789062 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv4pt\" (UniqueName: \"kubernetes.io/projected/2f894415-f174-4b40-8546-014769b398e6-kube-api-access-wv4pt\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.789294 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789068 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f894415-f174-4b40-8546-014769b398e6-root\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.789294 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f894415-f174-4b40-8546-014769b398e6-sys\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.789294 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f894415-f174-4b40-8546-014769b398e6-node-exporter-wtmp\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.789294 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbb39a4a-2163-4900-80a8-1847ceb34a17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-hqnk9\" (UID: \"fbb39a4a-2163-4900-80a8-1847ceb34a17\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" Jul 30 22:48:56.789294 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789160 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbb39a4a-2163-4900-80a8-1847ceb34a17-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-hqnk9\" (UID: \"fbb39a4a-2163-4900-80a8-1847ceb34a17\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" Jul 30 22:48:56.789294 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f894415-f174-4b40-8546-014769b398e6-node-exporter-textfile\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.789294 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789188 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f894415-f174-4b40-8546-014769b398e6-sys\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.789294 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789214 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbb39a4a-2163-4900-80a8-1847ceb34a17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-hqnk9\" (UID: \"fbb39a4a-2163-4900-80a8-1847ceb34a17\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" Jul 30 22:48:56.789294 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789258 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f894415-f174-4b40-8546-014769b398e6-node-exporter-wtmp\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.789294 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789270 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.789294 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.789840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.789840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f894415-f174-4b40-8546-014769b398e6-node-exporter-tls\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.789840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789395 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f894415-f174-4b40-8546-014769b398e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.789840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789429 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.789840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2txqz\" (UniqueName: \"kubernetes.io/projected/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-kube-api-access-2txqz\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.789840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789552 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f894415-f174-4b40-8546-014769b398e6-node-exporter-textfile\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.789840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789638 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f894415-f174-4b40-8546-014769b398e6-metrics-client-ca\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.789840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789665 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f894415-f174-4b40-8546-014769b398e6-node-exporter-accelerators-collector-config\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.790264 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.789912 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbb39a4a-2163-4900-80a8-1847ceb34a17-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-hqnk9\" (UID: \"fbb39a4a-2163-4900-80a8-1847ceb34a17\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" Jul 30 22:48:56.790264 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.790243 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.790607 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.790582 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.791076 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.791053 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.792032 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.792008 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.792303 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.792284 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbb39a4a-2163-4900-80a8-1847ceb34a17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-hqnk9\" (UID: \"fbb39a4a-2163-4900-80a8-1847ceb34a17\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" Jul 30 22:48:56.792575 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.792558 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f894415-f174-4b40-8546-014769b398e6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.792745 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.792728 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.792795 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.792734 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f894415-f174-4b40-8546-014769b398e6-node-exporter-tls\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.793088 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.793071 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbb39a4a-2163-4900-80a8-1847ceb34a17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-hqnk9\" (UID: \"fbb39a4a-2163-4900-80a8-1847ceb34a17\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" Jul 30 22:48:56.799173 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.799123 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv4pt\" (UniqueName: \"kubernetes.io/projected/2f894415-f174-4b40-8546-014769b398e6-kube-api-access-wv4pt\") pod \"node-exporter-fqm7n\" (UID: \"2f894415-f174-4b40-8546-014769b398e6\") " pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.799799 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.799773 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7j78\" (UniqueName: \"kubernetes.io/projected/fbb39a4a-2163-4900-80a8-1847ceb34a17-kube-api-access-d7j78\") pod \"openshift-state-metrics-6bb4d7b4dd-hqnk9\" (UID: \"fbb39a4a-2163-4900-80a8-1847ceb34a17\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" Jul 30 22:48:56.799906 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.799806 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2txqz\" (UniqueName: \"kubernetes.io/projected/b8034c8f-7835-47e4-9b0f-e2a40bc9acef-kube-api-access-2txqz\") pod \"kube-state-metrics-6bd9664c4-zgx2f\" (UID: \"b8034c8f-7835-47e4-9b0f-e2a40bc9acef\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.884933 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.884914 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" Jul 30 22:48:56.901168 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.901153 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" Jul 30 22:48:56.918202 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:56.918181 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fqm7n" Jul 30 22:48:56.932804 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:48:56.932762 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f894415_f174_4b40_8546_014769b398e6.slice/crio-ab116c471c4a81a732bed8a904035e2e04b735537123df084b8ec90e815b6153 WatchSource:0}: Error finding container ab116c471c4a81a732bed8a904035e2e04b735537123df084b8ec90e815b6153: Status 404 returned error can't find the container with id ab116c471c4a81a732bed8a904035e2e04b735537123df084b8ec90e815b6153 Jul 30 22:48:57.033617 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:48:57.032742 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb39a4a_2163_4900_80a8_1847ceb34a17.slice/crio-eca4cd0e40372d2ff5e6a62684aac8b2e4acd30bd830d761a97cb9b7c958d94e WatchSource:0}: Error finding container eca4cd0e40372d2ff5e6a62684aac8b2e4acd30bd830d761a97cb9b7c958d94e: Status 404 returned error can't find the container with id eca4cd0e40372d2ff5e6a62684aac8b2e4acd30bd830d761a97cb9b7c958d94e Jul 30 22:48:57.034587 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:57.034550 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9"] Jul 30 22:48:57.060799 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:57.060774 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f"] Jul 30 22:48:57.063273 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:48:57.063250 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8034c8f_7835_47e4_9b0f_e2a40bc9acef.slice/crio-363c6af701f77077e21a0536209c3735de7958974fde23a2707f2f4818f62679 WatchSource:0}: Error finding container 363c6af701f77077e21a0536209c3735de7958974fde23a2707f2f4818f62679: Status 404 returned error can't find the container with id 363c6af701f77077e21a0536209c3735de7958974fde23a2707f2f4818f62679 Jul 30 22:48:57.639303 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:57.639267 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" event={"ID":"fbb39a4a-2163-4900-80a8-1847ceb34a17","Type":"ContainerStarted","Data":"4d5bc6eca6436c355e56e27229f922f3f505862a1174788b3f7b521b6d0a5467"} Jul 30 22:48:57.639744 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:57.639342 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" event={"ID":"fbb39a4a-2163-4900-80a8-1847ceb34a17","Type":"ContainerStarted","Data":"92b353060f5056d3ed6125e989ac51e45e2370c28e24a793014c06549456e302"} Jul 30 22:48:57.639744 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:57.639373 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" event={"ID":"fbb39a4a-2163-4900-80a8-1847ceb34a17","Type":"ContainerStarted","Data":"eca4cd0e40372d2ff5e6a62684aac8b2e4acd30bd830d761a97cb9b7c958d94e"} Jul 30 22:48:57.641141 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:57.641113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fqm7n" event={"ID":"2f894415-f174-4b40-8546-014769b398e6","Type":"ContainerStarted","Data":"ab116c471c4a81a732bed8a904035e2e04b735537123df084b8ec90e815b6153"} Jul 30 22:48:57.642591 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:57.642563 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" event={"ID":"b8034c8f-7835-47e4-9b0f-e2a40bc9acef","Type":"ContainerStarted","Data":"363c6af701f77077e21a0536209c3735de7958974fde23a2707f2f4818f62679"} Jul 30 22:48:58.000407 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.000320 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret\") pod \"global-pull-secret-syncer-r96n6\" (UID: \"20eeae26-7b8c-4b13-976f-45be0ec631ff\") " pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:58.000586 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.000562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs\") pod \"network-metrics-daemon-j8q5t\" (UID: \"ee4984a2-9082-4730-a056-597f24a92af7\") " pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:58.006161 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.006135 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 30 22:48:58.006275 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.006138 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 30 22:48:58.013310 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.013287 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20eeae26-7b8c-4b13-976f-45be0ec631ff-original-pull-secret\") pod \"global-pull-secret-syncer-r96n6\" (UID: \"20eeae26-7b8c-4b13-976f-45be0ec631ff\") " pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:58.013428 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.013409 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4984a2-9082-4730-a056-597f24a92af7-metrics-certs\") pod \"network-metrics-daemon-j8q5t\" (UID: \"ee4984a2-9082-4730-a056-597f24a92af7\") " pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:58.053817 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.053789 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r96n6" Jul 30 22:48:58.063605 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.063586 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6fgjp\"" Jul 30 22:48:58.071921 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.071903 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j8q5t" Jul 30 22:48:58.101148 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.101126 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl8wn\" (UniqueName: \"kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn\") pod \"network-check-target-jtwng\" (UID: \"a9f3bd63-f053-41d2-b0ea-7e2770e4315b\") " pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:58.103607 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.103588 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 30 22:48:58.114347 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.114323 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 30 22:48:58.127540 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.126494 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl8wn\" (UniqueName: \"kubernetes.io/projected/a9f3bd63-f053-41d2-b0ea-7e2770e4315b-kube-api-access-fl8wn\") pod \"network-check-target-jtwng\" (UID: \"a9f3bd63-f053-41d2-b0ea-7e2770e4315b\") " pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:58.281059 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.280950 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r96n6"] Jul 30 22:48:58.311530 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.311499 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j8q5t"] Jul 30 22:48:58.347743 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.347719 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ghwvz\"" Jul 30 22:48:58.355849 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.355828 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:48:58.561932 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:48:58.561851 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4984a2_9082_4730_a056_597f24a92af7.slice/crio-e82cc1a39ef235019b1b1dc964e7e81af5efc600036cc9ffd86a64cf29266195 WatchSource:0}: Error finding container e82cc1a39ef235019b1b1dc964e7e81af5efc600036cc9ffd86a64cf29266195: Status 404 returned error can't find the container with id e82cc1a39ef235019b1b1dc964e7e81af5efc600036cc9ffd86a64cf29266195 Jul 30 22:48:58.562648 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:48:58.562621 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20eeae26_7b8c_4b13_976f_45be0ec631ff.slice/crio-53c50f6b47db6b1e151aa611c94ba0ddbc508e4cd074ef3418bf0d5b0b80b7ea WatchSource:0}: Error finding container 53c50f6b47db6b1e151aa611c94ba0ddbc508e4cd074ef3418bf0d5b0b80b7ea: Status 404 returned error can't find the container with id 53c50f6b47db6b1e151aa611c94ba0ddbc508e4cd074ef3418bf0d5b0b80b7ea Jul 30 22:48:58.649349 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.649310 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" event={"ID":"fbb39a4a-2163-4900-80a8-1847ceb34a17","Type":"ContainerStarted","Data":"fa4d1c97e3606cccf6402a3d07732e3a029bbe946fb1e6ab05d2f5473cf600ff"} Jul 30 22:48:58.650964 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.650931 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j8q5t" event={"ID":"ee4984a2-9082-4730-a056-597f24a92af7","Type":"ContainerStarted","Data":"e82cc1a39ef235019b1b1dc964e7e81af5efc600036cc9ffd86a64cf29266195"} Jul 30 22:48:58.652605 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.652584 2576 generic.go:356] "Generic (PLEG): container finished" podID="2f894415-f174-4b40-8546-014769b398e6" containerID="3aee651e5b8a2c1fd20b2e7c676ec6baf5343084cdb0ed3f2c042e4103a59c31" exitCode=0 Jul 30 22:48:58.652725 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.652654 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fqm7n" event={"ID":"2f894415-f174-4b40-8546-014769b398e6","Type":"ContainerDied","Data":"3aee651e5b8a2c1fd20b2e7c676ec6baf5343084cdb0ed3f2c042e4103a59c31"} Jul 30 22:48:58.656382 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.656348 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r96n6" event={"ID":"20eeae26-7b8c-4b13-976f-45be0ec631ff","Type":"ContainerStarted","Data":"53c50f6b47db6b1e151aa611c94ba0ddbc508e4cd074ef3418bf0d5b0b80b7ea"} Jul 30 22:48:58.674508 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.674456 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-hqnk9" podStartSLOduration=1.664460317 podStartE2EDuration="2.674438247s" totalImagesPullingTime="1.00997793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:58.673425802 +0000 UTC m=+65.877245043" watchObservedRunningTime="2026-07-30 22:48:58.674438247 +0000 UTC m=+65.878257481" Jul 30 22:48:58.687582 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:58.687562 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jtwng"] Jul 30 22:48:58.691179 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:48:58.691151 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f3bd63_f053_41d2_b0ea_7e2770e4315b.slice/crio-ec312d41b1ed043358b085b36ea8ba095aa1b2feb84e86ba6d73903ece822f29 WatchSource:0}: Error finding container ec312d41b1ed043358b085b36ea8ba095aa1b2feb84e86ba6d73903ece822f29: Status 404 returned error can't find the container with id ec312d41b1ed043358b085b36ea8ba095aa1b2feb84e86ba6d73903ece822f29 Jul 30 22:48:59.664444 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:59.664406 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fqm7n" event={"ID":"2f894415-f174-4b40-8546-014769b398e6","Type":"ContainerStarted","Data":"f53e2f22aceae802dc8df49fd95da1f682a22c2c6857c643a62aaec1d61cc1d4"} Jul 30 22:48:59.664914 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:59.664474 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fqm7n" event={"ID":"2f894415-f174-4b40-8546-014769b398e6","Type":"ContainerStarted","Data":"7d783a6a62573273a0e7c3ff81b5a2b6ce5a7cd144fa18b7ae34e40ef03d3011"} Jul 30 22:48:59.668887 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:59.668843 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" event={"ID":"b8034c8f-7835-47e4-9b0f-e2a40bc9acef","Type":"ContainerStarted","Data":"8988876c5a6fa9ce9c2448240df6cdd2d38d7b9d633c6cfe5247022d12bc07f8"} Jul 30 22:48:59.669005 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:59.668919 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" event={"ID":"b8034c8f-7835-47e4-9b0f-e2a40bc9acef","Type":"ContainerStarted","Data":"b0cea275aa5d00bb9c77d191c1c49c7cf46a39b3e7454684b654f10df8643666"} Jul 30 22:48:59.669005 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:59.668948 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" event={"ID":"b8034c8f-7835-47e4-9b0f-e2a40bc9acef","Type":"ContainerStarted","Data":"944d734fc041ccfa17a23ab5c82239f47942ecd8b21830a10e1ada34dc97dbe7"} Jul 30 22:48:59.671430 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:59.671405 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jtwng" event={"ID":"a9f3bd63-f053-41d2-b0ea-7e2770e4315b","Type":"ContainerStarted","Data":"ec312d41b1ed043358b085b36ea8ba095aa1b2feb84e86ba6d73903ece822f29"} Jul 30 22:48:59.686098 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:59.686050 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fqm7n" podStartSLOduration=2.416082321 podStartE2EDuration="3.686033261s" totalImagesPullingTime="1.188504173s" totalInitContainerRuntime="81.446767ms" isStatefulPod=true podCreationTimestamp="2026-07-30 22:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:59.68536186 +0000 UTC m=+66.889181120" watchObservedRunningTime="2026-07-30 22:48:59.686033261 +0000 UTC m=+66.889852498" Jul 30 22:48:59.704854 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:48:59.704744 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-zgx2f" podStartSLOduration=2.156313058 podStartE2EDuration="3.704725106s" totalImagesPullingTime="1.548412048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:59.703247248 +0000 UTC m=+66.907066483" watchObservedRunningTime="2026-07-30 22:48:59.704725106 +0000 UTC m=+66.908544340" Jul 30 22:49:00.678249 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:00.678207 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j8q5t" event={"ID":"ee4984a2-9082-4730-a056-597f24a92af7","Type":"ContainerStarted","Data":"141131f9631313ff3008cbd03347cd6b217e4c47cbdbb44e868d384cd8bfdda9"} Jul 30 22:49:00.678795 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:00.678309 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j8q5t" event={"ID":"ee4984a2-9082-4730-a056-597f24a92af7","Type":"ContainerStarted","Data":"196e8d068f5b8148022c8977e65ebeb2df187105f797dfc65b0096f0d63467af"} Jul 30 22:49:00.698654 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:00.697331 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j8q5t" podStartSLOduration=66.538012567 podStartE2EDuration="1m7.697310808s" totalImagesPullingTime="1.159298241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:49:00.695833459 +0000 UTC m=+67.899652694" watchObservedRunningTime="2026-07-30 22:49:00.697310808 +0000 UTC m=+67.901130036" Jul 30 22:49:01.409883 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.409814 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-756df4b7f-8t7zk"] Jul 30 22:49:01.447367 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.447338 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-678bdf8c54-j5pkx"] Jul 30 22:49:01.452057 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.452032 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.464420 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.464397 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-678bdf8c54-j5pkx"] Jul 30 22:49:01.534537 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.534506 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-oauth-config\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.534718 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.534552 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-serving-cert\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.534718 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.534614 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-config\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.534718 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.534702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-oauth-serving-cert\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.534892 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.534781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-service-ca\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.534892 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.534817 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k82s8\" (UniqueName: \"kubernetes.io/projected/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-kube-api-access-k82s8\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.534892 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.534872 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-trusted-ca-bundle\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.636040 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.635997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-config\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.636228 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.636049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-oauth-serving-cert\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.636228 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.636088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-service-ca\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.636228 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.636114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k82s8\" (UniqueName: \"kubernetes.io/projected/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-kube-api-access-k82s8\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.636228 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.636153 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-trusted-ca-bundle\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.636228 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.636201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-oauth-config\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.636515 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.636242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-serving-cert\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.636787 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.636750 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-config\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.636914 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.636851 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-service-ca\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.637280 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.637259 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-oauth-serving-cert\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.637643 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.637614 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-trusted-ca-bundle\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.639330 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.639309 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-oauth-config\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.639413 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.639392 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-serving-cert\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.645047 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.645013 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k82s8\" (UniqueName: \"kubernetes.io/projected/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-kube-api-access-k82s8\") pod \"console-678bdf8c54-j5pkx\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:01.762116 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:01.761845 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:03.389618 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:03.389588 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-678bdf8c54-j5pkx"] Jul 30 22:49:03.392793 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:49:03.392761 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f5b2e0_72e0_43f0_bfd3_77f6cf44df98.slice/crio-57e6ac0861bb0ae5b81d830d3ee2923e0aed49e62d244eb91e968eb0d7c52aa7 WatchSource:0}: Error finding container 57e6ac0861bb0ae5b81d830d3ee2923e0aed49e62d244eb91e968eb0d7c52aa7: Status 404 returned error can't find the container with id 57e6ac0861bb0ae5b81d830d3ee2923e0aed49e62d244eb91e968eb0d7c52aa7 Jul 30 22:49:03.488215 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:03.487902 2576 patch_prober.go:28] interesting pod/image-registry-6d98d88b4f-rbnfd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 30 22:49:03.488215 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:03.487967 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" podUID="f2b8d98f-be8b-49ff-88a1-0cee4fbc4244" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 22:49:03.693808 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:03.693774 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r96n6" event={"ID":"20eeae26-7b8c-4b13-976f-45be0ec631ff","Type":"ContainerStarted","Data":"5ec606deaf3dd1900561c82529dced20faa131ea7581857108b58df8575e844c"} Jul 30 22:49:03.695363 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:03.695337 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jtwng" event={"ID":"a9f3bd63-f053-41d2-b0ea-7e2770e4315b","Type":"ContainerStarted","Data":"a888a990f4bf8f01ba9d3cb91d5d0474ee32fb2846e48a439805032ca4db16d5"} Jul 30 22:49:03.695489 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:03.695419 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:49:03.696872 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:03.696838 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678bdf8c54-j5pkx" event={"ID":"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98","Type":"ContainerStarted","Data":"77fa6a8b5b0cb67c7dacb70873f229fe650c7ac3713e853d8bca888ec6e7cc5b"} Jul 30 22:49:03.696951 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:03.696911 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678bdf8c54-j5pkx" event={"ID":"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98","Type":"ContainerStarted","Data":"57e6ac0861bb0ae5b81d830d3ee2923e0aed49e62d244eb91e968eb0d7c52aa7"} Jul 30 22:49:03.710926 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:03.710889 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r96n6" podStartSLOduration=66.005381146 podStartE2EDuration="1m10.710851885s" totalImagesPullingTime="4.705470739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:49:03.710492536 +0000 UTC m=+70.914311770" watchObservedRunningTime="2026-07-30 22:49:03.710851885 +0000 UTC m=+70.914671119" Jul 30 22:49:03.728406 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:03.728363 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-678bdf8c54-j5pkx" podStartSLOduration=2.728348383 podStartE2EDuration="2.728348383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:49:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:49:03.72793503 +0000 UTC m=+70.931754264" watchObservedRunningTime="2026-07-30 22:49:03.728348383 +0000 UTC m=+70.932167616" Jul 30 22:49:03.744100 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:03.744060 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jtwng" podStartSLOduration=66.18080519 podStartE2EDuration="1m10.744048211s" totalImagesPullingTime="4.563243021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:49:03.74270896 +0000 UTC m=+70.946528193" watchObservedRunningTime="2026-07-30 22:49:03.744048211 +0000 UTC m=+70.947867445" Jul 30 22:49:05.106660 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:05.106631 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:49:05.110360 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:05.110342 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:49:05.590135 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:05.590105 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d98d88b4f-rbnfd" Jul 30 22:49:11.762051 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:11.762015 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:11.762535 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:11.762082 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:11.766796 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:11.766774 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:12.733775 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:12.733747 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:49:12.784875 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:12.784826 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74b8c4b577-nlf9f"] Jul 30 22:49:26.435967 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.435822 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-756df4b7f-8t7zk" podUID="dd79af4c-00c4-4aa0-8378-57ea4f3a206b" containerName="console" containerID="cri-o://15ab595649a0283d9b621c8c177e61fcaeb144304c08474b4535d4d6e4084eb1" gracePeriod=15 Jul 30 22:49:26.677468 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.677433 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:49:26.783754 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.783662 2576 generic.go:356] "Generic (PLEG): container finished" podID="dd79af4c-00c4-4aa0-8378-57ea4f3a206b" containerID="15ab595649a0283d9b621c8c177e61fcaeb144304c08474b4535d4d6e4084eb1" exitCode=0 Jul 30 22:49:26.783754 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.783705 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-756df4b7f-8t7zk" Jul 30 22:49:26.784006 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.783736 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-756df4b7f-8t7zk" event={"ID":"dd79af4c-00c4-4aa0-8378-57ea4f3a206b","Type":"ContainerDied","Data":"15ab595649a0283d9b621c8c177e61fcaeb144304c08474b4535d4d6e4084eb1"} Jul 30 22:49:26.784006 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.783804 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-756df4b7f-8t7zk" event={"ID":"dd79af4c-00c4-4aa0-8378-57ea4f3a206b","Type":"ContainerDied","Data":"358b2d211ecc878e9346c975a00742a68ac286119bf589c7855da68df2f0759a"} Jul 30 22:49:26.784006 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.783831 2576 scope.go:117] "RemoveContainer" containerID="15ab595649a0283d9b621c8c177e61fcaeb144304c08474b4535d4d6e4084eb1" Jul 30 22:49:26.791320 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.791303 2576 scope.go:117] "RemoveContainer" containerID="15ab595649a0283d9b621c8c177e61fcaeb144304c08474b4535d4d6e4084eb1" Jul 30 22:49:26.791598 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:49:26.791577 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15ab595649a0283d9b621c8c177e61fcaeb144304c08474b4535d4d6e4084eb1\": container with ID starting with 15ab595649a0283d9b621c8c177e61fcaeb144304c08474b4535d4d6e4084eb1 not found: ID does not exist" containerID="15ab595649a0283d9b621c8c177e61fcaeb144304c08474b4535d4d6e4084eb1" Jul 30 22:49:26.791673 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.791605 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ab595649a0283d9b621c8c177e61fcaeb144304c08474b4535d4d6e4084eb1"} err="failed to get container status \"15ab595649a0283d9b621c8c177e61fcaeb144304c08474b4535d4d6e4084eb1\": rpc error: code = NotFound desc = could not find container \"15ab595649a0283d9b621c8c177e61fcaeb144304c08474b4535d4d6e4084eb1\": container with ID starting with 15ab595649a0283d9b621c8c177e61fcaeb144304c08474b4535d4d6e4084eb1 not found: ID does not exist" Jul 30 22:49:26.830890 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.830850 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-oauth-config\") pod \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " Jul 30 22:49:26.830985 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.830904 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-service-ca\") pod \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " Jul 30 22:49:26.830985 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.830924 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-serving-cert\") pod \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " Jul 30 22:49:26.830985 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.830962 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f9wz\" (UniqueName: \"kubernetes.io/projected/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-kube-api-access-8f9wz\") pod \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " Jul 30 22:49:26.831121 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.830993 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-oauth-serving-cert\") pod \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " Jul 30 22:49:26.831121 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.831025 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-config\") pod \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\" (UID: \"dd79af4c-00c4-4aa0-8378-57ea4f3a206b\") " Jul 30 22:49:26.831430 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.831396 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-service-ca" (OuterVolumeSpecName: "service-ca") pod "dd79af4c-00c4-4aa0-8378-57ea4f3a206b" (UID: "dd79af4c-00c4-4aa0-8378-57ea4f3a206b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:49:26.831532 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.831398 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dd79af4c-00c4-4aa0-8378-57ea4f3a206b" (UID: "dd79af4c-00c4-4aa0-8378-57ea4f3a206b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:49:26.831532 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.831459 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-config" (OuterVolumeSpecName: "console-config") pod "dd79af4c-00c4-4aa0-8378-57ea4f3a206b" (UID: "dd79af4c-00c4-4aa0-8378-57ea4f3a206b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:49:26.833104 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.833079 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dd79af4c-00c4-4aa0-8378-57ea4f3a206b" (UID: "dd79af4c-00c4-4aa0-8378-57ea4f3a206b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 22:49:26.833200 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.833186 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dd79af4c-00c4-4aa0-8378-57ea4f3a206b" (UID: "dd79af4c-00c4-4aa0-8378-57ea4f3a206b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 22:49:26.833257 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.833197 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-kube-api-access-8f9wz" (OuterVolumeSpecName: "kube-api-access-8f9wz") pod "dd79af4c-00c4-4aa0-8378-57ea4f3a206b" (UID: "dd79af4c-00c4-4aa0-8378-57ea4f3a206b"). InnerVolumeSpecName "kube-api-access-8f9wz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 22:49:26.931474 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.931450 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f9wz\" (UniqueName: \"kubernetes.io/projected/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-kube-api-access-8f9wz\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:49:26.931474 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.931471 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-oauth-serving-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:49:26.931611 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.931486 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-config\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:49:26.931611 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.931498 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-oauth-config\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:49:26.931611 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.931509 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-service-ca\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:49:26.931611 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:26.931521 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd79af4c-00c4-4aa0-8378-57ea4f3a206b-console-serving-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:49:27.112072 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:27.112042 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-756df4b7f-8t7zk"] Jul 30 22:49:27.117460 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:27.117427 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-756df4b7f-8t7zk"] Jul 30 22:49:27.234938 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:27.234909 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd79af4c-00c4-4aa0-8378-57ea4f3a206b" path="/var/lib/kubelet/pods/dd79af4c-00c4-4aa0-8378-57ea4f3a206b/volumes" Jul 30 22:49:34.703368 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:34.703335 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jtwng" Jul 30 22:49:37.803580 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:37.803521 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74b8c4b577-nlf9f" podUID="26ce9858-f40c-4517-8520-36f0d158865f" containerName="console" containerID="cri-o://5fa0716e0e304487834c169d9054c63c9a1336bf9934091c55a0d5023cea2b82" gracePeriod=15 Jul 30 22:49:38.074963 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.074906 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:49:38.214240 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.214212 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ce9858-f40c-4517-8520-36f0d158865f-console-oauth-config\") pod \"26ce9858-f40c-4517-8520-36f0d158865f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " Jul 30 22:49:38.214240 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.214244 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-console-config\") pod \"26ce9858-f40c-4517-8520-36f0d158865f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " Jul 30 22:49:38.214468 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.214269 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-trusted-ca-bundle\") pod \"26ce9858-f40c-4517-8520-36f0d158865f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " Jul 30 22:49:38.214468 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.214288 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-oauth-serving-cert\") pod \"26ce9858-f40c-4517-8520-36f0d158865f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " Jul 30 22:49:38.214468 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.214308 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-service-ca\") pod \"26ce9858-f40c-4517-8520-36f0d158865f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " Jul 30 22:49:38.214468 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.214371 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gvx2\" (UniqueName: \"kubernetes.io/projected/26ce9858-f40c-4517-8520-36f0d158865f-kube-api-access-8gvx2\") pod \"26ce9858-f40c-4517-8520-36f0d158865f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " Jul 30 22:49:38.214468 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.214406 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ce9858-f40c-4517-8520-36f0d158865f-console-serving-cert\") pod \"26ce9858-f40c-4517-8520-36f0d158865f\" (UID: \"26ce9858-f40c-4517-8520-36f0d158865f\") " Jul 30 22:49:38.214776 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.214746 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "26ce9858-f40c-4517-8520-36f0d158865f" (UID: "26ce9858-f40c-4517-8520-36f0d158865f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:49:38.214776 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.214762 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-console-config" (OuterVolumeSpecName: "console-config") pod "26ce9858-f40c-4517-8520-36f0d158865f" (UID: "26ce9858-f40c-4517-8520-36f0d158865f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:49:38.214909 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.214770 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "26ce9858-f40c-4517-8520-36f0d158865f" (UID: "26ce9858-f40c-4517-8520-36f0d158865f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:49:38.214909 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.214797 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-service-ca" (OuterVolumeSpecName: "service-ca") pod "26ce9858-f40c-4517-8520-36f0d158865f" (UID: "26ce9858-f40c-4517-8520-36f0d158865f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:49:38.216466 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.216438 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26ce9858-f40c-4517-8520-36f0d158865f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "26ce9858-f40c-4517-8520-36f0d158865f" (UID: "26ce9858-f40c-4517-8520-36f0d158865f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 22:49:38.216621 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.216602 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26ce9858-f40c-4517-8520-36f0d158865f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "26ce9858-f40c-4517-8520-36f0d158865f" (UID: "26ce9858-f40c-4517-8520-36f0d158865f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 22:49:38.216679 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.216608 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26ce9858-f40c-4517-8520-36f0d158865f-kube-api-access-8gvx2" (OuterVolumeSpecName: "kube-api-access-8gvx2") pod "26ce9858-f40c-4517-8520-36f0d158865f" (UID: "26ce9858-f40c-4517-8520-36f0d158865f"). InnerVolumeSpecName "kube-api-access-8gvx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 22:49:38.315101 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.315071 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-oauth-serving-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:49:38.315101 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.315096 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-service-ca\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:49:38.315101 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.315105 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gvx2\" (UniqueName: \"kubernetes.io/projected/26ce9858-f40c-4517-8520-36f0d158865f-kube-api-access-8gvx2\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:49:38.315266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.315114 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/26ce9858-f40c-4517-8520-36f0d158865f-console-serving-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:49:38.315266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.315123 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/26ce9858-f40c-4517-8520-36f0d158865f-console-oauth-config\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:49:38.315266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.315131 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-console-config\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:49:38.315266 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.315139 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ce9858-f40c-4517-8520-36f0d158865f-trusted-ca-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:49:38.826747 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.826710 2576 generic.go:356] "Generic (PLEG): container finished" podID="26ce9858-f40c-4517-8520-36f0d158865f" containerID="5fa0716e0e304487834c169d9054c63c9a1336bf9934091c55a0d5023cea2b82" exitCode=0 Jul 30 22:49:38.827210 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.826757 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b8c4b577-nlf9f" Jul 30 22:49:38.827210 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.826795 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b8c4b577-nlf9f" event={"ID":"26ce9858-f40c-4517-8520-36f0d158865f","Type":"ContainerDied","Data":"5fa0716e0e304487834c169d9054c63c9a1336bf9934091c55a0d5023cea2b82"} Jul 30 22:49:38.827210 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.826881 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b8c4b577-nlf9f" event={"ID":"26ce9858-f40c-4517-8520-36f0d158865f","Type":"ContainerDied","Data":"40be47381fc3857c8cc9b11c66becb79e5c8b41621331207df2b4f878eb3d241"} Jul 30 22:49:38.827210 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.826918 2576 scope.go:117] "RemoveContainer" containerID="5fa0716e0e304487834c169d9054c63c9a1336bf9934091c55a0d5023cea2b82" Jul 30 22:49:38.835344 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.835327 2576 scope.go:117] "RemoveContainer" containerID="5fa0716e0e304487834c169d9054c63c9a1336bf9934091c55a0d5023cea2b82" Jul 30 22:49:38.835589 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:49:38.835572 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fa0716e0e304487834c169d9054c63c9a1336bf9934091c55a0d5023cea2b82\": container with ID starting with 5fa0716e0e304487834c169d9054c63c9a1336bf9934091c55a0d5023cea2b82 not found: ID does not exist" containerID="5fa0716e0e304487834c169d9054c63c9a1336bf9934091c55a0d5023cea2b82" Jul 30 22:49:38.835636 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.835598 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fa0716e0e304487834c169d9054c63c9a1336bf9934091c55a0d5023cea2b82"} err="failed to get container status \"5fa0716e0e304487834c169d9054c63c9a1336bf9934091c55a0d5023cea2b82\": rpc error: code = NotFound desc = could not find container \"5fa0716e0e304487834c169d9054c63c9a1336bf9934091c55a0d5023cea2b82\": container with ID starting with 5fa0716e0e304487834c169d9054c63c9a1336bf9934091c55a0d5023cea2b82 not found: ID does not exist" Jul 30 22:49:38.847871 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.847834 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74b8c4b577-nlf9f"] Jul 30 22:49:38.851768 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:38.851750 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74b8c4b577-nlf9f"] Jul 30 22:49:39.235807 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:49:39.235771 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26ce9858-f40c-4517-8520-36f0d158865f" path="/var/lib/kubelet/pods/26ce9858-f40c-4517-8520-36f0d158865f/volumes" Jul 30 22:50:20.953311 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:20.953280 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-859974687f-9n895"] Jul 30 22:50:20.953794 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:20.953533 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd79af4c-00c4-4aa0-8378-57ea4f3a206b" containerName="console" Jul 30 22:50:20.953794 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:20.953544 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd79af4c-00c4-4aa0-8378-57ea4f3a206b" containerName="console" Jul 30 22:50:20.953794 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:20.953555 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26ce9858-f40c-4517-8520-36f0d158865f" containerName="console" Jul 30 22:50:20.953794 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:20.953561 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="26ce9858-f40c-4517-8520-36f0d158865f" containerName="console" Jul 30 22:50:20.953794 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:20.953598 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="26ce9858-f40c-4517-8520-36f0d158865f" containerName="console" Jul 30 22:50:20.953794 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:20.953607 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd79af4c-00c4-4aa0-8378-57ea4f3a206b" containerName="console" Jul 30 22:50:20.956533 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:20.956515 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:20.959561 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:20.959535 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-g68fw\"" Jul 30 22:50:20.959561 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:20.959551 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 30 22:50:20.959715 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:20.959697 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 30 22:50:20.959851 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:20.959838 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 30 22:50:20.959948 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:20.959933 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 30 22:50:20.960021 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:20.960006 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 30 22:50:20.965472 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:20.965455 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 30 22:50:20.971231 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:20.971211 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-859974687f-9n895"] Jul 30 22:50:21.018505 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.018471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt4f2\" (UniqueName: \"kubernetes.io/projected/2c82d714-549f-4d1f-8770-30da50a594a7-kube-api-access-rt4f2\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.018505 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.018503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2c82d714-549f-4d1f-8770-30da50a594a7-telemeter-client-tls\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.018695 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.018528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2c82d714-549f-4d1f-8770-30da50a594a7-secret-telemeter-client\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.018695 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.018572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c82d714-549f-4d1f-8770-30da50a594a7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.018695 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.018604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c82d714-549f-4d1f-8770-30da50a594a7-serving-certs-ca-bundle\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.018695 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.018650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c82d714-549f-4d1f-8770-30da50a594a7-metrics-client-ca\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.018695 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.018670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c82d714-549f-4d1f-8770-30da50a594a7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.018844 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.018725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2c82d714-549f-4d1f-8770-30da50a594a7-federate-client-tls\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.119085 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.119052 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c82d714-549f-4d1f-8770-30da50a594a7-metrics-client-ca\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.119203 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.119090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c82d714-549f-4d1f-8770-30da50a594a7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.119203 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.119114 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2c82d714-549f-4d1f-8770-30da50a594a7-federate-client-tls\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.119203 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.119140 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt4f2\" (UniqueName: \"kubernetes.io/projected/2c82d714-549f-4d1f-8770-30da50a594a7-kube-api-access-rt4f2\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.119203 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.119159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2c82d714-549f-4d1f-8770-30da50a594a7-telemeter-client-tls\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.119203 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.119181 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2c82d714-549f-4d1f-8770-30da50a594a7-secret-telemeter-client\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.119203 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.119197 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c82d714-549f-4d1f-8770-30da50a594a7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.119454 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.119222 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c82d714-549f-4d1f-8770-30da50a594a7-serving-certs-ca-bundle\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.119937 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.119907 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c82d714-549f-4d1f-8770-30da50a594a7-metrics-client-ca\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.120218 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.120192 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c82d714-549f-4d1f-8770-30da50a594a7-serving-certs-ca-bundle\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.120322 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.120241 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c82d714-549f-4d1f-8770-30da50a594a7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.121689 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.121658 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2c82d714-549f-4d1f-8770-30da50a594a7-federate-client-tls\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.121810 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.121789 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2c82d714-549f-4d1f-8770-30da50a594a7-secret-telemeter-client\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.122028 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.122006 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c82d714-549f-4d1f-8770-30da50a594a7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.122176 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.122157 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2c82d714-549f-4d1f-8770-30da50a594a7-telemeter-client-tls\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.133793 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.133767 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt4f2\" (UniqueName: \"kubernetes.io/projected/2c82d714-549f-4d1f-8770-30da50a594a7-kube-api-access-rt4f2\") pod \"telemeter-client-859974687f-9n895\" (UID: \"2c82d714-549f-4d1f-8770-30da50a594a7\") " pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.266691 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.266604 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-859974687f-9n895" Jul 30 22:50:21.400320 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.400297 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-859974687f-9n895"] Jul 30 22:50:21.402528 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:50:21.402502 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c82d714_549f_4d1f_8770_30da50a594a7.slice/crio-a5d62ce9b16e0a870deb4bedc81834f336bd1f0eeea5428c7d0af28810c1baee WatchSource:0}: Error finding container a5d62ce9b16e0a870deb4bedc81834f336bd1f0eeea5428c7d0af28810c1baee: Status 404 returned error can't find the container with id a5d62ce9b16e0a870deb4bedc81834f336bd1f0eeea5428c7d0af28810c1baee Jul 30 22:50:21.978308 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:21.978268 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-859974687f-9n895" event={"ID":"2c82d714-549f-4d1f-8770-30da50a594a7","Type":"ContainerStarted","Data":"a5d62ce9b16e0a870deb4bedc81834f336bd1f0eeea5428c7d0af28810c1baee"} Jul 30 22:50:23.987913 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:23.987868 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-859974687f-9n895" event={"ID":"2c82d714-549f-4d1f-8770-30da50a594a7","Type":"ContainerStarted","Data":"302f05de70ebdd008e84c19cea408e1b87d7a1fff19fb3a62a9e388f54b7a004"} Jul 30 22:50:24.993069 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:24.993033 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-859974687f-9n895" event={"ID":"2c82d714-549f-4d1f-8770-30da50a594a7","Type":"ContainerStarted","Data":"dc224333d15846aecfdaba7f04a14071768ccd4dc6bb5243c30d3ffc5e5a28be"} Jul 30 22:50:24.993561 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:24.993095 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-859974687f-9n895" event={"ID":"2c82d714-549f-4d1f-8770-30da50a594a7","Type":"ContainerStarted","Data":"b7e2db86ce257f006355d618d51caff3757c843f08c3c81d38037a95f6454c75"} Jul 30 22:50:25.019076 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.019023 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-859974687f-9n895" podStartSLOduration=2.024615791 podStartE2EDuration="5.019007156s" totalImagesPullingTime="2.994391365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:50:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:50:25.017648917 +0000 UTC m=+152.221468205" watchObservedRunningTime="2026-07-30 22:50:25.019007156 +0000 UTC m=+152.222826389" Jul 30 22:50:25.119950 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.119917 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86b7885747-8n6w4"] Jul 30 22:50:25.122995 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.122978 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.135371 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.135347 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b7885747-8n6w4"] Jul 30 22:50:25.254347 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.254265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-trusted-ca-bundle\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.254347 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.254301 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-oauth-serving-cert\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.254347 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.254322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/963e053f-5faa-4db2-a359-06630eb6613c-console-oauth-config\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.254546 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.254347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-console-config\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.254546 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.254399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-service-ca\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.254546 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.254430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98jqq\" (UniqueName: \"kubernetes.io/projected/963e053f-5faa-4db2-a359-06630eb6613c-kube-api-access-98jqq\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.254546 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.254454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/963e053f-5faa-4db2-a359-06630eb6613c-console-serving-cert\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.355592 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.355548 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-console-config\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.355725 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.355607 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-service-ca\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.355725 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.355649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98jqq\" (UniqueName: \"kubernetes.io/projected/963e053f-5faa-4db2-a359-06630eb6613c-kube-api-access-98jqq\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.355725 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.355668 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/963e053f-5faa-4db2-a359-06630eb6613c-console-serving-cert\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.355903 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.355756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-trusted-ca-bundle\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.355903 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.355807 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-oauth-serving-cert\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.355903 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.355897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/963e053f-5faa-4db2-a359-06630eb6613c-console-oauth-config\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.356429 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.356402 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-console-config\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.356711 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.356684 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-service-ca\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.356779 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.356690 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-trusted-ca-bundle\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.356779 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.356757 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-oauth-serving-cert\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.358404 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.358385 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/963e053f-5faa-4db2-a359-06630eb6613c-console-oauth-config\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.358656 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.358638 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/963e053f-5faa-4db2-a359-06630eb6613c-console-serving-cert\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.365043 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.365021 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98jqq\" (UniqueName: \"kubernetes.io/projected/963e053f-5faa-4db2-a359-06630eb6613c-kube-api-access-98jqq\") pod \"console-86b7885747-8n6w4\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.432680 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.432643 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:25.558719 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.558688 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b7885747-8n6w4"] Jul 30 22:50:25.561638 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:50:25.561607 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod963e053f_5faa_4db2_a359_06630eb6613c.slice/crio-6a4610c0bc3f8df28c84ef1fa9daceb5d94d443b1ceb736ea872790a3e25c996 WatchSource:0}: Error finding container 6a4610c0bc3f8df28c84ef1fa9daceb5d94d443b1ceb736ea872790a3e25c996: Status 404 returned error can't find the container with id 6a4610c0bc3f8df28c84ef1fa9daceb5d94d443b1ceb736ea872790a3e25c996 Jul 30 22:50:25.998067 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.998026 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b7885747-8n6w4" event={"ID":"963e053f-5faa-4db2-a359-06630eb6613c","Type":"ContainerStarted","Data":"3244a28febfc1458332ffc427f2df9e91dcbfed2af715c2c0aea90a30eb108c1"} Jul 30 22:50:25.998567 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:25.998109 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b7885747-8n6w4" event={"ID":"963e053f-5faa-4db2-a359-06630eb6613c","Type":"ContainerStarted","Data":"6a4610c0bc3f8df28c84ef1fa9daceb5d94d443b1ceb736ea872790a3e25c996"} Jul 30 22:50:26.017377 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:26.017294 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86b7885747-8n6w4" podStartSLOduration=1.017274839 podStartE2EDuration="1.017274839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:50:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:50:26.017160206 +0000 UTC m=+153.220979439" watchObservedRunningTime="2026-07-30 22:50:26.017274839 +0000 UTC m=+153.221094053" Jul 30 22:50:35.433494 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:35.433435 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:35.433494 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:35.433511 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:35.438304 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:35.438282 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:36.036813 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.036783 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:50:36.084057 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.084023 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-678bdf8c54-j5pkx"] Jul 30 22:50:36.155411 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.155381 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56c7f7bbd5-25942"] Jul 30 22:50:36.159796 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.159775 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.174386 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.174362 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56c7f7bbd5-25942"] Jul 30 22:50:36.244516 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.244477 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-serving-cert\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.244516 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.244513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-config\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.244765 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.244535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-oauth-config\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.244765 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.244601 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-service-ca\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.244765 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.244649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-trusted-ca-bundle\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.244765 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.244704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-oauth-serving-cert\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.244945 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.244776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7ld6\" (UniqueName: \"kubernetes.io/projected/a40f5aa1-838a-46b2-8169-c9f3015a582c-kube-api-access-w7ld6\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.345528 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.345443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7ld6\" (UniqueName: \"kubernetes.io/projected/a40f5aa1-838a-46b2-8169-c9f3015a582c-kube-api-access-w7ld6\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.345528 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.345483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-serving-cert\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.345528 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.345503 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-config\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.345528 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.345522 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-oauth-config\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.345883 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.345548 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-service-ca\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.345883 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.345569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-trusted-ca-bundle\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.345883 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.345606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-oauth-serving-cert\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.346408 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.346372 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-oauth-serving-cert\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.346408 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.346396 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-config\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.346577 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.346397 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-service-ca\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.346577 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.346557 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-trusted-ca-bundle\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.348220 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.348198 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-oauth-config\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.348220 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.348216 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-serving-cert\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.354726 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.354699 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7ld6\" (UniqueName: \"kubernetes.io/projected/a40f5aa1-838a-46b2-8169-c9f3015a582c-kube-api-access-w7ld6\") pod \"console-56c7f7bbd5-25942\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.469391 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.469362 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:36.597787 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:36.597714 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56c7f7bbd5-25942"] Jul 30 22:50:36.600582 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:50:36.600558 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda40f5aa1_838a_46b2_8169_c9f3015a582c.slice/crio-2aace4a6edd2402f7a2b96918668670c3fa58a417c5fc645e1d2f982319cd2b2 WatchSource:0}: Error finding container 2aace4a6edd2402f7a2b96918668670c3fa58a417c5fc645e1d2f982319cd2b2: Status 404 returned error can't find the container with id 2aace4a6edd2402f7a2b96918668670c3fa58a417c5fc645e1d2f982319cd2b2 Jul 30 22:50:37.037213 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:37.037160 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c7f7bbd5-25942" event={"ID":"a40f5aa1-838a-46b2-8169-c9f3015a582c","Type":"ContainerStarted","Data":"3514e728ee9a294ec6aee872f1098b6e929e7f682ed14ccbc1a695c7a2afb84d"} Jul 30 22:50:37.037401 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:37.037233 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c7f7bbd5-25942" event={"ID":"a40f5aa1-838a-46b2-8169-c9f3015a582c","Type":"ContainerStarted","Data":"2aace4a6edd2402f7a2b96918668670c3fa58a417c5fc645e1d2f982319cd2b2"} Jul 30 22:50:37.059030 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:37.058969 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56c7f7bbd5-25942" podStartSLOduration=1.058949227 podStartE2EDuration="1.058949227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:50:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:50:37.058595263 +0000 UTC m=+164.262414499" watchObservedRunningTime="2026-07-30 22:50:37.058949227 +0000 UTC m=+164.262768462" Jul 30 22:50:46.470489 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:46.470408 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:46.470489 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:46.470482 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:46.474920 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:46.474900 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:47.077139 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:47.077113 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:50:47.127007 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:50:47.126977 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86b7885747-8n6w4"] Jul 30 22:51:01.102570 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.102506 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-678bdf8c54-j5pkx" podUID="96f5b2e0-72e0-43f0-bfd3-77f6cf44df98" containerName="console" containerID="cri-o://77fa6a8b5b0cb67c7dacb70873f229fe650c7ac3713e853d8bca888ec6e7cc5b" gracePeriod=15 Jul 30 22:51:01.348232 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.348210 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:51:01.433194 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.433165 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-serving-cert\") pod \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " Jul 30 22:51:01.433375 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.433213 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-oauth-config\") pod \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " Jul 30 22:51:01.433375 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.433238 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k82s8\" (UniqueName: \"kubernetes.io/projected/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-kube-api-access-k82s8\") pod \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " Jul 30 22:51:01.433375 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.433289 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-config\") pod \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " Jul 30 22:51:01.433375 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.433320 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-oauth-serving-cert\") pod \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " Jul 30 22:51:01.433375 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.433353 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-trusted-ca-bundle\") pod \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " Jul 30 22:51:01.433625 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.433383 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-service-ca\") pod \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\" (UID: \"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98\") " Jul 30 22:51:01.433775 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.433742 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "96f5b2e0-72e0-43f0-bfd3-77f6cf44df98" (UID: "96f5b2e0-72e0-43f0-bfd3-77f6cf44df98"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:51:01.433876 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.433768 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-config" (OuterVolumeSpecName: "console-config") pod "96f5b2e0-72e0-43f0-bfd3-77f6cf44df98" (UID: "96f5b2e0-72e0-43f0-bfd3-77f6cf44df98"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:51:01.433876 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.433777 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "96f5b2e0-72e0-43f0-bfd3-77f6cf44df98" (UID: "96f5b2e0-72e0-43f0-bfd3-77f6cf44df98"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:51:01.433876 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.433843 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-service-ca" (OuterVolumeSpecName: "service-ca") pod "96f5b2e0-72e0-43f0-bfd3-77f6cf44df98" (UID: "96f5b2e0-72e0-43f0-bfd3-77f6cf44df98"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:51:01.435486 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.435464 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "96f5b2e0-72e0-43f0-bfd3-77f6cf44df98" (UID: "96f5b2e0-72e0-43f0-bfd3-77f6cf44df98"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 22:51:01.435570 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.435460 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-kube-api-access-k82s8" (OuterVolumeSpecName: "kube-api-access-k82s8") pod "96f5b2e0-72e0-43f0-bfd3-77f6cf44df98" (UID: "96f5b2e0-72e0-43f0-bfd3-77f6cf44df98"). InnerVolumeSpecName "kube-api-access-k82s8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 22:51:01.435570 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.435527 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "96f5b2e0-72e0-43f0-bfd3-77f6cf44df98" (UID: "96f5b2e0-72e0-43f0-bfd3-77f6cf44df98"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 22:51:01.534751 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.534722 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-service-ca\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:51:01.534751 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.534748 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-serving-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:51:01.534751 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.534757 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-oauth-config\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:51:01.535047 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.534766 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k82s8\" (UniqueName: \"kubernetes.io/projected/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-kube-api-access-k82s8\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:51:01.535047 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.534776 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-console-config\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:51:01.535047 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.534784 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-oauth-serving-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:51:01.535047 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:01.534791 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98-trusted-ca-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:51:02.126391 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:02.126357 2576 generic.go:356] "Generic (PLEG): container finished" podID="96f5b2e0-72e0-43f0-bfd3-77f6cf44df98" containerID="77fa6a8b5b0cb67c7dacb70873f229fe650c7ac3713e853d8bca888ec6e7cc5b" exitCode=0 Jul 30 22:51:02.126799 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:02.126404 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678bdf8c54-j5pkx" Jul 30 22:51:02.126799 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:02.126439 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678bdf8c54-j5pkx" event={"ID":"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98","Type":"ContainerDied","Data":"77fa6a8b5b0cb67c7dacb70873f229fe650c7ac3713e853d8bca888ec6e7cc5b"} Jul 30 22:51:02.126799 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:02.126487 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678bdf8c54-j5pkx" event={"ID":"96f5b2e0-72e0-43f0-bfd3-77f6cf44df98","Type":"ContainerDied","Data":"57e6ac0861bb0ae5b81d830d3ee2923e0aed49e62d244eb91e968eb0d7c52aa7"} Jul 30 22:51:02.126799 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:02.126508 2576 scope.go:117] "RemoveContainer" containerID="77fa6a8b5b0cb67c7dacb70873f229fe650c7ac3713e853d8bca888ec6e7cc5b" Jul 30 22:51:02.135128 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:02.135113 2576 scope.go:117] "RemoveContainer" containerID="77fa6a8b5b0cb67c7dacb70873f229fe650c7ac3713e853d8bca888ec6e7cc5b" Jul 30 22:51:02.135384 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:51:02.135363 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77fa6a8b5b0cb67c7dacb70873f229fe650c7ac3713e853d8bca888ec6e7cc5b\": container with ID starting with 77fa6a8b5b0cb67c7dacb70873f229fe650c7ac3713e853d8bca888ec6e7cc5b not found: ID does not exist" containerID="77fa6a8b5b0cb67c7dacb70873f229fe650c7ac3713e853d8bca888ec6e7cc5b" Jul 30 22:51:02.135448 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:02.135391 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77fa6a8b5b0cb67c7dacb70873f229fe650c7ac3713e853d8bca888ec6e7cc5b"} err="failed to get container status \"77fa6a8b5b0cb67c7dacb70873f229fe650c7ac3713e853d8bca888ec6e7cc5b\": rpc error: code = NotFound desc = could not find container \"77fa6a8b5b0cb67c7dacb70873f229fe650c7ac3713e853d8bca888ec6e7cc5b\": container with ID starting with 77fa6a8b5b0cb67c7dacb70873f229fe650c7ac3713e853d8bca888ec6e7cc5b not found: ID does not exist" Jul 30 22:51:02.147957 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:02.147932 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-678bdf8c54-j5pkx"] Jul 30 22:51:02.151600 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:02.151580 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-678bdf8c54-j5pkx"] Jul 30 22:51:03.235030 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:03.234991 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96f5b2e0-72e0-43f0-bfd3-77f6cf44df98" path="/var/lib/kubelet/pods/96f5b2e0-72e0-43f0-bfd3-77f6cf44df98/volumes" Jul 30 22:51:12.146288 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.146222 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86b7885747-8n6w4" podUID="963e053f-5faa-4db2-a359-06630eb6613c" containerName="console" containerID="cri-o://3244a28febfc1458332ffc427f2df9e91dcbfed2af715c2c0aea90a30eb108c1" gracePeriod=15 Jul 30 22:51:12.384824 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.384801 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:51:12.520762 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.520668 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-trusted-ca-bundle\") pod \"963e053f-5faa-4db2-a359-06630eb6613c\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " Jul 30 22:51:12.520762 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.520715 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-oauth-serving-cert\") pod \"963e053f-5faa-4db2-a359-06630eb6613c\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " Jul 30 22:51:12.520762 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.520750 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-service-ca\") pod \"963e053f-5faa-4db2-a359-06630eb6613c\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " Jul 30 22:51:12.521066 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.520768 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-console-config\") pod \"963e053f-5faa-4db2-a359-06630eb6613c\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " Jul 30 22:51:12.521066 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.520792 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/963e053f-5faa-4db2-a359-06630eb6613c-console-serving-cert\") pod \"963e053f-5faa-4db2-a359-06630eb6613c\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " Jul 30 22:51:12.521066 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.520820 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98jqq\" (UniqueName: \"kubernetes.io/projected/963e053f-5faa-4db2-a359-06630eb6613c-kube-api-access-98jqq\") pod \"963e053f-5faa-4db2-a359-06630eb6613c\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " Jul 30 22:51:12.521066 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.520853 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/963e053f-5faa-4db2-a359-06630eb6613c-console-oauth-config\") pod \"963e053f-5faa-4db2-a359-06630eb6613c\" (UID: \"963e053f-5faa-4db2-a359-06630eb6613c\") " Jul 30 22:51:12.521256 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.521225 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "963e053f-5faa-4db2-a359-06630eb6613c" (UID: "963e053f-5faa-4db2-a359-06630eb6613c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:51:12.521376 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.521286 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-service-ca" (OuterVolumeSpecName: "service-ca") pod "963e053f-5faa-4db2-a359-06630eb6613c" (UID: "963e053f-5faa-4db2-a359-06630eb6613c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:51:12.521376 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.521291 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "963e053f-5faa-4db2-a359-06630eb6613c" (UID: "963e053f-5faa-4db2-a359-06630eb6613c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:51:12.521376 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.521326 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-console-config" (OuterVolumeSpecName: "console-config") pod "963e053f-5faa-4db2-a359-06630eb6613c" (UID: "963e053f-5faa-4db2-a359-06630eb6613c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:51:12.523100 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.523073 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/963e053f-5faa-4db2-a359-06630eb6613c-kube-api-access-98jqq" (OuterVolumeSpecName: "kube-api-access-98jqq") pod "963e053f-5faa-4db2-a359-06630eb6613c" (UID: "963e053f-5faa-4db2-a359-06630eb6613c"). InnerVolumeSpecName "kube-api-access-98jqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 22:51:12.523189 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.523074 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/963e053f-5faa-4db2-a359-06630eb6613c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "963e053f-5faa-4db2-a359-06630eb6613c" (UID: "963e053f-5faa-4db2-a359-06630eb6613c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 22:51:12.523189 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.523152 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/963e053f-5faa-4db2-a359-06630eb6613c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "963e053f-5faa-4db2-a359-06630eb6613c" (UID: "963e053f-5faa-4db2-a359-06630eb6613c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 22:51:12.621424 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.621378 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/963e053f-5faa-4db2-a359-06630eb6613c-console-serving-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:51:12.621424 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.621420 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98jqq\" (UniqueName: \"kubernetes.io/projected/963e053f-5faa-4db2-a359-06630eb6613c-kube-api-access-98jqq\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:51:12.621424 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.621429 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/963e053f-5faa-4db2-a359-06630eb6613c-console-oauth-config\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:51:12.621424 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.621439 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-trusted-ca-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:51:12.621690 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.621449 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-oauth-serving-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:51:12.621690 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.621458 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-service-ca\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:51:12.621690 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:12.621467 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/963e053f-5faa-4db2-a359-06630eb6613c-console-config\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:51:13.166561 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:13.166525 2576 generic.go:356] "Generic (PLEG): container finished" podID="963e053f-5faa-4db2-a359-06630eb6613c" containerID="3244a28febfc1458332ffc427f2df9e91dcbfed2af715c2c0aea90a30eb108c1" exitCode=0 Jul 30 22:51:13.167033 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:13.166575 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b7885747-8n6w4" Jul 30 22:51:13.167033 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:13.166603 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b7885747-8n6w4" event={"ID":"963e053f-5faa-4db2-a359-06630eb6613c","Type":"ContainerDied","Data":"3244a28febfc1458332ffc427f2df9e91dcbfed2af715c2c0aea90a30eb108c1"} Jul 30 22:51:13.167033 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:13.166648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b7885747-8n6w4" event={"ID":"963e053f-5faa-4db2-a359-06630eb6613c","Type":"ContainerDied","Data":"6a4610c0bc3f8df28c84ef1fa9daceb5d94d443b1ceb736ea872790a3e25c996"} Jul 30 22:51:13.167033 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:13.166670 2576 scope.go:117] "RemoveContainer" containerID="3244a28febfc1458332ffc427f2df9e91dcbfed2af715c2c0aea90a30eb108c1" Jul 30 22:51:13.174504 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:13.174485 2576 scope.go:117] "RemoveContainer" containerID="3244a28febfc1458332ffc427f2df9e91dcbfed2af715c2c0aea90a30eb108c1" Jul 30 22:51:13.174755 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:51:13.174733 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3244a28febfc1458332ffc427f2df9e91dcbfed2af715c2c0aea90a30eb108c1\": container with ID starting with 3244a28febfc1458332ffc427f2df9e91dcbfed2af715c2c0aea90a30eb108c1 not found: ID does not exist" containerID="3244a28febfc1458332ffc427f2df9e91dcbfed2af715c2c0aea90a30eb108c1" Jul 30 22:51:13.174826 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:13.174765 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3244a28febfc1458332ffc427f2df9e91dcbfed2af715c2c0aea90a30eb108c1"} err="failed to get container status \"3244a28febfc1458332ffc427f2df9e91dcbfed2af715c2c0aea90a30eb108c1\": rpc error: code = NotFound desc = could not find container \"3244a28febfc1458332ffc427f2df9e91dcbfed2af715c2c0aea90a30eb108c1\": container with ID starting with 3244a28febfc1458332ffc427f2df9e91dcbfed2af715c2c0aea90a30eb108c1 not found: ID does not exist" Jul 30 22:51:13.187628 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:13.187605 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86b7885747-8n6w4"] Jul 30 22:51:13.191726 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:13.191705 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86b7885747-8n6w4"] Jul 30 22:51:13.234812 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:13.234782 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="963e053f-5faa-4db2-a359-06630eb6613c" path="/var/lib/kubelet/pods/963e053f-5faa-4db2-a359-06630eb6613c/volumes" Jul 30 22:51:47.908876 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:47.908832 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs"] Jul 30 22:51:47.909417 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:47.909227 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96f5b2e0-72e0-43f0-bfd3-77f6cf44df98" containerName="console" Jul 30 22:51:47.909417 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:47.909244 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="96f5b2e0-72e0-43f0-bfd3-77f6cf44df98" containerName="console" Jul 30 22:51:47.909417 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:47.909268 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="963e053f-5faa-4db2-a359-06630eb6613c" containerName="console" Jul 30 22:51:47.909417 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:47.909275 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="963e053f-5faa-4db2-a359-06630eb6613c" containerName="console" Jul 30 22:51:47.909417 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:47.909347 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="963e053f-5faa-4db2-a359-06630eb6613c" containerName="console" Jul 30 22:51:47.909417 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:47.909359 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="96f5b2e0-72e0-43f0-bfd3-77f6cf44df98" containerName="console" Jul 30 22:51:47.912435 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:47.912411 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" Jul 30 22:51:47.915223 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:47.915200 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 30 22:51:47.916195 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:47.916174 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6tc8q\"" Jul 30 22:51:47.916298 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:47.916178 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 30 22:51:47.920538 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:47.920520 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs"] Jul 30 22:51:47.992623 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:47.992586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs\" (UID: \"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" Jul 30 22:51:47.992623 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:47.992622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs\" (UID: \"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" Jul 30 22:51:47.992828 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:47.992754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w68ws\" (UniqueName: \"kubernetes.io/projected/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-kube-api-access-w68ws\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs\" (UID: \"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" Jul 30 22:51:48.093197 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:48.093163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs\" (UID: \"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" Jul 30 22:51:48.093292 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:48.093202 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs\" (UID: \"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" Jul 30 22:51:48.093331 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:48.093300 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w68ws\" (UniqueName: \"kubernetes.io/projected/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-kube-api-access-w68ws\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs\" (UID: \"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" Jul 30 22:51:48.093614 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:48.093594 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs\" (UID: \"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" Jul 30 22:51:48.093653 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:48.093618 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs\" (UID: \"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" Jul 30 22:51:48.101392 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:48.101373 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w68ws\" (UniqueName: \"kubernetes.io/projected/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-kube-api-access-w68ws\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs\" (UID: \"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" Jul 30 22:51:48.221825 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:48.221745 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" Jul 30 22:51:48.352659 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:48.352631 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs"] Jul 30 22:51:48.356030 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:51:48.355998 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69b842a_96bb_4f80_b5cc_8ac1ba4e4de1.slice/crio-cac4eb6581394a41139e069d3a8a08e2ae8b199acb40c921e83235dfd15cadf2 WatchSource:0}: Error finding container cac4eb6581394a41139e069d3a8a08e2ae8b199acb40c921e83235dfd15cadf2: Status 404 returned error can't find the container with id cac4eb6581394a41139e069d3a8a08e2ae8b199acb40c921e83235dfd15cadf2 Jul 30 22:51:49.293594 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:49.293560 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" event={"ID":"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1","Type":"ContainerStarted","Data":"cac4eb6581394a41139e069d3a8a08e2ae8b199acb40c921e83235dfd15cadf2"} Jul 30 22:51:55.316665 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:55.316632 2576 generic.go:356] "Generic (PLEG): container finished" podID="d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1" containerID="31e48f80915b0153254b4fc3746c6111f469c865a9326636e45f4679264d7c59" exitCode=0 Jul 30 22:51:55.316665 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:55.316668 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" event={"ID":"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1","Type":"ContainerDied","Data":"31e48f80915b0153254b4fc3746c6111f469c865a9326636e45f4679264d7c59"} Jul 30 22:51:58.329433 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:58.329399 2576 generic.go:356] "Generic (PLEG): container finished" podID="d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1" containerID="a45535d998dcb4dbae411386624ae6b35c0ba28e9179ebdb3a8e49ee94562a82" exitCode=0 Jul 30 22:51:58.329898 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:51:58.329472 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" event={"ID":"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1","Type":"ContainerDied","Data":"a45535d998dcb4dbae411386624ae6b35c0ba28e9179ebdb3a8e49ee94562a82"} Jul 30 22:52:05.363469 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:05.363372 2576 generic.go:356] "Generic (PLEG): container finished" podID="d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1" containerID="1a837a684b437d9bff4ee35d7e387c718035a2a168cf6cf0721c876fcfb23b6e" exitCode=0 Jul 30 22:52:05.363840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:05.363462 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" event={"ID":"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1","Type":"ContainerDied","Data":"1a837a684b437d9bff4ee35d7e387c718035a2a168cf6cf0721c876fcfb23b6e"} Jul 30 22:52:06.495624 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:06.495595 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" Jul 30 22:52:06.546256 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:06.546225 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-bundle\") pod \"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1\" (UID: \"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1\") " Jul 30 22:52:06.546403 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:06.546287 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-util\") pod \"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1\" (UID: \"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1\") " Jul 30 22:52:06.546403 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:06.546317 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w68ws\" (UniqueName: \"kubernetes.io/projected/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-kube-api-access-w68ws\") pod \"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1\" (UID: \"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1\") " Jul 30 22:52:06.547075 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:06.547046 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-bundle" (OuterVolumeSpecName: "bundle") pod "d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1" (UID: "d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:52:06.548416 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:06.548396 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-kube-api-access-w68ws" (OuterVolumeSpecName: "kube-api-access-w68ws") pod "d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1" (UID: "d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1"). InnerVolumeSpecName "kube-api-access-w68ws". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 22:52:06.552587 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:06.552558 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-util" (OuterVolumeSpecName: "util") pod "d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1" (UID: "d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:52:06.647085 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:06.647056 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-util\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:52:06.647085 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:06.647086 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w68ws\" (UniqueName: \"kubernetes.io/projected/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-kube-api-access-w68ws\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:52:06.647270 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:06.647099 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:52:07.371187 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:07.371153 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" event={"ID":"d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1","Type":"ContainerDied","Data":"cac4eb6581394a41139e069d3a8a08e2ae8b199acb40c921e83235dfd15cadf2"} Jul 30 22:52:07.371187 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:07.371175 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754074mzs" Jul 30 22:52:07.371382 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:07.371208 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cac4eb6581394a41139e069d3a8a08e2ae8b199acb40c921e83235dfd15cadf2" Jul 30 22:52:10.805426 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:10.805389 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79hmv"] Jul 30 22:52:10.805949 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:10.805690 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1" containerName="util" Jul 30 22:52:10.805949 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:10.805702 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1" containerName="util" Jul 30 22:52:10.805949 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:10.805718 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1" containerName="extract" Jul 30 22:52:10.805949 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:10.805728 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1" containerName="extract" Jul 30 22:52:10.805949 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:10.805748 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1" containerName="pull" Jul 30 22:52:10.805949 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:10.805754 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1" containerName="pull" Jul 30 22:52:10.805949 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:10.805814 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d69b842a-96bb-4f80-b5cc-8ac1ba4e4de1" containerName="extract" Jul 30 22:52:10.838934 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:10.838898 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79hmv"] Jul 30 22:52:10.839082 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:10.839015 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79hmv" Jul 30 22:52:10.841877 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:10.841845 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 30 22:52:10.841995 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:10.841889 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 30 22:52:10.841995 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:10.841935 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-gz5sc\"" Jul 30 22:52:10.980533 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:10.980498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkffx\" (UniqueName: \"kubernetes.io/projected/06c5ec93-4086-440c-a88e-1e30033bff86-kube-api-access-tkffx\") pod \"cert-manager-operator-controller-manager-55c444bf86-79hmv\" (UID: \"06c5ec93-4086-440c-a88e-1e30033bff86\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79hmv" Jul 30 22:52:10.980533 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:10.980533 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06c5ec93-4086-440c-a88e-1e30033bff86-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-79hmv\" (UID: \"06c5ec93-4086-440c-a88e-1e30033bff86\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79hmv" Jul 30 22:52:11.081401 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:11.081314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkffx\" (UniqueName: \"kubernetes.io/projected/06c5ec93-4086-440c-a88e-1e30033bff86-kube-api-access-tkffx\") pod \"cert-manager-operator-controller-manager-55c444bf86-79hmv\" (UID: \"06c5ec93-4086-440c-a88e-1e30033bff86\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79hmv" Jul 30 22:52:11.081401 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:11.081350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06c5ec93-4086-440c-a88e-1e30033bff86-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-79hmv\" (UID: \"06c5ec93-4086-440c-a88e-1e30033bff86\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79hmv" Jul 30 22:52:11.081700 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:11.081684 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06c5ec93-4086-440c-a88e-1e30033bff86-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-79hmv\" (UID: \"06c5ec93-4086-440c-a88e-1e30033bff86\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79hmv" Jul 30 22:52:11.092405 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:11.092373 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkffx\" (UniqueName: \"kubernetes.io/projected/06c5ec93-4086-440c-a88e-1e30033bff86-kube-api-access-tkffx\") pod \"cert-manager-operator-controller-manager-55c444bf86-79hmv\" (UID: \"06c5ec93-4086-440c-a88e-1e30033bff86\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79hmv" Jul 30 22:52:11.147481 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:11.147449 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79hmv" Jul 30 22:52:11.311716 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:11.311695 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79hmv"] Jul 30 22:52:11.313512 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:52:11.313485 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06c5ec93_4086_440c_a88e_1e30033bff86.slice/crio-fd5067e88e3c07cb15498755fe8d5bf96b474afa015ac6643dbc01726d66ed6d WatchSource:0}: Error finding container fd5067e88e3c07cb15498755fe8d5bf96b474afa015ac6643dbc01726d66ed6d: Status 404 returned error can't find the container with id fd5067e88e3c07cb15498755fe8d5bf96b474afa015ac6643dbc01726d66ed6d Jul 30 22:52:11.387541 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:11.387514 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79hmv" event={"ID":"06c5ec93-4086-440c-a88e-1e30033bff86","Type":"ContainerStarted","Data":"fd5067e88e3c07cb15498755fe8d5bf96b474afa015ac6643dbc01726d66ed6d"} Jul 30 22:52:14.401104 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:14.401070 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79hmv" event={"ID":"06c5ec93-4086-440c-a88e-1e30033bff86","Type":"ContainerStarted","Data":"96a5df73ca3a04624ef4369f491e0e0d793815d11261a766e9cb2bdc774db6ae"} Jul 30 22:52:14.425332 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:14.425261 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-79hmv" podStartSLOduration=2.322350727 podStartE2EDuration="4.425241709s" totalImagesPullingTime="2.102890982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:52:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:52:14.424114458 +0000 UTC m=+261.627933737" watchObservedRunningTime="2026-07-30 22:52:14.425241709 +0000 UTC m=+261.629060943" Jul 30 22:52:14.553362 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:14.553334 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6cvxh"] Jul 30 22:52:14.566199 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:14.566174 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6cvxh" Jul 30 22:52:14.569219 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:14.569193 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 30 22:52:14.569357 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:14.569296 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4hvl9\"" Jul 30 22:52:14.569738 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:14.569723 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 30 22:52:14.576992 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:14.576972 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6cvxh"] Jul 30 22:52:14.711980 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:14.711893 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z4q4\" (UniqueName: \"kubernetes.io/projected/a3657dd8-410c-4550-9735-49eaca91240c-kube-api-access-5z4q4\") pod \"cert-manager-webhook-6486ffd997-6cvxh\" (UID: \"a3657dd8-410c-4550-9735-49eaca91240c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6cvxh" Jul 30 22:52:14.711980 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:14.711933 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3657dd8-410c-4550-9735-49eaca91240c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6cvxh\" (UID: \"a3657dd8-410c-4550-9735-49eaca91240c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6cvxh" Jul 30 22:52:14.812467 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:14.812431 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z4q4\" (UniqueName: \"kubernetes.io/projected/a3657dd8-410c-4550-9735-49eaca91240c-kube-api-access-5z4q4\") pod \"cert-manager-webhook-6486ffd997-6cvxh\" (UID: \"a3657dd8-410c-4550-9735-49eaca91240c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6cvxh" Jul 30 22:52:14.812467 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:14.812469 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3657dd8-410c-4550-9735-49eaca91240c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6cvxh\" (UID: \"a3657dd8-410c-4550-9735-49eaca91240c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6cvxh" Jul 30 22:52:14.827845 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:14.827819 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z4q4\" (UniqueName: \"kubernetes.io/projected/a3657dd8-410c-4550-9735-49eaca91240c-kube-api-access-5z4q4\") pod \"cert-manager-webhook-6486ffd997-6cvxh\" (UID: \"a3657dd8-410c-4550-9735-49eaca91240c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6cvxh" Jul 30 22:52:14.827845 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:14.827830 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3657dd8-410c-4550-9735-49eaca91240c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6cvxh\" (UID: \"a3657dd8-410c-4550-9735-49eaca91240c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6cvxh" Jul 30 22:52:14.883492 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:14.883458 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6cvxh" Jul 30 22:52:15.028153 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.028131 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6cvxh"] Jul 30 22:52:15.030742 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:52:15.030710 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3657dd8_410c_4550_9735_49eaca91240c.slice/crio-13b7e353187d29cac12b18a11d635da11ede7c55decda13c88daba688ab12b49 WatchSource:0}: Error finding container 13b7e353187d29cac12b18a11d635da11ede7c55decda13c88daba688ab12b49: Status 404 returned error can't find the container with id 13b7e353187d29cac12b18a11d635da11ede7c55decda13c88daba688ab12b49 Jul 30 22:52:15.406166 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.406137 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6cvxh" event={"ID":"a3657dd8-410c-4550-9735-49eaca91240c","Type":"ContainerStarted","Data":"13b7e353187d29cac12b18a11d635da11ede7c55decda13c88daba688ab12b49"} Jul 30 22:52:15.420320 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.420293 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf"] Jul 30 22:52:15.436898 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.436879 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" Jul 30 22:52:15.440008 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.439807 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 30 22:52:15.440008 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.439915 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 30 22:52:15.440886 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.440846 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6tc8q\"" Jul 30 22:52:15.442944 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.442916 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf"] Jul 30 22:52:15.516215 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.516176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f65992b-d220-452f-98dc-45bf80261cee-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf\" (UID: \"6f65992b-d220-452f-98dc-45bf80261cee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" Jul 30 22:52:15.516348 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.516254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f65992b-d220-452f-98dc-45bf80261cee-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf\" (UID: \"6f65992b-d220-452f-98dc-45bf80261cee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" Jul 30 22:52:15.516348 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.516285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll86x\" (UniqueName: \"kubernetes.io/projected/6f65992b-d220-452f-98dc-45bf80261cee-kube-api-access-ll86x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf\" (UID: \"6f65992b-d220-452f-98dc-45bf80261cee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" Jul 30 22:52:15.617388 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.617361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f65992b-d220-452f-98dc-45bf80261cee-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf\" (UID: \"6f65992b-d220-452f-98dc-45bf80261cee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" Jul 30 22:52:15.617519 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.617391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll86x\" (UniqueName: \"kubernetes.io/projected/6f65992b-d220-452f-98dc-45bf80261cee-kube-api-access-ll86x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf\" (UID: \"6f65992b-d220-452f-98dc-45bf80261cee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" Jul 30 22:52:15.617519 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.617425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f65992b-d220-452f-98dc-45bf80261cee-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf\" (UID: \"6f65992b-d220-452f-98dc-45bf80261cee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" Jul 30 22:52:15.617734 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.617716 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f65992b-d220-452f-98dc-45bf80261cee-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf\" (UID: \"6f65992b-d220-452f-98dc-45bf80261cee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" Jul 30 22:52:15.617786 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.617737 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f65992b-d220-452f-98dc-45bf80261cee-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf\" (UID: \"6f65992b-d220-452f-98dc-45bf80261cee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" Jul 30 22:52:15.630988 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.630968 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll86x\" (UniqueName: \"kubernetes.io/projected/6f65992b-d220-452f-98dc-45bf80261cee-kube-api-access-ll86x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf\" (UID: \"6f65992b-d220-452f-98dc-45bf80261cee\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" Jul 30 22:52:15.748561 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.748489 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" Jul 30 22:52:15.881065 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:15.881035 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf"] Jul 30 22:52:15.883800 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:52:15.883757 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f65992b_d220_452f_98dc_45bf80261cee.slice/crio-eea30eef16711e803e8acba2ff9d9fea6c8e77374bd0c2d65c35373344cdd57b WatchSource:0}: Error finding container eea30eef16711e803e8acba2ff9d9fea6c8e77374bd0c2d65c35373344cdd57b: Status 404 returned error can't find the container with id eea30eef16711e803e8acba2ff9d9fea6c8e77374bd0c2d65c35373344cdd57b Jul 30 22:52:16.411530 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:16.411495 2576 generic.go:356] "Generic (PLEG): container finished" podID="6f65992b-d220-452f-98dc-45bf80261cee" containerID="a52ae7f1d6a2bfb169b1b1a284a878df9fc13c201cde2e5ce4eee5321941708b" exitCode=0 Jul 30 22:52:16.412009 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:16.411589 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" event={"ID":"6f65992b-d220-452f-98dc-45bf80261cee","Type":"ContainerDied","Data":"a52ae7f1d6a2bfb169b1b1a284a878df9fc13c201cde2e5ce4eee5321941708b"} Jul 30 22:52:16.412009 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:16.411640 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" event={"ID":"6f65992b-d220-452f-98dc-45bf80261cee","Type":"ContainerStarted","Data":"eea30eef16711e803e8acba2ff9d9fea6c8e77374bd0c2d65c35373344cdd57b"} Jul 30 22:52:16.846879 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:16.846789 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gg97p"] Jul 30 22:52:16.851180 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:16.851157 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gg97p" Jul 30 22:52:16.853947 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:16.853927 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5lqq2\"" Jul 30 22:52:16.861627 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:16.861604 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gg97p"] Jul 30 22:52:16.928675 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:16.928641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhwkp\" (UniqueName: \"kubernetes.io/projected/0cafa1f2-e226-438e-b159-58840640d25d-kube-api-access-xhwkp\") pod \"cert-manager-cainjector-559cdd8c87-gg97p\" (UID: \"0cafa1f2-e226-438e-b159-58840640d25d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gg97p" Jul 30 22:52:16.928841 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:16.928726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cafa1f2-e226-438e-b159-58840640d25d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gg97p\" (UID: \"0cafa1f2-e226-438e-b159-58840640d25d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gg97p" Jul 30 22:52:17.029652 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:17.029615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cafa1f2-e226-438e-b159-58840640d25d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gg97p\" (UID: \"0cafa1f2-e226-438e-b159-58840640d25d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gg97p" Jul 30 22:52:17.029824 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:17.029794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhwkp\" (UniqueName: \"kubernetes.io/projected/0cafa1f2-e226-438e-b159-58840640d25d-kube-api-access-xhwkp\") pod \"cert-manager-cainjector-559cdd8c87-gg97p\" (UID: \"0cafa1f2-e226-438e-b159-58840640d25d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gg97p" Jul 30 22:52:17.039969 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:17.039929 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cafa1f2-e226-438e-b159-58840640d25d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gg97p\" (UID: \"0cafa1f2-e226-438e-b159-58840640d25d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gg97p" Jul 30 22:52:17.040089 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:17.040052 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhwkp\" (UniqueName: \"kubernetes.io/projected/0cafa1f2-e226-438e-b159-58840640d25d-kube-api-access-xhwkp\") pod \"cert-manager-cainjector-559cdd8c87-gg97p\" (UID: \"0cafa1f2-e226-438e-b159-58840640d25d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gg97p" Jul 30 22:52:17.160536 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:17.160503 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gg97p" Jul 30 22:52:17.850035 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:17.849975 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gg97p"] Jul 30 22:52:17.852802 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:52:17.852769 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0cafa1f2_e226_438e_b159_58840640d25d.slice/crio-52173a32d338f5aa3481fb87c5b66aca2463b28a3c72b0b53b56448dd36b5aaa WatchSource:0}: Error finding container 52173a32d338f5aa3481fb87c5b66aca2463b28a3c72b0b53b56448dd36b5aaa: Status 404 returned error can't find the container with id 52173a32d338f5aa3481fb87c5b66aca2463b28a3c72b0b53b56448dd36b5aaa Jul 30 22:52:18.423103 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:18.423064 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gg97p" event={"ID":"0cafa1f2-e226-438e-b159-58840640d25d","Type":"ContainerStarted","Data":"2451cf2828dc7a385622bbcc71d26b979bbbc154179efc7b3445a203f65c068e"} Jul 30 22:52:18.423274 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:18.423117 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gg97p" event={"ID":"0cafa1f2-e226-438e-b159-58840640d25d","Type":"ContainerStarted","Data":"52173a32d338f5aa3481fb87c5b66aca2463b28a3c72b0b53b56448dd36b5aaa"} Jul 30 22:52:18.424630 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:18.424600 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6cvxh" event={"ID":"a3657dd8-410c-4550-9735-49eaca91240c","Type":"ContainerStarted","Data":"9dc7ae15b99450904214bfd0db55d9ed26795532d9596b6d1d3fef1553202a21"} Jul 30 22:52:18.424744 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:18.424654 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6cvxh" Jul 30 22:52:18.438965 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:18.438914 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gg97p" podStartSLOduration=2.438898041 podStartE2EDuration="2.438898041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:52:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:52:18.437254556 +0000 UTC m=+265.641073790" watchObservedRunningTime="2026-07-30 22:52:18.438898041 +0000 UTC m=+265.642717275" Jul 30 22:52:18.460331 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:18.460273 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-6cvxh" podStartSLOduration=1.7089530929999999 podStartE2EDuration="4.460252502s" totalImagesPullingTime="2.751299409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:52:18.45897811 +0000 UTC m=+265.662797347" watchObservedRunningTime="2026-07-30 22:52:18.460252502 +0000 UTC m=+265.664071750" Jul 30 22:52:19.429624 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:19.429538 2576 generic.go:356] "Generic (PLEG): container finished" podID="6f65992b-d220-452f-98dc-45bf80261cee" containerID="64a2830a1430bc835e2a32422c39a131b8e2d93a8629af751fe3d7968329e9df" exitCode=0 Jul 30 22:52:19.430023 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:19.429630 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" event={"ID":"6f65992b-d220-452f-98dc-45bf80261cee","Type":"ContainerDied","Data":"64a2830a1430bc835e2a32422c39a131b8e2d93a8629af751fe3d7968329e9df"} Jul 30 22:52:20.437993 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:20.437959 2576 generic.go:356] "Generic (PLEG): container finished" podID="6f65992b-d220-452f-98dc-45bf80261cee" containerID="b233315230ea8eb3e5d7fba546c7f6a30a66931d2f9ad6924c9e2fc46c0919eb" exitCode=0 Jul 30 22:52:20.438450 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:20.438046 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" event={"ID":"6f65992b-d220-452f-98dc-45bf80261cee","Type":"ContainerDied","Data":"b233315230ea8eb3e5d7fba546c7f6a30a66931d2f9ad6924c9e2fc46c0919eb"} Jul 30 22:52:21.561801 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:21.561776 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" Jul 30 22:52:21.667964 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:21.667934 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll86x\" (UniqueName: \"kubernetes.io/projected/6f65992b-d220-452f-98dc-45bf80261cee-kube-api-access-ll86x\") pod \"6f65992b-d220-452f-98dc-45bf80261cee\" (UID: \"6f65992b-d220-452f-98dc-45bf80261cee\") " Jul 30 22:52:21.668154 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:21.668064 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f65992b-d220-452f-98dc-45bf80261cee-bundle\") pod \"6f65992b-d220-452f-98dc-45bf80261cee\" (UID: \"6f65992b-d220-452f-98dc-45bf80261cee\") " Jul 30 22:52:21.668154 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:21.668112 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f65992b-d220-452f-98dc-45bf80261cee-util\") pod \"6f65992b-d220-452f-98dc-45bf80261cee\" (UID: \"6f65992b-d220-452f-98dc-45bf80261cee\") " Jul 30 22:52:21.668473 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:21.668435 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f65992b-d220-452f-98dc-45bf80261cee-bundle" (OuterVolumeSpecName: "bundle") pod "6f65992b-d220-452f-98dc-45bf80261cee" (UID: "6f65992b-d220-452f-98dc-45bf80261cee"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:52:21.670061 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:21.670039 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f65992b-d220-452f-98dc-45bf80261cee-kube-api-access-ll86x" (OuterVolumeSpecName: "kube-api-access-ll86x") pod "6f65992b-d220-452f-98dc-45bf80261cee" (UID: "6f65992b-d220-452f-98dc-45bf80261cee"). InnerVolumeSpecName "kube-api-access-ll86x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 22:52:21.673574 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:21.673530 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f65992b-d220-452f-98dc-45bf80261cee-util" (OuterVolumeSpecName: "util") pod "6f65992b-d220-452f-98dc-45bf80261cee" (UID: "6f65992b-d220-452f-98dc-45bf80261cee"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:52:21.769637 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:21.769556 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f65992b-d220-452f-98dc-45bf80261cee-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:52:21.769637 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:21.769586 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f65992b-d220-452f-98dc-45bf80261cee-util\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:52:21.769637 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:21.769596 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll86x\" (UniqueName: \"kubernetes.io/projected/6f65992b-d220-452f-98dc-45bf80261cee-kube-api-access-ll86x\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:52:22.447575 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:22.447547 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" Jul 30 22:52:22.447575 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:22.447562 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f4m9wf" event={"ID":"6f65992b-d220-452f-98dc-45bf80261cee","Type":"ContainerDied","Data":"eea30eef16711e803e8acba2ff9d9fea6c8e77374bd0c2d65c35373344cdd57b"} Jul 30 22:52:22.447813 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:22.447608 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eea30eef16711e803e8acba2ff9d9fea6c8e77374bd0c2d65c35373344cdd57b" Jul 30 22:52:24.432752 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:24.432721 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6cvxh" Jul 30 22:52:28.119249 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.119216 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xk5x2"] Jul 30 22:52:28.119634 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.119487 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f65992b-d220-452f-98dc-45bf80261cee" containerName="pull" Jul 30 22:52:28.119634 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.119498 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f65992b-d220-452f-98dc-45bf80261cee" containerName="pull" Jul 30 22:52:28.119634 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.119514 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f65992b-d220-452f-98dc-45bf80261cee" containerName="extract" Jul 30 22:52:28.119634 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.119519 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f65992b-d220-452f-98dc-45bf80261cee" containerName="extract" Jul 30 22:52:28.119634 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.119529 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f65992b-d220-452f-98dc-45bf80261cee" containerName="util" Jul 30 22:52:28.119634 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.119534 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f65992b-d220-452f-98dc-45bf80261cee" containerName="util" Jul 30 22:52:28.119634 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.119578 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f65992b-d220-452f-98dc-45bf80261cee" containerName="extract" Jul 30 22:52:28.122583 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.122564 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xk5x2" Jul 30 22:52:28.125156 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.125131 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 30 22:52:28.126150 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.126129 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 30 22:52:28.126271 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.126136 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vc4hp\"" Jul 30 22:52:28.132532 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.132509 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xk5x2"] Jul 30 22:52:28.220587 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.220554 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9bb6b0a-b522-4e83-9dc2-b98328ec356b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xk5x2\" (UID: \"b9bb6b0a-b522-4e83-9dc2-b98328ec356b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xk5x2" Jul 30 22:52:28.220760 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.220594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db7gl\" (UniqueName: \"kubernetes.io/projected/b9bb6b0a-b522-4e83-9dc2-b98328ec356b-kube-api-access-db7gl\") pod \"openshift-lws-operator-fd8ccff4c-xk5x2\" (UID: \"b9bb6b0a-b522-4e83-9dc2-b98328ec356b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xk5x2" Jul 30 22:52:28.321880 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.321820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9bb6b0a-b522-4e83-9dc2-b98328ec356b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xk5x2\" (UID: \"b9bb6b0a-b522-4e83-9dc2-b98328ec356b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xk5x2" Jul 30 22:52:28.322063 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.321898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db7gl\" (UniqueName: \"kubernetes.io/projected/b9bb6b0a-b522-4e83-9dc2-b98328ec356b-kube-api-access-db7gl\") pod \"openshift-lws-operator-fd8ccff4c-xk5x2\" (UID: \"b9bb6b0a-b522-4e83-9dc2-b98328ec356b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xk5x2" Jul 30 22:52:28.322275 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.322255 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9bb6b0a-b522-4e83-9dc2-b98328ec356b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xk5x2\" (UID: \"b9bb6b0a-b522-4e83-9dc2-b98328ec356b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xk5x2" Jul 30 22:52:28.329421 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.329390 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db7gl\" (UniqueName: \"kubernetes.io/projected/b9bb6b0a-b522-4e83-9dc2-b98328ec356b-kube-api-access-db7gl\") pod \"openshift-lws-operator-fd8ccff4c-xk5x2\" (UID: \"b9bb6b0a-b522-4e83-9dc2-b98328ec356b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xk5x2" Jul 30 22:52:28.431545 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.431512 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xk5x2" Jul 30 22:52:28.557183 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:28.557158 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xk5x2"] Jul 30 22:52:28.559884 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:52:28.559844 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9bb6b0a_b522_4e83_9dc2_b98328ec356b.slice/crio-76334a8dcb9d88ba00d8917caf3a7c5a2226ee3977fd56c9fc78c744830158a3 WatchSource:0}: Error finding container 76334a8dcb9d88ba00d8917caf3a7c5a2226ee3977fd56c9fc78c744830158a3: Status 404 returned error can't find the container with id 76334a8dcb9d88ba00d8917caf3a7c5a2226ee3977fd56c9fc78c744830158a3 Jul 30 22:52:29.479651 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:29.479613 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xk5x2" event={"ID":"b9bb6b0a-b522-4e83-9dc2-b98328ec356b","Type":"ContainerStarted","Data":"76334a8dcb9d88ba00d8917caf3a7c5a2226ee3977fd56c9fc78c744830158a3"} Jul 30 22:52:30.487112 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:30.487071 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xk5x2" event={"ID":"b9bb6b0a-b522-4e83-9dc2-b98328ec356b","Type":"ContainerStarted","Data":"cdd4c3d1e75c4b463b4337598f4c6493368fb306dd1acd2205f83583a14be59d"} Jul 30 22:52:30.504352 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:30.504297 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xk5x2" podStartSLOduration=0.682748889 podStartE2EDuration="2.504276254s" totalImagesPullingTime="1.821527365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:52:30.501925329 +0000 UTC m=+277.705744582" watchObservedRunningTime="2026-07-30 22:52:30.504276254 +0000 UTC m=+277.708095489" Jul 30 22:52:36.167280 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:36.167240 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q"] Jul 30 22:52:36.171875 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:36.171842 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" Jul 30 22:52:36.174461 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:36.174440 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 30 22:52:36.174553 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:36.174443 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 30 22:52:36.175492 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:36.175479 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6tc8q\"" Jul 30 22:52:36.178015 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:36.177991 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q"] Jul 30 22:52:36.286230 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:36.286199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48b071ee-28d0-453f-b532-1ad29d969de4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q\" (UID: \"48b071ee-28d0-453f-b532-1ad29d969de4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" Jul 30 22:52:36.286414 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:36.286253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48b071ee-28d0-453f-b532-1ad29d969de4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q\" (UID: \"48b071ee-28d0-453f-b532-1ad29d969de4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" Jul 30 22:52:36.286414 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:36.286287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqjpk\" (UniqueName: \"kubernetes.io/projected/48b071ee-28d0-453f-b532-1ad29d969de4-kube-api-access-cqjpk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q\" (UID: \"48b071ee-28d0-453f-b532-1ad29d969de4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" Jul 30 22:52:36.386660 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:36.386623 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48b071ee-28d0-453f-b532-1ad29d969de4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q\" (UID: \"48b071ee-28d0-453f-b532-1ad29d969de4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" Jul 30 22:52:36.386842 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:36.386682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48b071ee-28d0-453f-b532-1ad29d969de4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q\" (UID: \"48b071ee-28d0-453f-b532-1ad29d969de4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" Jul 30 22:52:36.386842 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:36.386715 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqjpk\" (UniqueName: \"kubernetes.io/projected/48b071ee-28d0-453f-b532-1ad29d969de4-kube-api-access-cqjpk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q\" (UID: \"48b071ee-28d0-453f-b532-1ad29d969de4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" Jul 30 22:52:36.387116 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:36.387092 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48b071ee-28d0-453f-b532-1ad29d969de4-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q\" (UID: \"48b071ee-28d0-453f-b532-1ad29d969de4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" Jul 30 22:52:36.387185 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:36.387103 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48b071ee-28d0-453f-b532-1ad29d969de4-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q\" (UID: \"48b071ee-28d0-453f-b532-1ad29d969de4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" Jul 30 22:52:36.395807 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:36.395784 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqjpk\" (UniqueName: \"kubernetes.io/projected/48b071ee-28d0-453f-b532-1ad29d969de4-kube-api-access-cqjpk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q\" (UID: \"48b071ee-28d0-453f-b532-1ad29d969de4\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" Jul 30 22:52:36.482400 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:36.482325 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" Jul 30 22:52:36.631300 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:36.631271 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q"] Jul 30 22:52:36.633666 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:52:36.633644 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b071ee_28d0_453f_b532_1ad29d969de4.slice/crio-3aa6987912f5c0589a3bdcc7b655ae6315567ffdb6a6c9a618e2170f8baece03 WatchSource:0}: Error finding container 3aa6987912f5c0589a3bdcc7b655ae6315567ffdb6a6c9a618e2170f8baece03: Status 404 returned error can't find the container with id 3aa6987912f5c0589a3bdcc7b655ae6315567ffdb6a6c9a618e2170f8baece03 Jul 30 22:52:37.517779 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:37.517745 2576 generic.go:356] "Generic (PLEG): container finished" podID="48b071ee-28d0-453f-b532-1ad29d969de4" containerID="a1c2436a3c11d41fc71efa6fac0e05b7f721e5d669e679a92c7a6f7231375437" exitCode=0 Jul 30 22:52:37.518192 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:37.517833 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" event={"ID":"48b071ee-28d0-453f-b532-1ad29d969de4","Type":"ContainerDied","Data":"a1c2436a3c11d41fc71efa6fac0e05b7f721e5d669e679a92c7a6f7231375437"} Jul 30 22:52:37.518192 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:37.517901 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" event={"ID":"48b071ee-28d0-453f-b532-1ad29d969de4","Type":"ContainerStarted","Data":"3aa6987912f5c0589a3bdcc7b655ae6315567ffdb6a6c9a618e2170f8baece03"} Jul 30 22:52:38.524128 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:38.524092 2576 generic.go:356] "Generic (PLEG): container finished" podID="48b071ee-28d0-453f-b532-1ad29d969de4" containerID="1b2dac1b0b3c3213c68aec11ab059d20124d8f695d34ae6e0d48d8668aa0fed6" exitCode=0 Jul 30 22:52:38.524495 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:38.524174 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" event={"ID":"48b071ee-28d0-453f-b532-1ad29d969de4","Type":"ContainerDied","Data":"1b2dac1b0b3c3213c68aec11ab059d20124d8f695d34ae6e0d48d8668aa0fed6"} Jul 30 22:52:39.530546 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:39.530515 2576 generic.go:356] "Generic (PLEG): container finished" podID="48b071ee-28d0-453f-b532-1ad29d969de4" containerID="605b114e038610c4a1d5a28c35ebecf824d3922a1fe861a54a893fb6412023ce" exitCode=0 Jul 30 22:52:39.530945 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:39.530625 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" event={"ID":"48b071ee-28d0-453f-b532-1ad29d969de4","Type":"ContainerDied","Data":"605b114e038610c4a1d5a28c35ebecf824d3922a1fe861a54a893fb6412023ce"} Jul 30 22:52:40.662087 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:40.662061 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" Jul 30 22:52:40.719047 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:40.719017 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48b071ee-28d0-453f-b532-1ad29d969de4-util\") pod \"48b071ee-28d0-453f-b532-1ad29d969de4\" (UID: \"48b071ee-28d0-453f-b532-1ad29d969de4\") " Jul 30 22:52:40.719200 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:40.719061 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48b071ee-28d0-453f-b532-1ad29d969de4-bundle\") pod \"48b071ee-28d0-453f-b532-1ad29d969de4\" (UID: \"48b071ee-28d0-453f-b532-1ad29d969de4\") " Jul 30 22:52:40.719200 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:40.719100 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqjpk\" (UniqueName: \"kubernetes.io/projected/48b071ee-28d0-453f-b532-1ad29d969de4-kube-api-access-cqjpk\") pod \"48b071ee-28d0-453f-b532-1ad29d969de4\" (UID: \"48b071ee-28d0-453f-b532-1ad29d969de4\") " Jul 30 22:52:40.719743 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:40.719717 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48b071ee-28d0-453f-b532-1ad29d969de4-bundle" (OuterVolumeSpecName: "bundle") pod "48b071ee-28d0-453f-b532-1ad29d969de4" (UID: "48b071ee-28d0-453f-b532-1ad29d969de4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:52:40.721162 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:40.721136 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48b071ee-28d0-453f-b532-1ad29d969de4-kube-api-access-cqjpk" (OuterVolumeSpecName: "kube-api-access-cqjpk") pod "48b071ee-28d0-453f-b532-1ad29d969de4" (UID: "48b071ee-28d0-453f-b532-1ad29d969de4"). InnerVolumeSpecName "kube-api-access-cqjpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 22:52:40.724846 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:40.724728 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48b071ee-28d0-453f-b532-1ad29d969de4-util" (OuterVolumeSpecName: "util") pod "48b071ee-28d0-453f-b532-1ad29d969de4" (UID: "48b071ee-28d0-453f-b532-1ad29d969de4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:52:40.820135 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:40.820049 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/48b071ee-28d0-453f-b532-1ad29d969de4-util\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:52:40.820135 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:40.820085 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/48b071ee-28d0-453f-b532-1ad29d969de4-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:52:40.820135 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:40.820096 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqjpk\" (UniqueName: \"kubernetes.io/projected/48b071ee-28d0-453f-b532-1ad29d969de4-kube-api-access-cqjpk\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:52:41.541015 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:41.540942 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" Jul 30 22:52:41.541149 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:41.540948 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8n54q" event={"ID":"48b071ee-28d0-453f-b532-1ad29d969de4","Type":"ContainerDied","Data":"3aa6987912f5c0589a3bdcc7b655ae6315567ffdb6a6c9a618e2170f8baece03"} Jul 30 22:52:41.541149 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:41.541052 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3aa6987912f5c0589a3bdcc7b655ae6315567ffdb6a6c9a618e2170f8baece03" Jul 30 22:52:48.648660 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.648622 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph"] Jul 30 22:52:48.649122 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.649040 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b071ee-28d0-453f-b532-1ad29d969de4" containerName="util" Jul 30 22:52:48.649122 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.649057 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b071ee-28d0-453f-b532-1ad29d969de4" containerName="util" Jul 30 22:52:48.649122 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.649069 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b071ee-28d0-453f-b532-1ad29d969de4" containerName="pull" Jul 30 22:52:48.649122 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.649076 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b071ee-28d0-453f-b532-1ad29d969de4" containerName="pull" Jul 30 22:52:48.649122 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.649089 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b071ee-28d0-453f-b532-1ad29d969de4" containerName="extract" Jul 30 22:52:48.649122 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.649096 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b071ee-28d0-453f-b532-1ad29d969de4" containerName="extract" Jul 30 22:52:48.649435 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.649184 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="48b071ee-28d0-453f-b532-1ad29d969de4" containerName="extract" Jul 30 22:52:48.651424 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.651405 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:48.654469 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.654447 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 30 22:52:48.654469 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.654466 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 30 22:52:48.654776 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.654760 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 30 22:52:48.654831 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.654792 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rmz5j\"" Jul 30 22:52:48.654831 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.654809 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 30 22:52:48.666444 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.666425 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph"] Jul 30 22:52:48.676769 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.676749 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9280869d-ea5f-4723-aba9-cbc6ddce34f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c6bb66584-b6zph\" (UID: \"9280869d-ea5f-4723-aba9-cbc6ddce34f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:48.676879 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.676814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9280869d-ea5f-4723-aba9-cbc6ddce34f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c6bb66584-b6zph\" (UID: \"9280869d-ea5f-4723-aba9-cbc6ddce34f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:48.676879 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.676852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9280869d-ea5f-4723-aba9-cbc6ddce34f7-manifests\") pod \"opendatahub-operator-controller-manager-5c6bb66584-b6zph\" (UID: \"9280869d-ea5f-4723-aba9-cbc6ddce34f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:48.676971 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.676896 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8ck2\" (UniqueName: \"kubernetes.io/projected/9280869d-ea5f-4723-aba9-cbc6ddce34f7-kube-api-access-k8ck2\") pod \"opendatahub-operator-controller-manager-5c6bb66584-b6zph\" (UID: \"9280869d-ea5f-4723-aba9-cbc6ddce34f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:48.676971 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.676920 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9280869d-ea5f-4723-aba9-cbc6ddce34f7-tmp\") pod \"opendatahub-operator-controller-manager-5c6bb66584-b6zph\" (UID: \"9280869d-ea5f-4723-aba9-cbc6ddce34f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:48.778120 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.778095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9280869d-ea5f-4723-aba9-cbc6ddce34f7-manifests\") pod \"opendatahub-operator-controller-manager-5c6bb66584-b6zph\" (UID: \"9280869d-ea5f-4723-aba9-cbc6ddce34f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:48.778264 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.778125 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8ck2\" (UniqueName: \"kubernetes.io/projected/9280869d-ea5f-4723-aba9-cbc6ddce34f7-kube-api-access-k8ck2\") pod \"opendatahub-operator-controller-manager-5c6bb66584-b6zph\" (UID: \"9280869d-ea5f-4723-aba9-cbc6ddce34f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:48.778264 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.778145 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9280869d-ea5f-4723-aba9-cbc6ddce34f7-tmp\") pod \"opendatahub-operator-controller-manager-5c6bb66584-b6zph\" (UID: \"9280869d-ea5f-4723-aba9-cbc6ddce34f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:48.778264 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.778166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9280869d-ea5f-4723-aba9-cbc6ddce34f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c6bb66584-b6zph\" (UID: \"9280869d-ea5f-4723-aba9-cbc6ddce34f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:48.778264 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.778216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9280869d-ea5f-4723-aba9-cbc6ddce34f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c6bb66584-b6zph\" (UID: \"9280869d-ea5f-4723-aba9-cbc6ddce34f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:48.778487 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.778464 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9280869d-ea5f-4723-aba9-cbc6ddce34f7-manifests\") pod \"opendatahub-operator-controller-manager-5c6bb66584-b6zph\" (UID: \"9280869d-ea5f-4723-aba9-cbc6ddce34f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:48.780417 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.780387 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9280869d-ea5f-4723-aba9-cbc6ddce34f7-tmp\") pod \"opendatahub-operator-controller-manager-5c6bb66584-b6zph\" (UID: \"9280869d-ea5f-4723-aba9-cbc6ddce34f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:48.780678 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.780659 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9280869d-ea5f-4723-aba9-cbc6ddce34f7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c6bb66584-b6zph\" (UID: \"9280869d-ea5f-4723-aba9-cbc6ddce34f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:48.780739 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.780679 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9280869d-ea5f-4723-aba9-cbc6ddce34f7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c6bb66584-b6zph\" (UID: \"9280869d-ea5f-4723-aba9-cbc6ddce34f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:48.789616 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.789596 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8ck2\" (UniqueName: \"kubernetes.io/projected/9280869d-ea5f-4723-aba9-cbc6ddce34f7-kube-api-access-k8ck2\") pod \"opendatahub-operator-controller-manager-5c6bb66584-b6zph\" (UID: \"9280869d-ea5f-4723-aba9-cbc6ddce34f7\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:48.961451 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:48.961387 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:49.092559 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:49.092536 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph"] Jul 30 22:52:49.095019 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:52:49.094988 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9280869d_ea5f_4723_aba9_cbc6ddce34f7.slice/crio-644d71f0a1a57d266d847c0be1d52697eb1d26d71d239d321c8d07c487b52c05 WatchSource:0}: Error finding container 644d71f0a1a57d266d847c0be1d52697eb1d26d71d239d321c8d07c487b52c05: Status 404 returned error can't find the container with id 644d71f0a1a57d266d847c0be1d52697eb1d26d71d239d321c8d07c487b52c05 Jul 30 22:52:49.574812 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:49.574775 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" event={"ID":"9280869d-ea5f-4723-aba9-cbc6ddce34f7","Type":"ContainerStarted","Data":"644d71f0a1a57d266d847c0be1d52697eb1d26d71d239d321c8d07c487b52c05"} Jul 30 22:52:52.592111 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:52.592076 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" event={"ID":"9280869d-ea5f-4723-aba9-cbc6ddce34f7","Type":"ContainerStarted","Data":"7762057cc03164b96d2553d354b798314185db807dee4cf573baf4bb90c39041"} Jul 30 22:52:53.110567 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:53.110542 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 22:52:53.112508 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:53.112490 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 22:52:53.118048 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:53.117978 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 30 22:52:53.597958 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:53.597919 2576 generic.go:356] "Generic (PLEG): container finished" podID="9280869d-ea5f-4723-aba9-cbc6ddce34f7" containerID="7762057cc03164b96d2553d354b798314185db807dee4cf573baf4bb90c39041" exitCode=0 Jul 30 22:52:53.600351 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:53.598002 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" event={"ID":"9280869d-ea5f-4723-aba9-cbc6ddce34f7","Type":"ContainerDied","Data":"7762057cc03164b96d2553d354b798314185db807dee4cf573baf4bb90c39041"} Jul 30 22:52:54.604532 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:54.604498 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" event={"ID":"9280869d-ea5f-4723-aba9-cbc6ddce34f7","Type":"ContainerStarted","Data":"3da4f9e650c718f31c29ce1274e9a538c4221169c0787632f28c3df75b0142c6"} Jul 30 22:52:54.604956 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:54.604603 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:52:54.625015 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:52:54.624966 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" podStartSLOduration=2.26381582 podStartE2EDuration="6.624951755s" totalImagesPullingTime="3.365104283s" totalInitContainerRuntime="996.031652ms" isStatefulPod=false podCreationTimestamp="2026-07-30 22:52:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:52:54.62269343 +0000 UTC m=+301.826512693" watchObservedRunningTime="2026-07-30 22:52:54.624951755 +0000 UTC m=+301.828771062" Jul 30 22:53:05.611417 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:05.611381 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-b6zph" Jul 30 22:53:06.295837 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.295802 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv"] Jul 30 22:53:06.306062 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.306040 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" Jul 30 22:53:06.306184 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.306078 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv"] Jul 30 22:53:06.308411 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.308390 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-clkv5\"" Jul 30 22:53:06.308535 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.308395 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 30 22:53:06.309366 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.309347 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 30 22:53:06.309556 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.309540 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 30 22:53:06.422153 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.422118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c5424165-20ba-4f37-848e-f2085c461bef-manager-config\") pod \"lws-controller-manager-78d44f567c-lcdtv\" (UID: \"c5424165-20ba-4f37-848e-f2085c461bef\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" Jul 30 22:53:06.422324 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.422168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5424165-20ba-4f37-848e-f2085c461bef-cert\") pod \"lws-controller-manager-78d44f567c-lcdtv\" (UID: \"c5424165-20ba-4f37-848e-f2085c461bef\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" Jul 30 22:53:06.422324 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.422197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c5424165-20ba-4f37-848e-f2085c461bef-metrics-cert\") pod \"lws-controller-manager-78d44f567c-lcdtv\" (UID: \"c5424165-20ba-4f37-848e-f2085c461bef\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" Jul 30 22:53:06.422324 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.422255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvcdw\" (UniqueName: \"kubernetes.io/projected/c5424165-20ba-4f37-848e-f2085c461bef-kube-api-access-cvcdw\") pod \"lws-controller-manager-78d44f567c-lcdtv\" (UID: \"c5424165-20ba-4f37-848e-f2085c461bef\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" Jul 30 22:53:06.523592 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.523558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c5424165-20ba-4f37-848e-f2085c461bef-manager-config\") pod \"lws-controller-manager-78d44f567c-lcdtv\" (UID: \"c5424165-20ba-4f37-848e-f2085c461bef\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" Jul 30 22:53:06.523757 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.523603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5424165-20ba-4f37-848e-f2085c461bef-cert\") pod \"lws-controller-manager-78d44f567c-lcdtv\" (UID: \"c5424165-20ba-4f37-848e-f2085c461bef\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" Jul 30 22:53:06.523757 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.523623 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c5424165-20ba-4f37-848e-f2085c461bef-metrics-cert\") pod \"lws-controller-manager-78d44f567c-lcdtv\" (UID: \"c5424165-20ba-4f37-848e-f2085c461bef\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" Jul 30 22:53:06.523757 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.523666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvcdw\" (UniqueName: \"kubernetes.io/projected/c5424165-20ba-4f37-848e-f2085c461bef-kube-api-access-cvcdw\") pod \"lws-controller-manager-78d44f567c-lcdtv\" (UID: \"c5424165-20ba-4f37-848e-f2085c461bef\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" Jul 30 22:53:06.524299 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.524279 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c5424165-20ba-4f37-848e-f2085c461bef-manager-config\") pod \"lws-controller-manager-78d44f567c-lcdtv\" (UID: \"c5424165-20ba-4f37-848e-f2085c461bef\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" Jul 30 22:53:06.526103 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.526081 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5424165-20ba-4f37-848e-f2085c461bef-cert\") pod \"lws-controller-manager-78d44f567c-lcdtv\" (UID: \"c5424165-20ba-4f37-848e-f2085c461bef\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" Jul 30 22:53:06.526207 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.526135 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c5424165-20ba-4f37-848e-f2085c461bef-metrics-cert\") pod \"lws-controller-manager-78d44f567c-lcdtv\" (UID: \"c5424165-20ba-4f37-848e-f2085c461bef\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" Jul 30 22:53:06.537453 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.537429 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvcdw\" (UniqueName: \"kubernetes.io/projected/c5424165-20ba-4f37-848e-f2085c461bef-kube-api-access-cvcdw\") pod \"lws-controller-manager-78d44f567c-lcdtv\" (UID: \"c5424165-20ba-4f37-848e-f2085c461bef\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" Jul 30 22:53:06.615832 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.615758 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" Jul 30 22:53:06.741929 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.741872 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv"] Jul 30 22:53:06.743945 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:53:06.743921 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5424165_20ba_4f37_848e_f2085c461bef.slice/crio-59779192d81499a86d115836504c642c3fb2ddbdadb3ac924eadfa8f45023e63 WatchSource:0}: Error finding container 59779192d81499a86d115836504c642c3fb2ddbdadb3ac924eadfa8f45023e63: Status 404 returned error can't find the container with id 59779192d81499a86d115836504c642c3fb2ddbdadb3ac924eadfa8f45023e63 Jul 30 22:53:06.745760 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:06.745739 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 22:53:07.658635 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:07.658603 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" event={"ID":"c5424165-20ba-4f37-848e-f2085c461bef","Type":"ContainerStarted","Data":"59779192d81499a86d115836504c642c3fb2ddbdadb3ac924eadfa8f45023e63"} Jul 30 22:53:09.668988 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:09.668954 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" event={"ID":"c5424165-20ba-4f37-848e-f2085c461bef","Type":"ContainerStarted","Data":"06a9ee336eaf138c84ea8b7087ec333a777a334230f585fdbe6f44bea702419c"} Jul 30 22:53:09.669399 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:09.669047 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" Jul 30 22:53:09.686151 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:09.686104 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" podStartSLOduration=1.7462044589999999 podStartE2EDuration="3.686088658s" totalImagesPullingTime="1.939884199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:53:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:53:09.684998918 +0000 UTC m=+316.888818164" watchObservedRunningTime="2026-07-30 22:53:09.686088658 +0000 UTC m=+316.889907893" Jul 30 22:53:09.896727 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:09.896694 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-swlkn"] Jul 30 22:53:09.899942 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:09.899927 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-swlkn" Jul 30 22:53:09.902484 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:09.902462 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 30 22:53:09.902810 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:09.902793 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-r45mx\"" Jul 30 22:53:09.909012 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:09.908989 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-swlkn"] Jul 30 22:53:09.953789 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:09.953718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qmzl\" (UniqueName: \"kubernetes.io/projected/d62069f4-023c-41ae-addc-b92d44b1849b-kube-api-access-6qmzl\") pod \"model-serving-api-54d89bd5fc-swlkn\" (UID: \"d62069f4-023c-41ae-addc-b92d44b1849b\") " pod="opendatahub/model-serving-api-54d89bd5fc-swlkn" Jul 30 22:53:09.953789 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:09.953786 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d62069f4-023c-41ae-addc-b92d44b1849b-tls-certs\") pod \"model-serving-api-54d89bd5fc-swlkn\" (UID: \"d62069f4-023c-41ae-addc-b92d44b1849b\") " pod="opendatahub/model-serving-api-54d89bd5fc-swlkn" Jul 30 22:53:10.054911 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:10.054853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qmzl\" (UniqueName: \"kubernetes.io/projected/d62069f4-023c-41ae-addc-b92d44b1849b-kube-api-access-6qmzl\") pod \"model-serving-api-54d89bd5fc-swlkn\" (UID: \"d62069f4-023c-41ae-addc-b92d44b1849b\") " pod="opendatahub/model-serving-api-54d89bd5fc-swlkn" Jul 30 22:53:10.055072 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:10.054947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d62069f4-023c-41ae-addc-b92d44b1849b-tls-certs\") pod \"model-serving-api-54d89bd5fc-swlkn\" (UID: \"d62069f4-023c-41ae-addc-b92d44b1849b\") " pod="opendatahub/model-serving-api-54d89bd5fc-swlkn" Jul 30 22:53:10.055072 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:53:10.055047 2576 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 30 22:53:10.055143 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:53:10.055102 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62069f4-023c-41ae-addc-b92d44b1849b-tls-certs podName:d62069f4-023c-41ae-addc-b92d44b1849b nodeName:}" failed. No retries permitted until 2026-07-30 22:53:10.555086269 +0000 UTC m=+317.758905481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d62069f4-023c-41ae-addc-b92d44b1849b-tls-certs") pod "model-serving-api-54d89bd5fc-swlkn" (UID: "d62069f4-023c-41ae-addc-b92d44b1849b") : secret "model-serving-api-tls" not found Jul 30 22:53:10.064782 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:10.064755 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qmzl\" (UniqueName: \"kubernetes.io/projected/d62069f4-023c-41ae-addc-b92d44b1849b-kube-api-access-6qmzl\") pod \"model-serving-api-54d89bd5fc-swlkn\" (UID: \"d62069f4-023c-41ae-addc-b92d44b1849b\") " pod="opendatahub/model-serving-api-54d89bd5fc-swlkn" Jul 30 22:53:10.559259 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:10.559225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d62069f4-023c-41ae-addc-b92d44b1849b-tls-certs\") pod \"model-serving-api-54d89bd5fc-swlkn\" (UID: \"d62069f4-023c-41ae-addc-b92d44b1849b\") " pod="opendatahub/model-serving-api-54d89bd5fc-swlkn" Jul 30 22:53:10.561595 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:10.561560 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d62069f4-023c-41ae-addc-b92d44b1849b-tls-certs\") pod \"model-serving-api-54d89bd5fc-swlkn\" (UID: \"d62069f4-023c-41ae-addc-b92d44b1849b\") " pod="opendatahub/model-serving-api-54d89bd5fc-swlkn" Jul 30 22:53:10.810970 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:10.810853 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-swlkn" Jul 30 22:53:10.946165 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:10.946133 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-swlkn"] Jul 30 22:53:10.947181 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:53:10.947156 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62069f4_023c_41ae_addc_b92d44b1849b.slice/crio-082d0d73f612bc8b01cef69ba2d189cc48054184ba3e4c22131207f0b4995f43 WatchSource:0}: Error finding container 082d0d73f612bc8b01cef69ba2d189cc48054184ba3e4c22131207f0b4995f43: Status 404 returned error can't find the container with id 082d0d73f612bc8b01cef69ba2d189cc48054184ba3e4c22131207f0b4995f43 Jul 30 22:53:11.681339 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:11.681305 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-swlkn" event={"ID":"d62069f4-023c-41ae-addc-b92d44b1849b","Type":"ContainerStarted","Data":"082d0d73f612bc8b01cef69ba2d189cc48054184ba3e4c22131207f0b4995f43"} Jul 30 22:53:12.687223 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:12.687188 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-swlkn" event={"ID":"d62069f4-023c-41ae-addc-b92d44b1849b","Type":"ContainerStarted","Data":"3290f430815ad8db65ac6250e25e03ac511119bf48f500155dafdba106fc0c0f"} Jul 30 22:53:12.687683 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:12.687303 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-swlkn" Jul 30 22:53:12.702005 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:12.701797 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-swlkn" podStartSLOduration=2.13013275 podStartE2EDuration="3.701778923s" totalImagesPullingTime="1.571646173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:53:12.701411638 +0000 UTC m=+319.905230873" watchObservedRunningTime="2026-07-30 22:53:12.701778923 +0000 UTC m=+319.905598157" Jul 30 22:53:15.256188 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.256139 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw"] Jul 30 22:53:15.259792 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.259771 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.262462 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.262435 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 30 22:53:15.262462 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.262435 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 30 22:53:15.262617 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.262473 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-tg675\"" Jul 30 22:53:15.262617 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.262508 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 30 22:53:15.267877 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.267839 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw"] Jul 30 22:53:15.349759 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.349722 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz"] Jul 30 22:53:15.353427 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.353404 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.366642 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.366618 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz"] Jul 30 22:53:15.400637 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.400610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.400788 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.400647 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.400788 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.400720 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.400788 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.400761 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.400950 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.400794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.400950 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.400813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.400950 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.400834 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pstb\" (UniqueName: \"kubernetes.io/projected/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-kube-api-access-9pstb\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.400950 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.400917 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.401104 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.400970 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.501543 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.501509 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.501695 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.501551 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12461584-a631-45e0-bbb8-9ee438e01758-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.501695 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.501663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.501809 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.501697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12461584-a631-45e0-bbb8-9ee438e01758-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.501809 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.501724 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pstb\" (UniqueName: \"kubernetes.io/projected/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-kube-api-access-9pstb\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.501809 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.501740 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12461584-a631-45e0-bbb8-9ee438e01758-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.501809 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.501782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12461584-a631-45e0-bbb8-9ee438e01758-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.502043 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.501908 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.502043 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.501923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.502043 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.501972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.502043 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.502000 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.502043 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.502020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12461584-a631-45e0-bbb8-9ee438e01758-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.502043 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.502039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12461584-a631-45e0-bbb8-9ee438e01758-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.502399 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.502063 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12461584-a631-45e0-bbb8-9ee438e01758-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.502399 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.502091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.502399 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.502137 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12461584-a631-45e0-bbb8-9ee438e01758-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.502399 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.502221 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.502399 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.502251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.502399 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.502268 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmdvj\" (UniqueName: \"kubernetes.io/projected/12461584-a631-45e0-bbb8-9ee438e01758-kube-api-access-lmdvj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.502399 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.502322 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.502754 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.502566 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.502754 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.502589 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.502754 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.502629 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.503916 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.503897 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.504190 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.504174 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.509369 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.509318 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.509459 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.509440 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pstb\" (UniqueName: \"kubernetes.io/projected/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-kube-api-access-9pstb\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bclnqnw\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.571126 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.571102 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:15.603167 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.603141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12461584-a631-45e0-bbb8-9ee438e01758-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.603288 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.603175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12461584-a631-45e0-bbb8-9ee438e01758-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.603365 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.603344 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12461584-a631-45e0-bbb8-9ee438e01758-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.603422 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.603385 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12461584-a631-45e0-bbb8-9ee438e01758-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.603422 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.603415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12461584-a631-45e0-bbb8-9ee438e01758-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.603534 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.603516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12461584-a631-45e0-bbb8-9ee438e01758-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.603603 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.603585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmdvj\" (UniqueName: \"kubernetes.io/projected/12461584-a631-45e0-bbb8-9ee438e01758-kube-api-access-lmdvj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.603662 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.603635 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12461584-a631-45e0-bbb8-9ee438e01758-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.603713 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.603666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12461584-a631-45e0-bbb8-9ee438e01758-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.603765 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.603723 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12461584-a631-45e0-bbb8-9ee438e01758-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.603813 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.603768 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12461584-a631-45e0-bbb8-9ee438e01758-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.603877 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.603837 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12461584-a631-45e0-bbb8-9ee438e01758-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.604080 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.604054 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12461584-a631-45e0-bbb8-9ee438e01758-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.604344 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.604325 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12461584-a631-45e0-bbb8-9ee438e01758-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.605446 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.605423 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12461584-a631-45e0-bbb8-9ee438e01758-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.605829 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.605811 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12461584-a631-45e0-bbb8-9ee438e01758-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.613110 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.613088 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12461584-a631-45e0-bbb8-9ee438e01758-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.613180 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.613152 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmdvj\" (UniqueName: \"kubernetes.io/projected/12461584-a631-45e0-bbb8-9ee438e01758-kube-api-access-lmdvj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz\" (UID: \"12461584-a631-45e0-bbb8-9ee438e01758\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.663240 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.663210 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:15.712082 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.712057 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw"] Jul 30 22:53:15.712940 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:53:15.712914 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94eb984_d1a7_48ba_91f9_bc7a05d05b4d.slice/crio-c0ffa7acf874ea096b7f97b6c685487c2dfe727c47ee0c1241c92761361ac5e1 WatchSource:0}: Error finding container c0ffa7acf874ea096b7f97b6c685487c2dfe727c47ee0c1241c92761361ac5e1: Status 404 returned error can't find the container with id c0ffa7acf874ea096b7f97b6c685487c2dfe727c47ee0c1241c92761361ac5e1 Jul 30 22:53:15.802698 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:15.802675 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz"] Jul 30 22:53:15.804448 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:53:15.804422 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12461584_a631_45e0_bbb8_9ee438e01758.slice/crio-22e2254ae2cd1430f44bbc846fdf1044b896a3af9b1175561295e4a65c747e7c WatchSource:0}: Error finding container 22e2254ae2cd1430f44bbc846fdf1044b896a3af9b1175561295e4a65c747e7c: Status 404 returned error can't find the container with id 22e2254ae2cd1430f44bbc846fdf1044b896a3af9b1175561295e4a65c747e7c Jul 30 22:53:16.716394 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:16.716358 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" event={"ID":"12461584-a631-45e0-bbb8-9ee438e01758","Type":"ContainerStarted","Data":"22e2254ae2cd1430f44bbc846fdf1044b896a3af9b1175561295e4a65c747e7c"} Jul 30 22:53:16.737621 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:16.737562 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" event={"ID":"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d","Type":"ContainerStarted","Data":"c0ffa7acf874ea096b7f97b6c685487c2dfe727c47ee0c1241c92761361ac5e1"} Jul 30 22:53:17.505304 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.505261 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4"] Jul 30 22:53:17.508902 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.508877 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.511760 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.511735 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 30 22:53:17.511973 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.511957 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 30 22:53:17.512106 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.512057 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 30 22:53:17.512106 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.512080 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wmbpb\"" Jul 30 22:53:17.521723 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.521633 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4"] Jul 30 22:53:17.623292 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.623252 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7fd15c56-ef0e-4eb2-8094-c840276d64bf-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.623483 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.623307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7fd15c56-ef0e-4eb2-8094-c840276d64bf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.623483 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.623386 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd15c56-ef0e-4eb2-8094-c840276d64bf-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.623483 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.623425 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42zzc\" (UniqueName: \"kubernetes.io/projected/7fd15c56-ef0e-4eb2-8094-c840276d64bf-kube-api-access-42zzc\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.623483 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.623453 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd15c56-ef0e-4eb2-8094-c840276d64bf-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.623483 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.623477 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7fd15c56-ef0e-4eb2-8094-c840276d64bf-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.623737 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.623636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7fd15c56-ef0e-4eb2-8094-c840276d64bf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.724787 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.724729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd15c56-ef0e-4eb2-8094-c840276d64bf-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.724787 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.724785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42zzc\" (UniqueName: \"kubernetes.io/projected/7fd15c56-ef0e-4eb2-8094-c840276d64bf-kube-api-access-42zzc\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.725620 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.724829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd15c56-ef0e-4eb2-8094-c840276d64bf-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.725620 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.724874 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7fd15c56-ef0e-4eb2-8094-c840276d64bf-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.725620 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.724937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7fd15c56-ef0e-4eb2-8094-c840276d64bf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.725620 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.724985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7fd15c56-ef0e-4eb2-8094-c840276d64bf-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.725620 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.725016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7fd15c56-ef0e-4eb2-8094-c840276d64bf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.726205 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.726002 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7fd15c56-ef0e-4eb2-8094-c840276d64bf-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.728326 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.728282 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7fd15c56-ef0e-4eb2-8094-c840276d64bf-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.728484 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.728331 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fd15c56-ef0e-4eb2-8094-c840276d64bf-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.728607 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.728498 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7fd15c56-ef0e-4eb2-8094-c840276d64bf-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.728968 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.728923 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7fd15c56-ef0e-4eb2-8094-c840276d64bf-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.739978 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.739957 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fd15c56-ef0e-4eb2-8094-c840276d64bf-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.740666 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.740642 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42zzc\" (UniqueName: \"kubernetes.io/projected/7fd15c56-ef0e-4eb2-8094-c840276d64bf-kube-api-access-42zzc\") pod \"istiod-openshift-gateway-5677ccb49b-7xxw4\" (UID: \"7fd15c56-ef0e-4eb2-8094-c840276d64bf\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.824698 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.824608 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:17.984593 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:17.984564 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4"] Jul 30 22:53:18.876533 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:53:18.876502 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fd15c56_ef0e_4eb2_8094_c840276d64bf.slice/crio-0914617ee15c0626f4816fe487f6bdbbfb2c94e9c40fd19ffc835d23abf36e01 WatchSource:0}: Error finding container 0914617ee15c0626f4816fe487f6bdbbfb2c94e9c40fd19ffc835d23abf36e01: Status 404 returned error can't find the container with id 0914617ee15c0626f4816fe487f6bdbbfb2c94e9c40fd19ffc835d23abf36e01 Jul 30 22:53:18.953766 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:18.953721 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 22:53:18.953914 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:18.953809 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 22:53:18.953914 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:18.953852 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 22:53:18.961230 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:18.961206 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 22:53:18.961303 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:18.961265 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 22:53:18.961349 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:18.961301 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 22:53:19.755500 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:19.755451 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" event={"ID":"7fd15c56-ef0e-4eb2-8094-c840276d64bf","Type":"ContainerStarted","Data":"0914617ee15c0626f4816fe487f6bdbbfb2c94e9c40fd19ffc835d23abf36e01"} Jul 30 22:53:19.757737 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:19.757702 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" event={"ID":"12461584-a631-45e0-bbb8-9ee438e01758","Type":"ContainerStarted","Data":"2ce6838dabd04e8bd844d550a837fb96f08e7fac65af63aafae096a7ef6f2f26"} Jul 30 22:53:19.759902 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:19.759849 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" event={"ID":"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d","Type":"ContainerStarted","Data":"e7f58131ae3a8ae9983b166c893fbe033e36193d8a13d26c9c3246aa1aeee6d7"} Jul 30 22:53:19.790124 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:19.790081 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" podStartSLOduration=1.643069542 podStartE2EDuration="4.790065992s" totalImagesPullingTime="3.14699645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:53:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:53:19.788463392 +0000 UTC m=+326.992282627" watchObservedRunningTime="2026-07-30 22:53:19.790065992 +0000 UTC m=+326.993885225" Jul 30 22:53:19.811576 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:19.811533 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" podStartSLOduration=1.5656021180000002 podStartE2EDuration="4.811520459s" totalImagesPullingTime="3.245918341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:53:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:53:19.809243624 +0000 UTC m=+327.013062870" watchObservedRunningTime="2026-07-30 22:53:19.811520459 +0000 UTC m=+327.015339693" Jul 30 22:53:20.571844 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:20.571804 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:20.573052 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:20.573028 2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 30 22:53:20.573132 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:20.573077 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" podUID="f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 30 22:53:20.663767 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:20.663733 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:20.668527 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:20.668502 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:20.675252 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:20.675228 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-78d44f567c-lcdtv" Jul 30 22:53:20.765926 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:20.765896 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:20.766908 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:20.766876 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz" Jul 30 22:53:20.825746 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:20.825636 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw"] Jul 30 22:53:21.571733 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:21.571694 2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 30 22:53:21.571936 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:21.571760 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" podUID="f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 30 22:53:22.572430 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:22.572395 2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 30 22:53:22.572812 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:22.572450 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" podUID="f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 30 22:53:22.777995 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:22.777923 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" podUID="f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" containerName="istio-proxy" containerID="cri-o://e7f58131ae3a8ae9983b166c893fbe033e36193d8a13d26c9c3246aa1aeee6d7" gracePeriod=30 Jul 30 22:53:23.577171 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:23.577140 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 22:53:23.577463 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:23.577203 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 22:53:23.695619 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:23.695593 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-swlkn" Jul 30 22:53:23.783770 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:23.783734 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" event={"ID":"7fd15c56-ef0e-4eb2-8094-c840276d64bf","Type":"ContainerStarted","Data":"ec24b8e238c9b006b7d1563f019dd39ef06636a81c45f863c1e7e504941b701b"} Jul 30 22:53:23.783957 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:23.783873 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:23.803098 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:23.803050 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" podStartSLOduration=2.105468094 podStartE2EDuration="6.803034446s" totalImagesPullingTime="4.697566352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:53:23.801053196 +0000 UTC m=+331.004872448" watchObservedRunningTime="2026-07-30 22:53:23.803034446 +0000 UTC m=+331.006853680" Jul 30 22:53:24.789626 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:24.789592 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-7xxw4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 22:53:24.790075 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:24.789647 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" podUID="7fd15c56-ef0e-4eb2-8094-c840276d64bf" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 22:53:27.788606 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:27.788578 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-7xxw4" Jul 30 22:53:28.027427 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.027405 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:28.114741 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.114675 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-credential-socket\") pod \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " Jul 30 22:53:28.114741 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.114735 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pstb\" (UniqueName: \"kubernetes.io/projected/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-kube-api-access-9pstb\") pod \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " Jul 30 22:53:28.114979 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.114756 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-token\") pod \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " Jul 30 22:53:28.114979 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.114789 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-podinfo\") pod \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " Jul 30 22:53:28.114979 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.114818 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istiod-ca-cert\") pod \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " Jul 30 22:53:28.114979 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.114851 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-workload-certs\") pod \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " Jul 30 22:53:28.114979 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.114926 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-envoy\") pod \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " Jul 30 22:53:28.114979 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.114953 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-data\") pod \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " Jul 30 22:53:28.114979 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.114976 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-workload-socket\") pod \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\" (UID: \"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d\") " Jul 30 22:53:28.115235 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.115008 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" (UID: "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:53:28.115235 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.115167 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:53:28.118232 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.118175 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-data" (OuterVolumeSpecName: "istio-data") pod "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" (UID: "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:53:28.118232 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.118205 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" (UID: "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:53:28.118232 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.118222 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" (UID: "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:53:28.118522 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.118442 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" (UID: "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:53:28.120043 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.120015 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" (UID: "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 22:53:28.120273 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.120251 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-kube-api-access-9pstb" (OuterVolumeSpecName: "kube-api-access-9pstb") pod "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" (UID: "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d"). InnerVolumeSpecName "kube-api-access-9pstb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 22:53:28.120406 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.120387 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-token" (OuterVolumeSpecName: "istio-token") pod "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" (UID: "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 22:53:28.120451 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.120388 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" (UID: "f94eb984-d1a7-48ba-91f9-bc7a05d05b4d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:53:28.215942 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.215915 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pstb\" (UniqueName: \"kubernetes.io/projected/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-kube-api-access-9pstb\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:53:28.215942 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.215940 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:53:28.215942 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.215949 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:53:28.216169 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.215957 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:53:28.216169 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.215965 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:53:28.216169 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.215974 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:53:28.216169 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.215982 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:53:28.216169 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.215990 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:53:28.810265 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.810235 2576 generic.go:356] "Generic (PLEG): container finished" podID="f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" containerID="e7f58131ae3a8ae9983b166c893fbe033e36193d8a13d26c9c3246aa1aeee6d7" exitCode=0 Jul 30 22:53:28.810657 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.810285 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" Jul 30 22:53:28.810657 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.810323 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" event={"ID":"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d","Type":"ContainerDied","Data":"e7f58131ae3a8ae9983b166c893fbe033e36193d8a13d26c9c3246aa1aeee6d7"} Jul 30 22:53:28.810657 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.810377 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw" event={"ID":"f94eb984-d1a7-48ba-91f9-bc7a05d05b4d","Type":"ContainerDied","Data":"c0ffa7acf874ea096b7f97b6c685487c2dfe727c47ee0c1241c92761361ac5e1"} Jul 30 22:53:28.810657 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.810398 2576 scope.go:117] "RemoveContainer" containerID="e7f58131ae3a8ae9983b166c893fbe033e36193d8a13d26c9c3246aa1aeee6d7" Jul 30 22:53:28.819424 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.819408 2576 scope.go:117] "RemoveContainer" containerID="e7f58131ae3a8ae9983b166c893fbe033e36193d8a13d26c9c3246aa1aeee6d7" Jul 30 22:53:28.819646 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:53:28.819629 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7f58131ae3a8ae9983b166c893fbe033e36193d8a13d26c9c3246aa1aeee6d7\": container with ID starting with e7f58131ae3a8ae9983b166c893fbe033e36193d8a13d26c9c3246aa1aeee6d7 not found: ID does not exist" containerID="e7f58131ae3a8ae9983b166c893fbe033e36193d8a13d26c9c3246aa1aeee6d7" Jul 30 22:53:28.819712 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.819657 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f58131ae3a8ae9983b166c893fbe033e36193d8a13d26c9c3246aa1aeee6d7"} err="failed to get container status \"e7f58131ae3a8ae9983b166c893fbe033e36193d8a13d26c9c3246aa1aeee6d7\": rpc error: code = NotFound desc = could not find container \"e7f58131ae3a8ae9983b166c893fbe033e36193d8a13d26c9c3246aa1aeee6d7\": container with ID starting with e7f58131ae3a8ae9983b166c893fbe033e36193d8a13d26c9c3246aa1aeee6d7 not found: ID does not exist" Jul 30 22:53:28.832144 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.832123 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw"] Jul 30 22:53:28.839410 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:28.839391 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bclnqnw"] Jul 30 22:53:29.240198 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:29.237307 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" path="/var/lib/kubelet/pods/f94eb984-d1a7-48ba-91f9-bc7a05d05b4d/volumes" Jul 30 22:53:44.815071 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.815040 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8476b4c5df-nmv8r"] Jul 30 22:53:44.815540 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.815336 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" containerName="istio-proxy" Jul 30 22:53:44.815540 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.815347 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" containerName="istio-proxy" Jul 30 22:53:44.815540 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.815404 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f94eb984-d1a7-48ba-91f9-bc7a05d05b4d" containerName="istio-proxy" Jul 30 22:53:44.821193 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.821173 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.830428 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.830406 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8476b4c5df-nmv8r"] Jul 30 22:53:44.847757 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.847732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q54g6\" (UniqueName: \"kubernetes.io/projected/1da78400-ee64-43b0-ad1d-1347a53c0ab0-kube-api-access-q54g6\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.847845 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.847778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1da78400-ee64-43b0-ad1d-1347a53c0ab0-console-serving-cert\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.847845 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.847804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1da78400-ee64-43b0-ad1d-1347a53c0ab0-console-config\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.847945 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.847913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1da78400-ee64-43b0-ad1d-1347a53c0ab0-console-oauth-config\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.847980 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.847943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1da78400-ee64-43b0-ad1d-1347a53c0ab0-trusted-ca-bundle\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.847980 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.847962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1da78400-ee64-43b0-ad1d-1347a53c0ab0-oauth-serving-cert\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.848046 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.847977 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1da78400-ee64-43b0-ad1d-1347a53c0ab0-service-ca\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.948398 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.948334 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q54g6\" (UniqueName: \"kubernetes.io/projected/1da78400-ee64-43b0-ad1d-1347a53c0ab0-kube-api-access-q54g6\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.948398 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.948389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1da78400-ee64-43b0-ad1d-1347a53c0ab0-console-serving-cert\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.948582 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.948434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1da78400-ee64-43b0-ad1d-1347a53c0ab0-console-config\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.948582 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.948518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1da78400-ee64-43b0-ad1d-1347a53c0ab0-console-oauth-config\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.948582 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.948544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1da78400-ee64-43b0-ad1d-1347a53c0ab0-trusted-ca-bundle\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.948733 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.948604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1da78400-ee64-43b0-ad1d-1347a53c0ab0-oauth-serving-cert\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.948733 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.948639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1da78400-ee64-43b0-ad1d-1347a53c0ab0-service-ca\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.950840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.949964 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1da78400-ee64-43b0-ad1d-1347a53c0ab0-console-config\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.950840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.950077 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1da78400-ee64-43b0-ad1d-1347a53c0ab0-trusted-ca-bundle\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.950840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.950132 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1da78400-ee64-43b0-ad1d-1347a53c0ab0-oauth-serving-cert\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.950840 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.950302 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1da78400-ee64-43b0-ad1d-1347a53c0ab0-service-ca\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.956261 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.951993 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1da78400-ee64-43b0-ad1d-1347a53c0ab0-console-serving-cert\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.956261 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.954609 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1da78400-ee64-43b0-ad1d-1347a53c0ab0-console-oauth-config\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:44.957158 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:44.957139 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q54g6\" (UniqueName: \"kubernetes.io/projected/1da78400-ee64-43b0-ad1d-1347a53c0ab0-kube-api-access-q54g6\") pod \"console-8476b4c5df-nmv8r\" (UID: \"1da78400-ee64-43b0-ad1d-1347a53c0ab0\") " pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:45.131554 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:45.131535 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:45.257395 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:45.257375 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8476b4c5df-nmv8r"] Jul 30 22:53:45.259624 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:53:45.259592 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da78400_ee64_43b0_ad1d_1347a53c0ab0.slice/crio-1b629e3d7225ff23ac8886c824315c2cdf5eab1c3c4c1e8a7b19d6f73836556f WatchSource:0}: Error finding container 1b629e3d7225ff23ac8886c824315c2cdf5eab1c3c4c1e8a7b19d6f73836556f: Status 404 returned error can't find the container with id 1b629e3d7225ff23ac8886c824315c2cdf5eab1c3c4c1e8a7b19d6f73836556f Jul 30 22:53:45.888484 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:45.888447 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8476b4c5df-nmv8r" event={"ID":"1da78400-ee64-43b0-ad1d-1347a53c0ab0","Type":"ContainerStarted","Data":"782135d86ccf0421ee3482c4095182d4c2a68d52371ff64c4f6c4ae0a653897c"} Jul 30 22:53:45.888846 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:45.888503 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8476b4c5df-nmv8r" event={"ID":"1da78400-ee64-43b0-ad1d-1347a53c0ab0","Type":"ContainerStarted","Data":"1b629e3d7225ff23ac8886c824315c2cdf5eab1c3c4c1e8a7b19d6f73836556f"} Jul 30 22:53:45.905822 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:45.905775 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8476b4c5df-nmv8r" podStartSLOduration=1.9057602679999999 podStartE2EDuration="1.905760268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:53:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:53:45.904030332 +0000 UTC m=+353.107849567" watchObservedRunningTime="2026-07-30 22:53:45.905760268 +0000 UTC m=+353.109579501" Jul 30 22:53:55.132710 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:55.132672 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:55.133148 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:55.132777 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:55.137659 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:55.137636 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:55.936833 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:55.936806 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8476b4c5df-nmv8r" Jul 30 22:53:55.979465 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:53:55.979436 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56c7f7bbd5-25942"] Jul 30 22:54:12.289478 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.289446 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj"] Jul 30 22:54:12.302144 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.302112 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj"] Jul 30 22:54:12.302290 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.302229 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" Jul 30 22:54:12.305240 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.305214 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 30 22:54:12.305497 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.305222 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 30 22:54:12.306562 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.306542 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6tc8q\"" Jul 30 22:54:12.378913 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.378888 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj\" (UID: \"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" Jul 30 22:54:12.379012 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.378927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj\" (UID: \"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" Jul 30 22:54:12.379012 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.378959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbx2g\" (UniqueName: \"kubernetes.io/projected/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-kube-api-access-jbx2g\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj\" (UID: \"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" Jul 30 22:54:12.390172 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.390144 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49"] Jul 30 22:54:12.393605 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.393589 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" Jul 30 22:54:12.401836 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.401815 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49"] Jul 30 22:54:12.480024 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.479998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj\" (UID: \"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" Jul 30 22:54:12.480155 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.480036 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxk4d\" (UniqueName: \"kubernetes.io/projected/73051942-e98b-4ddd-b22b-eac4e3cf59d4-kube-api-access-qxk4d\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49\" (UID: \"73051942-e98b-4ddd-b22b-eac4e3cf59d4\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" Jul 30 22:54:12.480155 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.480066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73051942-e98b-4ddd-b22b-eac4e3cf59d4-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49\" (UID: \"73051942-e98b-4ddd-b22b-eac4e3cf59d4\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" Jul 30 22:54:12.480155 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.480132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73051942-e98b-4ddd-b22b-eac4e3cf59d4-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49\" (UID: \"73051942-e98b-4ddd-b22b-eac4e3cf59d4\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" Jul 30 22:54:12.480261 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.480184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj\" (UID: \"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" Jul 30 22:54:12.480261 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.480229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbx2g\" (UniqueName: \"kubernetes.io/projected/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-kube-api-access-jbx2g\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj\" (UID: \"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" Jul 30 22:54:12.480363 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.480349 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj\" (UID: \"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" Jul 30 22:54:12.480566 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.480542 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj\" (UID: \"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" Jul 30 22:54:12.489987 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.489958 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv"] Jul 30 22:54:12.497625 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.497596 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbx2g\" (UniqueName: \"kubernetes.io/projected/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-kube-api-access-jbx2g\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj\" (UID: \"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" Jul 30 22:54:12.500474 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.500455 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" Jul 30 22:54:12.503022 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.503001 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv"] Jul 30 22:54:12.580791 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.580735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxk4d\" (UniqueName: \"kubernetes.io/projected/73051942-e98b-4ddd-b22b-eac4e3cf59d4-kube-api-access-qxk4d\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49\" (UID: \"73051942-e98b-4ddd-b22b-eac4e3cf59d4\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" Jul 30 22:54:12.580791 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.580765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73051942-e98b-4ddd-b22b-eac4e3cf59d4-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49\" (UID: \"73051942-e98b-4ddd-b22b-eac4e3cf59d4\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" Jul 30 22:54:12.580791 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.580791 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73051942-e98b-4ddd-b22b-eac4e3cf59d4-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49\" (UID: \"73051942-e98b-4ddd-b22b-eac4e3cf59d4\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" Jul 30 22:54:12.581017 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.580844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv\" (UID: \"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" Jul 30 22:54:12.581017 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.580902 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gcd7\" (UniqueName: \"kubernetes.io/projected/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-kube-api-access-4gcd7\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv\" (UID: \"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" Jul 30 22:54:12.581017 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.581002 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv\" (UID: \"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" Jul 30 22:54:12.581127 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.581086 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73051942-e98b-4ddd-b22b-eac4e3cf59d4-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49\" (UID: \"73051942-e98b-4ddd-b22b-eac4e3cf59d4\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" Jul 30 22:54:12.581165 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.581146 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73051942-e98b-4ddd-b22b-eac4e3cf59d4-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49\" (UID: \"73051942-e98b-4ddd-b22b-eac4e3cf59d4\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" Jul 30 22:54:12.590102 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.590083 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m"] Jul 30 22:54:12.592676 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.592654 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxk4d\" (UniqueName: \"kubernetes.io/projected/73051942-e98b-4ddd-b22b-eac4e3cf59d4-kube-api-access-qxk4d\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49\" (UID: \"73051942-e98b-4ddd-b22b-eac4e3cf59d4\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" Jul 30 22:54:12.593753 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.593736 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" Jul 30 22:54:12.604277 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.604259 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m"] Jul 30 22:54:12.612788 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.612770 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" Jul 30 22:54:12.681843 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.681814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fec0f3f0-112d-4c5c-aa75-814c73000cc7-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m\" (UID: \"fec0f3f0-112d-4c5c-aa75-814c73000cc7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" Jul 30 22:54:12.681990 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.681886 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58gtq\" (UniqueName: \"kubernetes.io/projected/fec0f3f0-112d-4c5c-aa75-814c73000cc7-kube-api-access-58gtq\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m\" (UID: \"fec0f3f0-112d-4c5c-aa75-814c73000cc7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" Jul 30 22:54:12.681990 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.681908 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fec0f3f0-112d-4c5c-aa75-814c73000cc7-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m\" (UID: \"fec0f3f0-112d-4c5c-aa75-814c73000cc7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" Jul 30 22:54:12.682067 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.682006 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv\" (UID: \"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" Jul 30 22:54:12.682067 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.682024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gcd7\" (UniqueName: \"kubernetes.io/projected/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-kube-api-access-4gcd7\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv\" (UID: \"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" Jul 30 22:54:12.682270 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.682246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv\" (UID: \"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" Jul 30 22:54:12.682482 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.682462 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv\" (UID: \"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" Jul 30 22:54:12.682521 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.682510 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv\" (UID: \"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" Jul 30 22:54:12.691058 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.691036 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gcd7\" (UniqueName: \"kubernetes.io/projected/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-kube-api-access-4gcd7\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv\" (UID: \"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" Jul 30 22:54:12.703236 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.703111 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" Jul 30 22:54:12.746919 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.746889 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj"] Jul 30 22:54:12.748713 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:54:12.748681 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3971d5a_14ae_4a2a_ae0f_6a178f914ca1.slice/crio-22dcebf63c8dc29d3d443ae1ec7e1d00c03bffdf8d57fdf480de1a9270e71888 WatchSource:0}: Error finding container 22dcebf63c8dc29d3d443ae1ec7e1d00c03bffdf8d57fdf480de1a9270e71888: Status 404 returned error can't find the container with id 22dcebf63c8dc29d3d443ae1ec7e1d00c03bffdf8d57fdf480de1a9270e71888 Jul 30 22:54:12.783070 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.783039 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58gtq\" (UniqueName: \"kubernetes.io/projected/fec0f3f0-112d-4c5c-aa75-814c73000cc7-kube-api-access-58gtq\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m\" (UID: \"fec0f3f0-112d-4c5c-aa75-814c73000cc7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" Jul 30 22:54:12.783195 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.783091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fec0f3f0-112d-4c5c-aa75-814c73000cc7-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m\" (UID: \"fec0f3f0-112d-4c5c-aa75-814c73000cc7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" Jul 30 22:54:12.783195 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.783187 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fec0f3f0-112d-4c5c-aa75-814c73000cc7-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m\" (UID: \"fec0f3f0-112d-4c5c-aa75-814c73000cc7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" Jul 30 22:54:12.783458 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.783439 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fec0f3f0-112d-4c5c-aa75-814c73000cc7-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m\" (UID: \"fec0f3f0-112d-4c5c-aa75-814c73000cc7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" Jul 30 22:54:12.783575 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.783555 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fec0f3f0-112d-4c5c-aa75-814c73000cc7-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m\" (UID: \"fec0f3f0-112d-4c5c-aa75-814c73000cc7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" Jul 30 22:54:12.791523 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.791503 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58gtq\" (UniqueName: \"kubernetes.io/projected/fec0f3f0-112d-4c5c-aa75-814c73000cc7-kube-api-access-58gtq\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m\" (UID: \"fec0f3f0-112d-4c5c-aa75-814c73000cc7\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" Jul 30 22:54:12.811788 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.811764 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" Jul 30 22:54:12.842913 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.842884 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49"] Jul 30 22:54:12.844125 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:54:12.844097 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73051942_e98b_4ddd_b22b_eac4e3cf59d4.slice/crio-92b630af5e5fdb59229fe80c58740e0ff9305405e8233239ffb1e7a1ff972ba5 WatchSource:0}: Error finding container 92b630af5e5fdb59229fe80c58740e0ff9305405e8233239ffb1e7a1ff972ba5: Status 404 returned error can't find the container with id 92b630af5e5fdb59229fe80c58740e0ff9305405e8233239ffb1e7a1ff972ba5 Jul 30 22:54:12.909223 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.909195 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" Jul 30 22:54:12.943933 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:12.943906 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv"] Jul 30 22:54:12.945376 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:54:12.945344 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcecf91e7_767f_4bd8_88ac_8f96a0e4f9f2.slice/crio-4b1caf249ebdd445f3712decb62624e712e58053a4cf8eeac6a2a9e5a572e0bb WatchSource:0}: Error finding container 4b1caf249ebdd445f3712decb62624e712e58053a4cf8eeac6a2a9e5a572e0bb: Status 404 returned error can't find the container with id 4b1caf249ebdd445f3712decb62624e712e58053a4cf8eeac6a2a9e5a572e0bb Jul 30 22:54:13.014681 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:13.014653 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" event={"ID":"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2","Type":"ContainerStarted","Data":"4b1caf249ebdd445f3712decb62624e712e58053a4cf8eeac6a2a9e5a572e0bb"} Jul 30 22:54:13.016782 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:13.016585 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" event={"ID":"73051942-e98b-4ddd-b22b-eac4e3cf59d4","Type":"ContainerStarted","Data":"18ea62fcca850ae5602504eb30d3b4b13344b3c4be3f6db87812c9ccc4694a0e"} Jul 30 22:54:13.016782 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:13.016634 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" event={"ID":"73051942-e98b-4ddd-b22b-eac4e3cf59d4","Type":"ContainerStarted","Data":"92b630af5e5fdb59229fe80c58740e0ff9305405e8233239ffb1e7a1ff972ba5"} Jul 30 22:54:13.018391 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:13.018325 2576 generic.go:356] "Generic (PLEG): container finished" podID="d3971d5a-14ae-4a2a-ae0f-6a178f914ca1" containerID="ee903d5d6e17ca5f96cd4e38e239b5f1566fffaefeecb4c40f891d0202758a3d" exitCode=0 Jul 30 22:54:13.018391 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:13.018362 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" event={"ID":"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1","Type":"ContainerDied","Data":"ee903d5d6e17ca5f96cd4e38e239b5f1566fffaefeecb4c40f891d0202758a3d"} Jul 30 22:54:13.018508 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:13.018393 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" event={"ID":"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1","Type":"ContainerStarted","Data":"22dcebf63c8dc29d3d443ae1ec7e1d00c03bffdf8d57fdf480de1a9270e71888"} Jul 30 22:54:13.055756 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:13.055707 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m"] Jul 30 22:54:13.109636 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:54:13.109571 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec0f3f0_112d_4c5c_aa75_814c73000cc7.slice/crio-c030fc65874a7c772d68e10113850d5a95f77476b2da9ca42ff30ea6119a09c2 WatchSource:0}: Error finding container c030fc65874a7c772d68e10113850d5a95f77476b2da9ca42ff30ea6119a09c2: Status 404 returned error can't find the container with id c030fc65874a7c772d68e10113850d5a95f77476b2da9ca42ff30ea6119a09c2 Jul 30 22:54:14.025037 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:14.024997 2576 generic.go:356] "Generic (PLEG): container finished" podID="cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2" containerID="e5720e9960dafecddb54042efa83c76b3300f526ee56e38cfec8933952efd2e0" exitCode=0 Jul 30 22:54:14.025470 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:14.025062 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" event={"ID":"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2","Type":"ContainerDied","Data":"e5720e9960dafecddb54042efa83c76b3300f526ee56e38cfec8933952efd2e0"} Jul 30 22:54:14.026787 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:14.026729 2576 generic.go:356] "Generic (PLEG): container finished" podID="73051942-e98b-4ddd-b22b-eac4e3cf59d4" containerID="18ea62fcca850ae5602504eb30d3b4b13344b3c4be3f6db87812c9ccc4694a0e" exitCode=0 Jul 30 22:54:14.026847 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:14.026791 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" event={"ID":"73051942-e98b-4ddd-b22b-eac4e3cf59d4","Type":"ContainerDied","Data":"18ea62fcca850ae5602504eb30d3b4b13344b3c4be3f6db87812c9ccc4694a0e"} Jul 30 22:54:14.028666 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:14.028548 2576 generic.go:356] "Generic (PLEG): container finished" podID="fec0f3f0-112d-4c5c-aa75-814c73000cc7" containerID="79a511867ce9119e00d2c0256206a040142f065dbb245c6cb4a089f646e5a26c" exitCode=0 Jul 30 22:54:14.028666 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:14.028578 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" event={"ID":"fec0f3f0-112d-4c5c-aa75-814c73000cc7","Type":"ContainerDied","Data":"79a511867ce9119e00d2c0256206a040142f065dbb245c6cb4a089f646e5a26c"} Jul 30 22:54:14.028666 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:14.028630 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" event={"ID":"fec0f3f0-112d-4c5c-aa75-814c73000cc7","Type":"ContainerStarted","Data":"c030fc65874a7c772d68e10113850d5a95f77476b2da9ca42ff30ea6119a09c2"} Jul 30 22:54:14.030841 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:14.030816 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" event={"ID":"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1","Type":"ContainerStarted","Data":"f9673bedca75fe1eb61b30a25a3840227c51ca41dd0d96c8b2a61638babfffb3"} Jul 30 22:54:15.039381 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:15.039354 2576 generic.go:356] "Generic (PLEG): container finished" podID="73051942-e98b-4ddd-b22b-eac4e3cf59d4" containerID="bed119ca30a1b5fc99cb2d365105b83a690b1cc6f54d0460e913433827c7b907" exitCode=0 Jul 30 22:54:15.039758 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:15.039432 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" event={"ID":"73051942-e98b-4ddd-b22b-eac4e3cf59d4","Type":"ContainerDied","Data":"bed119ca30a1b5fc99cb2d365105b83a690b1cc6f54d0460e913433827c7b907"} Jul 30 22:54:15.041351 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:15.041329 2576 generic.go:356] "Generic (PLEG): container finished" podID="fec0f3f0-112d-4c5c-aa75-814c73000cc7" containerID="22a9b40018c0e9d8a79f4296577f6852ac45bd622d1b714c22a81b524e466fb2" exitCode=0 Jul 30 22:54:15.041439 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:15.041419 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" event={"ID":"fec0f3f0-112d-4c5c-aa75-814c73000cc7","Type":"ContainerDied","Data":"22a9b40018c0e9d8a79f4296577f6852ac45bd622d1b714c22a81b524e466fb2"} Jul 30 22:54:15.043634 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:15.043616 2576 generic.go:356] "Generic (PLEG): container finished" podID="d3971d5a-14ae-4a2a-ae0f-6a178f914ca1" containerID="f9673bedca75fe1eb61b30a25a3840227c51ca41dd0d96c8b2a61638babfffb3" exitCode=0 Jul 30 22:54:15.043740 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:15.043692 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" event={"ID":"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1","Type":"ContainerDied","Data":"f9673bedca75fe1eb61b30a25a3840227c51ca41dd0d96c8b2a61638babfffb3"} Jul 30 22:54:16.051392 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:16.051359 2576 generic.go:356] "Generic (PLEG): container finished" podID="cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2" containerID="8f42856cee1d4097e1ae7450a53adc7a9e1104e565cf75c77f54b5dbda674202" exitCode=0 Jul 30 22:54:16.051740 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:16.051434 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" event={"ID":"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2","Type":"ContainerDied","Data":"8f42856cee1d4097e1ae7450a53adc7a9e1104e565cf75c77f54b5dbda674202"} Jul 30 22:54:16.053659 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:16.053635 2576 generic.go:356] "Generic (PLEG): container finished" podID="73051942-e98b-4ddd-b22b-eac4e3cf59d4" containerID="4d7896031d3589472754b15fe41a0d0d308c6a00f6c6d0215a372b588c90a385" exitCode=0 Jul 30 22:54:16.053761 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:16.053672 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" event={"ID":"73051942-e98b-4ddd-b22b-eac4e3cf59d4","Type":"ContainerDied","Data":"4d7896031d3589472754b15fe41a0d0d308c6a00f6c6d0215a372b588c90a385"} Jul 30 22:54:16.055812 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:16.055791 2576 generic.go:356] "Generic (PLEG): container finished" podID="fec0f3f0-112d-4c5c-aa75-814c73000cc7" containerID="170690880d13cda76938d6638097423aa0e269e63a1d00841f46d55846d8e139" exitCode=0 Jul 30 22:54:16.055929 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:16.055882 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" event={"ID":"fec0f3f0-112d-4c5c-aa75-814c73000cc7","Type":"ContainerDied","Data":"170690880d13cda76938d6638097423aa0e269e63a1d00841f46d55846d8e139"} Jul 30 22:54:16.057978 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:16.057955 2576 generic.go:356] "Generic (PLEG): container finished" podID="d3971d5a-14ae-4a2a-ae0f-6a178f914ca1" containerID="83b35ad415b4fad03457e7725ba55f86ed5babc1a7f019c888cd5de15fe423ee" exitCode=0 Jul 30 22:54:16.058072 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:16.058032 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" event={"ID":"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1","Type":"ContainerDied","Data":"83b35ad415b4fad03457e7725ba55f86ed5babc1a7f019c888cd5de15fe423ee"} Jul 30 22:54:17.064633 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.064604 2576 generic.go:356] "Generic (PLEG): container finished" podID="cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2" containerID="030274981ad56e7fad03ad4338826b7c454fc1c2303e2970f559f716c932d2cd" exitCode=0 Jul 30 22:54:17.065115 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.064693 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" event={"ID":"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2","Type":"ContainerDied","Data":"030274981ad56e7fad03ad4338826b7c454fc1c2303e2970f559f716c932d2cd"} Jul 30 22:54:17.220628 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.220595 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" Jul 30 22:54:17.251101 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.251081 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" Jul 30 22:54:17.254268 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.254249 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" Jul 30 22:54:17.324780 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.324706 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fec0f3f0-112d-4c5c-aa75-814c73000cc7-util\") pod \"fec0f3f0-112d-4c5c-aa75-814c73000cc7\" (UID: \"fec0f3f0-112d-4c5c-aa75-814c73000cc7\") " Jul 30 22:54:17.324780 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.324765 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-bundle\") pod \"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1\" (UID: \"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1\") " Jul 30 22:54:17.325015 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.324803 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73051942-e98b-4ddd-b22b-eac4e3cf59d4-util\") pod \"73051942-e98b-4ddd-b22b-eac4e3cf59d4\" (UID: \"73051942-e98b-4ddd-b22b-eac4e3cf59d4\") " Jul 30 22:54:17.325015 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.324829 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-util\") pod \"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1\" (UID: \"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1\") " Jul 30 22:54:17.325015 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.324915 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbx2g\" (UniqueName: \"kubernetes.io/projected/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-kube-api-access-jbx2g\") pod \"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1\" (UID: \"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1\") " Jul 30 22:54:17.325015 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.324969 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxk4d\" (UniqueName: \"kubernetes.io/projected/73051942-e98b-4ddd-b22b-eac4e3cf59d4-kube-api-access-qxk4d\") pod \"73051942-e98b-4ddd-b22b-eac4e3cf59d4\" (UID: \"73051942-e98b-4ddd-b22b-eac4e3cf59d4\") " Jul 30 22:54:17.325241 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.325061 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73051942-e98b-4ddd-b22b-eac4e3cf59d4-bundle\") pod \"73051942-e98b-4ddd-b22b-eac4e3cf59d4\" (UID: \"73051942-e98b-4ddd-b22b-eac4e3cf59d4\") " Jul 30 22:54:17.325241 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.325091 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58gtq\" (UniqueName: \"kubernetes.io/projected/fec0f3f0-112d-4c5c-aa75-814c73000cc7-kube-api-access-58gtq\") pod \"fec0f3f0-112d-4c5c-aa75-814c73000cc7\" (UID: \"fec0f3f0-112d-4c5c-aa75-814c73000cc7\") " Jul 30 22:54:17.325241 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.325134 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fec0f3f0-112d-4c5c-aa75-814c73000cc7-bundle\") pod \"fec0f3f0-112d-4c5c-aa75-814c73000cc7\" (UID: \"fec0f3f0-112d-4c5c-aa75-814c73000cc7\") " Jul 30 22:54:17.325662 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.325634 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-bundle" (OuterVolumeSpecName: "bundle") pod "d3971d5a-14ae-4a2a-ae0f-6a178f914ca1" (UID: "d3971d5a-14ae-4a2a-ae0f-6a178f914ca1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:54:17.325930 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.325908 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec0f3f0-112d-4c5c-aa75-814c73000cc7-bundle" (OuterVolumeSpecName: "bundle") pod "fec0f3f0-112d-4c5c-aa75-814c73000cc7" (UID: "fec0f3f0-112d-4c5c-aa75-814c73000cc7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:54:17.326029 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.326005 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73051942-e98b-4ddd-b22b-eac4e3cf59d4-bundle" (OuterVolumeSpecName: "bundle") pod "73051942-e98b-4ddd-b22b-eac4e3cf59d4" (UID: "73051942-e98b-4ddd-b22b-eac4e3cf59d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:54:17.327639 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.327613 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-kube-api-access-jbx2g" (OuterVolumeSpecName: "kube-api-access-jbx2g") pod "d3971d5a-14ae-4a2a-ae0f-6a178f914ca1" (UID: "d3971d5a-14ae-4a2a-ae0f-6a178f914ca1"). InnerVolumeSpecName "kube-api-access-jbx2g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 22:54:17.327975 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.327951 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fec0f3f0-112d-4c5c-aa75-814c73000cc7-kube-api-access-58gtq" (OuterVolumeSpecName: "kube-api-access-58gtq") pod "fec0f3f0-112d-4c5c-aa75-814c73000cc7" (UID: "fec0f3f0-112d-4c5c-aa75-814c73000cc7"). InnerVolumeSpecName "kube-api-access-58gtq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 22:54:17.328147 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.328125 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73051942-e98b-4ddd-b22b-eac4e3cf59d4-kube-api-access-qxk4d" (OuterVolumeSpecName: "kube-api-access-qxk4d") pod "73051942-e98b-4ddd-b22b-eac4e3cf59d4" (UID: "73051942-e98b-4ddd-b22b-eac4e3cf59d4"). InnerVolumeSpecName "kube-api-access-qxk4d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 22:54:17.330674 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.330641 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73051942-e98b-4ddd-b22b-eac4e3cf59d4-util" (OuterVolumeSpecName: "util") pod "73051942-e98b-4ddd-b22b-eac4e3cf59d4" (UID: "73051942-e98b-4ddd-b22b-eac4e3cf59d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:54:17.330930 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.330913 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec0f3f0-112d-4c5c-aa75-814c73000cc7-util" (OuterVolumeSpecName: "util") pod "fec0f3f0-112d-4c5c-aa75-814c73000cc7" (UID: "fec0f3f0-112d-4c5c-aa75-814c73000cc7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:54:17.332035 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.332014 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-util" (OuterVolumeSpecName: "util") pod "d3971d5a-14ae-4a2a-ae0f-6a178f914ca1" (UID: "d3971d5a-14ae-4a2a-ae0f-6a178f914ca1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:54:17.426338 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.426302 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbx2g\" (UniqueName: \"kubernetes.io/projected/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-kube-api-access-jbx2g\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:17.426338 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.426330 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxk4d\" (UniqueName: \"kubernetes.io/projected/73051942-e98b-4ddd-b22b-eac4e3cf59d4-kube-api-access-qxk4d\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:17.426338 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.426341 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73051942-e98b-4ddd-b22b-eac4e3cf59d4-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:17.426621 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.426351 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58gtq\" (UniqueName: \"kubernetes.io/projected/fec0f3f0-112d-4c5c-aa75-814c73000cc7-kube-api-access-58gtq\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:17.426621 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.426360 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fec0f3f0-112d-4c5c-aa75-814c73000cc7-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:17.426621 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.426368 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fec0f3f0-112d-4c5c-aa75-814c73000cc7-util\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:17.426621 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.426375 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:17.426621 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.426382 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73051942-e98b-4ddd-b22b-eac4e3cf59d4-util\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:17.426621 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:17.426388 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3971d5a-14ae-4a2a-ae0f-6a178f914ca1-util\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:18.071682 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.071640 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" event={"ID":"73051942-e98b-4ddd-b22b-eac4e3cf59d4","Type":"ContainerDied","Data":"92b630af5e5fdb59229fe80c58740e0ff9305405e8233239ffb1e7a1ff972ba5"} Jul 30 22:54:18.072174 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.071702 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92b630af5e5fdb59229fe80c58740e0ff9305405e8233239ffb1e7a1ff972ba5" Jul 30 22:54:18.072174 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.071657 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0ljb49" Jul 30 22:54:18.073477 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.073452 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" Jul 30 22:54:18.073614 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.073450 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c9wj7m" event={"ID":"fec0f3f0-112d-4c5c-aa75-814c73000cc7","Type":"ContainerDied","Data":"c030fc65874a7c772d68e10113850d5a95f77476b2da9ca42ff30ea6119a09c2"} Jul 30 22:54:18.073614 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.073574 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c030fc65874a7c772d68e10113850d5a95f77476b2da9ca42ff30ea6119a09c2" Jul 30 22:54:18.075368 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.075345 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" event={"ID":"d3971d5a-14ae-4a2a-ae0f-6a178f914ca1","Type":"ContainerDied","Data":"22dcebf63c8dc29d3d443ae1ec7e1d00c03bffdf8d57fdf480de1a9270e71888"} Jul 30 22:54:18.075469 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.075382 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22dcebf63c8dc29d3d443ae1ec7e1d00c03bffdf8d57fdf480de1a9270e71888" Jul 30 22:54:18.075469 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.075383 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053gvxzj" Jul 30 22:54:18.195529 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.195507 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" Jul 30 22:54:18.334588 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.334503 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-util\") pod \"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2\" (UID: \"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2\") " Jul 30 22:54:18.334801 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.334598 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-bundle\") pod \"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2\" (UID: \"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2\") " Jul 30 22:54:18.334801 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.334622 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gcd7\" (UniqueName: \"kubernetes.io/projected/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-kube-api-access-4gcd7\") pod \"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2\" (UID: \"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2\") " Jul 30 22:54:18.335183 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.335156 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-bundle" (OuterVolumeSpecName: "bundle") pod "cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2" (UID: "cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:54:18.336845 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.336819 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-kube-api-access-4gcd7" (OuterVolumeSpecName: "kube-api-access-4gcd7") pod "cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2" (UID: "cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2"). InnerVolumeSpecName "kube-api-access-4gcd7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 22:54:18.340304 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.340285 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-util" (OuterVolumeSpecName: "util") pod "cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2" (UID: "cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 22:54:18.435542 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.435511 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-util\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:18.435542 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.435537 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:18.435542 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:18.435550 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gcd7\" (UniqueName: \"kubernetes.io/projected/cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2-kube-api-access-4gcd7\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:19.081573 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:19.081547 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" Jul 30 22:54:19.081573 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:19.081564 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbh2ccv" event={"ID":"cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2","Type":"ContainerDied","Data":"4b1caf249ebdd445f3712decb62624e712e58053a4cf8eeac6a2a9e5a572e0bb"} Jul 30 22:54:19.082005 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:19.081608 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b1caf249ebdd445f3712decb62624e712e58053a4cf8eeac6a2a9e5a572e0bb" Jul 30 22:54:21.000180 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.000129 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56c7f7bbd5-25942" podUID="a40f5aa1-838a-46b2-8169-c9f3015a582c" containerName="console" containerID="cri-o://3514e728ee9a294ec6aee872f1098b6e929e7f682ed14ccbc1a695c7a2afb84d" gracePeriod=15 Jul 30 22:54:21.253350 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.253282 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:54:21.362937 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.362906 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-oauth-config\") pod \"a40f5aa1-838a-46b2-8169-c9f3015a582c\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " Jul 30 22:54:21.363119 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.362959 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-service-ca\") pod \"a40f5aa1-838a-46b2-8169-c9f3015a582c\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " Jul 30 22:54:21.363119 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.362987 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-serving-cert\") pod \"a40f5aa1-838a-46b2-8169-c9f3015a582c\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " Jul 30 22:54:21.363119 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.363021 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7ld6\" (UniqueName: \"kubernetes.io/projected/a40f5aa1-838a-46b2-8169-c9f3015a582c-kube-api-access-w7ld6\") pod \"a40f5aa1-838a-46b2-8169-c9f3015a582c\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " Jul 30 22:54:21.363119 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.363114 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-oauth-serving-cert\") pod \"a40f5aa1-838a-46b2-8169-c9f3015a582c\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " Jul 30 22:54:21.363334 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.363227 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-config\") pod \"a40f5aa1-838a-46b2-8169-c9f3015a582c\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " Jul 30 22:54:21.363334 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.363254 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-trusted-ca-bundle\") pod \"a40f5aa1-838a-46b2-8169-c9f3015a582c\" (UID: \"a40f5aa1-838a-46b2-8169-c9f3015a582c\") " Jul 30 22:54:21.363448 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.363418 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-service-ca" (OuterVolumeSpecName: "service-ca") pod "a40f5aa1-838a-46b2-8169-c9f3015a582c" (UID: "a40f5aa1-838a-46b2-8169-c9f3015a582c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:54:21.363512 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.363476 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a40f5aa1-838a-46b2-8169-c9f3015a582c" (UID: "a40f5aa1-838a-46b2-8169-c9f3015a582c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:54:21.363565 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.363549 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-service-ca\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:21.363692 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.363647 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-config" (OuterVolumeSpecName: "console-config") pod "a40f5aa1-838a-46b2-8169-c9f3015a582c" (UID: "a40f5aa1-838a-46b2-8169-c9f3015a582c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:54:21.363815 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.363714 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a40f5aa1-838a-46b2-8169-c9f3015a582c" (UID: "a40f5aa1-838a-46b2-8169-c9f3015a582c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 22:54:21.365144 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.365121 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a40f5aa1-838a-46b2-8169-c9f3015a582c" (UID: "a40f5aa1-838a-46b2-8169-c9f3015a582c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 22:54:21.365252 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.365208 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a40f5aa1-838a-46b2-8169-c9f3015a582c" (UID: "a40f5aa1-838a-46b2-8169-c9f3015a582c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 22:54:21.365319 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.365274 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a40f5aa1-838a-46b2-8169-c9f3015a582c-kube-api-access-w7ld6" (OuterVolumeSpecName: "kube-api-access-w7ld6") pod "a40f5aa1-838a-46b2-8169-c9f3015a582c" (UID: "a40f5aa1-838a-46b2-8169-c9f3015a582c"). InnerVolumeSpecName "kube-api-access-w7ld6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 22:54:21.464005 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.463972 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-config\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:21.464005 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.464003 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-trusted-ca-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:21.464005 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.464016 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-oauth-config\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:21.464228 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.464024 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a40f5aa1-838a-46b2-8169-c9f3015a582c-console-serving-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:21.464228 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.464033 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7ld6\" (UniqueName: \"kubernetes.io/projected/a40f5aa1-838a-46b2-8169-c9f3015a582c-kube-api-access-w7ld6\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:21.464228 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:21.464043 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a40f5aa1-838a-46b2-8169-c9f3015a582c-oauth-serving-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 22:54:22.098471 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:22.098438 2576 generic.go:356] "Generic (PLEG): container finished" podID="a40f5aa1-838a-46b2-8169-c9f3015a582c" containerID="3514e728ee9a294ec6aee872f1098b6e929e7f682ed14ccbc1a695c7a2afb84d" exitCode=0 Jul 30 22:54:22.098900 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:22.098475 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c7f7bbd5-25942" event={"ID":"a40f5aa1-838a-46b2-8169-c9f3015a582c","Type":"ContainerDied","Data":"3514e728ee9a294ec6aee872f1098b6e929e7f682ed14ccbc1a695c7a2afb84d"} Jul 30 22:54:22.098900 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:22.098484 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c7f7bbd5-25942" Jul 30 22:54:22.098900 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:22.098517 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c7f7bbd5-25942" event={"ID":"a40f5aa1-838a-46b2-8169-c9f3015a582c","Type":"ContainerDied","Data":"2aace4a6edd2402f7a2b96918668670c3fa58a417c5fc645e1d2f982319cd2b2"} Jul 30 22:54:22.098900 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:22.098537 2576 scope.go:117] "RemoveContainer" containerID="3514e728ee9a294ec6aee872f1098b6e929e7f682ed14ccbc1a695c7a2afb84d" Jul 30 22:54:22.107571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:22.107555 2576 scope.go:117] "RemoveContainer" containerID="3514e728ee9a294ec6aee872f1098b6e929e7f682ed14ccbc1a695c7a2afb84d" Jul 30 22:54:22.107820 ip-10-0-142-10 kubenswrapper[2576]: E0730 22:54:22.107803 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3514e728ee9a294ec6aee872f1098b6e929e7f682ed14ccbc1a695c7a2afb84d\": container with ID starting with 3514e728ee9a294ec6aee872f1098b6e929e7f682ed14ccbc1a695c7a2afb84d not found: ID does not exist" containerID="3514e728ee9a294ec6aee872f1098b6e929e7f682ed14ccbc1a695c7a2afb84d" Jul 30 22:54:22.107889 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:22.107828 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3514e728ee9a294ec6aee872f1098b6e929e7f682ed14ccbc1a695c7a2afb84d"} err="failed to get container status \"3514e728ee9a294ec6aee872f1098b6e929e7f682ed14ccbc1a695c7a2afb84d\": rpc error: code = NotFound desc = could not find container \"3514e728ee9a294ec6aee872f1098b6e929e7f682ed14ccbc1a695c7a2afb84d\": container with ID starting with 3514e728ee9a294ec6aee872f1098b6e929e7f682ed14ccbc1a695c7a2afb84d not found: ID does not exist" Jul 30 22:54:22.120019 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:22.119996 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56c7f7bbd5-25942"] Jul 30 22:54:22.123783 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:22.123764 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56c7f7bbd5-25942"] Jul 30 22:54:23.235750 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:54:23.235708 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a40f5aa1-838a-46b2-8169-c9f3015a582c" path="/var/lib/kubelet/pods/a40f5aa1-838a-46b2-8169-c9f3015a582c/volumes" Jul 30 22:55:23.586141 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586047 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs"] Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586428 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fec0f3f0-112d-4c5c-aa75-814c73000cc7" containerName="extract" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586441 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec0f3f0-112d-4c5c-aa75-814c73000cc7" containerName="extract" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586452 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2" containerName="pull" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586458 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2" containerName="pull" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586464 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a40f5aa1-838a-46b2-8169-c9f3015a582c" containerName="console" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586470 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a40f5aa1-838a-46b2-8169-c9f3015a582c" containerName="console" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586479 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73051942-e98b-4ddd-b22b-eac4e3cf59d4" containerName="pull" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586484 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="73051942-e98b-4ddd-b22b-eac4e3cf59d4" containerName="pull" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586491 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2" containerName="extract" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586496 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2" containerName="extract" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586505 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fec0f3f0-112d-4c5c-aa75-814c73000cc7" containerName="pull" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586510 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec0f3f0-112d-4c5c-aa75-814c73000cc7" containerName="pull" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586519 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73051942-e98b-4ddd-b22b-eac4e3cf59d4" containerName="extract" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586524 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="73051942-e98b-4ddd-b22b-eac4e3cf59d4" containerName="extract" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586531 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fec0f3f0-112d-4c5c-aa75-814c73000cc7" containerName="util" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586536 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec0f3f0-112d-4c5c-aa75-814c73000cc7" containerName="util" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586543 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3971d5a-14ae-4a2a-ae0f-6a178f914ca1" containerName="extract" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586548 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3971d5a-14ae-4a2a-ae0f-6a178f914ca1" containerName="extract" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586555 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73051942-e98b-4ddd-b22b-eac4e3cf59d4" containerName="util" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586560 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="73051942-e98b-4ddd-b22b-eac4e3cf59d4" containerName="util" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586567 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3971d5a-14ae-4a2a-ae0f-6a178f914ca1" containerName="pull" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586571 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3971d5a-14ae-4a2a-ae0f-6a178f914ca1" containerName="pull" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586577 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3971d5a-14ae-4a2a-ae0f-6a178f914ca1" containerName="util" Jul 30 22:55:23.586571 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586583 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3971d5a-14ae-4a2a-ae0f-6a178f914ca1" containerName="util" Jul 30 22:55:23.587371 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586588 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2" containerName="util" Jul 30 22:55:23.587371 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586593 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2" containerName="util" Jul 30 22:55:23.587371 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586642 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3971d5a-14ae-4a2a-ae0f-6a178f914ca1" containerName="extract" Jul 30 22:55:23.587371 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586650 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a40f5aa1-838a-46b2-8169-c9f3015a582c" containerName="console" Jul 30 22:55:23.587371 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586656 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fec0f3f0-112d-4c5c-aa75-814c73000cc7" containerName="extract" Jul 30 22:55:23.587371 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586663 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="73051942-e98b-4ddd-b22b-eac4e3cf59d4" containerName="extract" Jul 30 22:55:23.587371 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.586669 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cecf91e7-767f-4bd8-88ac-8f96a0e4f9f2" containerName="extract" Jul 30 22:55:23.589664 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.589649 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.592052 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.592030 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fvfvr\"" Jul 30 22:55:23.599674 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.599651 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs"] Jul 30 22:55:23.683635 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.683605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b366a1b-5028-41fa-ac92-b15b8c494863-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.683794 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.683643 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b366a1b-5028-41fa-ac92-b15b8c494863-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.683794 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.683708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b366a1b-5028-41fa-ac92-b15b8c494863-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.683794 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.683754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b366a1b-5028-41fa-ac92-b15b8c494863-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.683794 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.683781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b366a1b-5028-41fa-ac92-b15b8c494863-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.683968 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.683803 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx7cw\" (UniqueName: \"kubernetes.io/projected/4b366a1b-5028-41fa-ac92-b15b8c494863-kube-api-access-xx7cw\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.683968 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.683839 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b366a1b-5028-41fa-ac92-b15b8c494863-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.683968 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.683904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b366a1b-5028-41fa-ac92-b15b8c494863-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.683968 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.683928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b366a1b-5028-41fa-ac92-b15b8c494863-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.785334 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.785291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b366a1b-5028-41fa-ac92-b15b8c494863-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.785334 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.785337 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b366a1b-5028-41fa-ac92-b15b8c494863-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.785520 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.785357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b366a1b-5028-41fa-ac92-b15b8c494863-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.785520 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.785378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b366a1b-5028-41fa-ac92-b15b8c494863-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.785520 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.785424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b366a1b-5028-41fa-ac92-b15b8c494863-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.785520 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.785467 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx7cw\" (UniqueName: \"kubernetes.io/projected/4b366a1b-5028-41fa-ac92-b15b8c494863-kube-api-access-xx7cw\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.785520 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.785511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b366a1b-5028-41fa-ac92-b15b8c494863-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.785762 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.785536 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b366a1b-5028-41fa-ac92-b15b8c494863-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.785827 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.785766 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b366a1b-5028-41fa-ac92-b15b8c494863-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.785827 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.785804 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b366a1b-5028-41fa-ac92-b15b8c494863-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.785978 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.785811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b366a1b-5028-41fa-ac92-b15b8c494863-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.785978 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.785853 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b366a1b-5028-41fa-ac92-b15b8c494863-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.785978 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.785894 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b366a1b-5028-41fa-ac92-b15b8c494863-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.786374 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.786357 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b366a1b-5028-41fa-ac92-b15b8c494863-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.787645 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.787619 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b366a1b-5028-41fa-ac92-b15b8c494863-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.787956 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.787940 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b366a1b-5028-41fa-ac92-b15b8c494863-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.793350 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.793321 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b366a1b-5028-41fa-ac92-b15b8c494863-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.793604 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.793584 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx7cw\" (UniqueName: \"kubernetes.io/projected/4b366a1b-5028-41fa-ac92-b15b8c494863-kube-api-access-xx7cw\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fkxvs\" (UID: \"4b366a1b-5028-41fa-ac92-b15b8c494863\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:23.901068 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:23.901033 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:24.031585 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:24.031550 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs"] Jul 30 22:55:24.054241 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:55:24.054212 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b366a1b_5028_41fa_ac92_b15b8c494863.slice/crio-ff1e373ba84a4e791c40e920edd7cefa63297286f65ec3a80cc494f6c4341499 WatchSource:0}: Error finding container ff1e373ba84a4e791c40e920edd7cefa63297286f65ec3a80cc494f6c4341499: Status 404 returned error can't find the container with id ff1e373ba84a4e791c40e920edd7cefa63297286f65ec3a80cc494f6c4341499 Jul 30 22:55:24.056421 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:24.056390 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 22:55:24.056495 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:24.056460 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 22:55:24.056532 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:24.056492 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 22:55:24.403542 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:24.403505 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" event={"ID":"4b366a1b-5028-41fa-ac92-b15b8c494863","Type":"ContainerStarted","Data":"fe91e17ee9aa2c16abadaab27f03466aa4c3b2e7e68a231fad264fbfdbc8f4ac"} Jul 30 22:55:24.403752 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:24.403558 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" event={"ID":"4b366a1b-5028-41fa-ac92-b15b8c494863","Type":"ContainerStarted","Data":"ff1e373ba84a4e791c40e920edd7cefa63297286f65ec3a80cc494f6c4341499"} Jul 30 22:55:24.424453 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:24.424390 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" podStartSLOduration=1.4243740520000001 podStartE2EDuration="1.424374052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:55:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:55:24.42168202 +0000 UTC m=+451.625501257" watchObservedRunningTime="2026-07-30 22:55:24.424374052 +0000 UTC m=+451.628193286" Jul 30 22:55:24.902093 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:24.902063 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:25.906338 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:25.906309 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:26.412694 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:26.412663 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:55:26.413551 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:55:26.413533 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:57:03.899017 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:03.898981 2576 generic.go:356] "Generic (PLEG): container finished" podID="4b366a1b-5028-41fa-ac92-b15b8c494863" containerID="fe91e17ee9aa2c16abadaab27f03466aa4c3b2e7e68a231fad264fbfdbc8f4ac" exitCode=0 Jul 30 22:57:03.899550 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:03.899059 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" event={"ID":"4b366a1b-5028-41fa-ac92-b15b8c494863","Type":"ContainerDied","Data":"fe91e17ee9aa2c16abadaab27f03466aa4c3b2e7e68a231fad264fbfdbc8f4ac"} Jul 30 22:57:03.899615 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:03.899580 2576 scope.go:117] "RemoveContainer" containerID="fe91e17ee9aa2c16abadaab27f03466aa4c3b2e7e68a231fad264fbfdbc8f4ac" Jul 30 22:57:03.900596 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:03.900571 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 22:57:03.900694 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:03.900638 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 22:57:03.900752 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:03.900709 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 22:57:04.906152 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:04.906115 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" event={"ID":"4b366a1b-5028-41fa-ac92-b15b8c494863","Type":"ContainerStarted","Data":"dbc4738194a6c224fa0c07b879f9890679811ef56e48f18a2fbccaf212fd0671"} Jul 30 22:57:05.901234 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:05.901199 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:57:05.901412 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:05.901393 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fkxvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 30 22:57:05.901467 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:05.901448 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" podUID="4b366a1b-5028-41fa-ac92-b15b8c494863" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 30 22:57:06.902361 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:06.902322 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fkxvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 30 22:57:06.902759 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:06.902380 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" podUID="4b366a1b-5028-41fa-ac92-b15b8c494863" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 30 22:57:07.901708 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:07.901670 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fkxvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 30 22:57:07.901942 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:07.901734 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" podUID="4b366a1b-5028-41fa-ac92-b15b8c494863" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 30 22:57:08.901762 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:08.901725 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fkxvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 30 22:57:08.902188 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:08.901791 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" podUID="4b366a1b-5028-41fa-ac92-b15b8c494863" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 30 22:57:09.902066 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:09.902030 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fkxvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 30 22:57:09.902470 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:09.902082 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" podUID="4b366a1b-5028-41fa-ac92-b15b8c494863" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 30 22:57:10.905046 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:10.905016 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:57:10.905451 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:10.905357 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:57:10.906130 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:10.906110 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fkxvs" Jul 30 22:57:32.136042 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.136011 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5"] Jul 30 22:57:32.139438 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.139417 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.143057 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.143032 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 30 22:57:32.143191 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.143033 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mkjq5\"" Jul 30 22:57:32.143191 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.143074 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 30 22:57:32.143191 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.143077 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 30 22:57:32.148929 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.148847 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5"] Jul 30 22:57:32.168941 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.168907 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f97bce20-d4cb-4556-ba08-5954c9c14ae1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.169125 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.168982 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f97bce20-d4cb-4556-ba08-5954c9c14ae1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.169125 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.169071 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwrtg\" (UniqueName: \"kubernetes.io/projected/f97bce20-d4cb-4556-ba08-5954c9c14ae1-kube-api-access-nwrtg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.169125 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.169109 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f97bce20-d4cb-4556-ba08-5954c9c14ae1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.169251 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.169180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f97bce20-d4cb-4556-ba08-5954c9c14ae1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.169251 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.169208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f97bce20-d4cb-4556-ba08-5954c9c14ae1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.270061 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.269974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwrtg\" (UniqueName: \"kubernetes.io/projected/f97bce20-d4cb-4556-ba08-5954c9c14ae1-kube-api-access-nwrtg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.270061 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.270019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f97bce20-d4cb-4556-ba08-5954c9c14ae1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.270061 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.270061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f97bce20-d4cb-4556-ba08-5954c9c14ae1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.270334 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.270080 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f97bce20-d4cb-4556-ba08-5954c9c14ae1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.270334 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.270110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f97bce20-d4cb-4556-ba08-5954c9c14ae1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.270334 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.270175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f97bce20-d4cb-4556-ba08-5954c9c14ae1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.270551 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.270524 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f97bce20-d4cb-4556-ba08-5954c9c14ae1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.270604 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.270554 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f97bce20-d4cb-4556-ba08-5954c9c14ae1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.270604 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.270595 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f97bce20-d4cb-4556-ba08-5954c9c14ae1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.272428 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.272407 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f97bce20-d4cb-4556-ba08-5954c9c14ae1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.272589 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.272573 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f97bce20-d4cb-4556-ba08-5954c9c14ae1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.277666 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.277646 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwrtg\" (UniqueName: \"kubernetes.io/projected/f97bce20-d4cb-4556-ba08-5954c9c14ae1-kube-api-access-nwrtg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f84n5\" (UID: \"f97bce20-d4cb-4556-ba08-5954c9c14ae1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.450871 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.450830 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:32.581057 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:32.581030 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5"] Jul 30 22:57:32.583083 ip-10-0-142-10 kubenswrapper[2576]: W0730 22:57:32.583058 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf97bce20_d4cb_4556_ba08_5954c9c14ae1.slice/crio-e0cff5929c92578517be0486ed40d3609f441d770f055f400f18478900ff972a WatchSource:0}: Error finding container e0cff5929c92578517be0486ed40d3609f441d770f055f400f18478900ff972a: Status 404 returned error can't find the container with id e0cff5929c92578517be0486ed40d3609f441d770f055f400f18478900ff972a Jul 30 22:57:33.048057 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:33.048014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" event={"ID":"f97bce20-d4cb-4556-ba08-5954c9c14ae1","Type":"ContainerStarted","Data":"e0cff5929c92578517be0486ed40d3609f441d770f055f400f18478900ff972a"} Jul 30 22:57:34.054288 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:34.054202 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" event={"ID":"f97bce20-d4cb-4556-ba08-5954c9c14ae1","Type":"ContainerStarted","Data":"7a59c5dc29db9e77d91de0364f285dce7442e3129ebba8c8f6a8cf30c086f767"} Jul 30 22:57:34.071918 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:34.071853 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" podStartSLOduration=1.029673059 podStartE2EDuration="2.071836766s" totalImagesPullingTime="1.042163707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:57:34.069721493 +0000 UTC m=+581.273540721" watchObservedRunningTime="2026-07-30 22:57:34.071836766 +0000 UTC m=+581.275656030" Jul 30 22:57:42.451794 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:42.451757 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:42.452199 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:42.451826 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:42.464272 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:42.464248 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:43.108805 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:43.108778 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f84n5" Jul 30 22:57:53.163678 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:53.163648 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 22:57:53.164122 ip-10-0-142-10 kubenswrapper[2576]: I0730 22:57:53.164002 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:00:00.141613 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:00:00.141582 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757540-gqp9w"] Jul 30 23:00:00.144795 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:00:00.144778 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757540-gqp9w" Jul 30 23:00:00.147230 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:00:00.147206 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52wcc\"" Jul 30 23:00:00.152347 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:00:00.152324 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757540-gqp9w"] Jul 30 23:00:00.156048 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:00:00.156028 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757540-gqp9w" Jul 30 23:00:00.287086 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:00:00.287059 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757540-gqp9w"] Jul 30 23:00:00.288892 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:00:00.288840 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21fffb06_bb24_492a_b175_a85e7db1a530.slice/crio-79d53ce688a8fc40638f27d94d42f82773f542f087d0b7265f82b50abdb0c216 WatchSource:0}: Error finding container 79d53ce688a8fc40638f27d94d42f82773f542f087d0b7265f82b50abdb0c216: Status 404 returned error can't find the container with id 79d53ce688a8fc40638f27d94d42f82773f542f087d0b7265f82b50abdb0c216 Jul 30 23:00:00.290723 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:00:00.290706 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 23:00:00.783214 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:00:00.783183 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757540-gqp9w" event={"ID":"21fffb06-bb24-492a-b175-a85e7db1a530","Type":"ContainerStarted","Data":"79d53ce688a8fc40638f27d94d42f82773f542f087d0b7265f82b50abdb0c216"} Jul 30 23:00:03.801093 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:00:03.801056 2576 generic.go:356] "Generic (PLEG): container finished" podID="21fffb06-bb24-492a-b175-a85e7db1a530" containerID="2fedf2c38f06fdde053f1b070bf78344fe5a4f921eb2f19b4d4289efc689a8ce" exitCode=0 Jul 30 23:00:03.801525 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:00:03.801123 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757540-gqp9w" event={"ID":"21fffb06-bb24-492a-b175-a85e7db1a530","Type":"ContainerDied","Data":"2fedf2c38f06fdde053f1b070bf78344fe5a4f921eb2f19b4d4289efc689a8ce"} Jul 30 23:00:04.933674 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:00:04.933647 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757540-gqp9w" Jul 30 23:00:05.811488 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:00:05.811451 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757540-gqp9w" event={"ID":"21fffb06-bb24-492a-b175-a85e7db1a530","Type":"ContainerDied","Data":"79d53ce688a8fc40638f27d94d42f82773f542f087d0b7265f82b50abdb0c216"} Jul 30 23:00:05.811488 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:00:05.811490 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757540-gqp9w" Jul 30 23:00:05.811703 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:00:05.811507 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79d53ce688a8fc40638f27d94d42f82773f542f087d0b7265f82b50abdb0c216" Jul 30 23:02:53.196500 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:02:53.196471 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:02:53.198391 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:02:53.198372 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:07:53.228048 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:07:53.228018 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:07:53.230505 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:07:53.230482 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:12:53.260430 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:12:53.260398 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:12:53.264838 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:12:53.264813 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:15:00.144491 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:15:00.144455 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757555-s9fpq"] Jul 30 23:15:00.144981 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:15:00.144775 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21fffb06-bb24-492a-b175-a85e7db1a530" containerName="cleanup" Jul 30 23:15:00.144981 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:15:00.144785 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="21fffb06-bb24-492a-b175-a85e7db1a530" containerName="cleanup" Jul 30 23:15:00.144981 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:15:00.144874 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="21fffb06-bb24-492a-b175-a85e7db1a530" containerName="cleanup" Jul 30 23:15:00.147668 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:15:00.147650 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757555-s9fpq" Jul 30 23:15:00.150354 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:15:00.150336 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52wcc\"" Jul 30 23:15:00.157338 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:15:00.157321 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757555-s9fpq" Jul 30 23:15:00.171184 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:15:00.171154 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757555-s9fpq"] Jul 30 23:15:00.296493 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:15:00.296460 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757555-s9fpq"] Jul 30 23:15:00.298621 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:15:00.298596 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f7a2294_6c22_4e11_9bef_3c987e492873.slice/crio-f57b0ce4e83ce11585c22f8d25575a73e79590e5bfabe7b3cd0693e6924d4be1 WatchSource:0}: Error finding container f57b0ce4e83ce11585c22f8d25575a73e79590e5bfabe7b3cd0693e6924d4be1: Status 404 returned error can't find the container with id f57b0ce4e83ce11585c22f8d25575a73e79590e5bfabe7b3cd0693e6924d4be1 Jul 30 23:15:01.259723 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:15:01.259686 2576 generic.go:356] "Generic (PLEG): container finished" podID="2f7a2294-6c22-4e11-9bef-3c987e492873" containerID="7bcbba4316b546d6f4827c158360eae1ec0c7daa585047d50dfc15fdb9bbe7bc" exitCode=0 Jul 30 23:15:01.260140 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:15:01.259773 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757555-s9fpq" event={"ID":"2f7a2294-6c22-4e11-9bef-3c987e492873","Type":"ContainerDied","Data":"7bcbba4316b546d6f4827c158360eae1ec0c7daa585047d50dfc15fdb9bbe7bc"} Jul 30 23:15:01.260140 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:15:01.259823 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757555-s9fpq" event={"ID":"2f7a2294-6c22-4e11-9bef-3c987e492873","Type":"ContainerStarted","Data":"f57b0ce4e83ce11585c22f8d25575a73e79590e5bfabe7b3cd0693e6924d4be1"} Jul 30 23:15:02.389150 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:15:02.389121 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757555-s9fpq" Jul 30 23:15:03.272054 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:15:03.272030 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757555-s9fpq" Jul 30 23:15:03.272199 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:15:03.272031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757555-s9fpq" event={"ID":"2f7a2294-6c22-4e11-9bef-3c987e492873","Type":"ContainerDied","Data":"f57b0ce4e83ce11585c22f8d25575a73e79590e5bfabe7b3cd0693e6924d4be1"} Jul 30 23:15:03.272199 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:15:03.272146 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f57b0ce4e83ce11585c22f8d25575a73e79590e5bfabe7b3cd0693e6924d4be1" Jul 30 23:16:35.271534 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.271457 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4"] Jul 30 23:16:35.272030 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.272011 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f7a2294-6c22-4e11-9bef-3c987e492873" containerName="cleanup" Jul 30 23:16:35.272078 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.272035 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f7a2294-6c22-4e11-9bef-3c987e492873" containerName="cleanup" Jul 30 23:16:35.272145 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.272129 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f7a2294-6c22-4e11-9bef-3c987e492873" containerName="cleanup" Jul 30 23:16:35.275332 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.275314 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.277987 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.277966 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c86f68a7-openshift-default-dockercfg-6kt59\"" Jul 30 23:16:35.295025 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.295002 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4"] Jul 30 23:16:35.423565 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.423521 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-data\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.423744 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.423587 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-podinfo\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.423744 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.423622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istiod-ca-cert\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.423744 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.423645 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-credential-socket\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.423744 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.423714 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-envoy\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.423909 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.423801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mpnm\" (UniqueName: \"kubernetes.io/projected/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-kube-api-access-4mpnm\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.423909 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.423889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-workload-socket\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.423979 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.423941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-token\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.424021 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.424007 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-workload-certs\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.525493 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.525407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-credential-socket\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.525493 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.525466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-envoy\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.525493 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.525482 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mpnm\" (UniqueName: \"kubernetes.io/projected/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-kube-api-access-4mpnm\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.525769 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.525512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-workload-socket\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.525769 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.525533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-token\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.525769 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.525562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-workload-certs\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.525769 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.525598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-data\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.525769 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.525639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-podinfo\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.525769 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.525669 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istiod-ca-cert\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.526139 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.525852 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-credential-socket\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.526139 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.525965 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-workload-socket\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.526139 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.526092 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-workload-certs\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.526139 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.526103 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-data\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.526368 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.526350 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istiod-ca-cert\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.527895 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.527870 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-envoy\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.528132 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.528112 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-podinfo\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.535091 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.535069 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-token\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.535183 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.535095 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mpnm\" (UniqueName: \"kubernetes.io/projected/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-kube-api-access-4mpnm\") pod \"e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.585919 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.585882 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:35.723555 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.721532 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4"] Jul 30 23:16:35.725191 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:16:35.725147 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f33d3bf_d617_48e8_8a1f_07fc8d2e042c.slice/crio-eb98eb8a6044495ca13a52c97181ffa3aa647c2274ce7adab048fcc484a50d44 WatchSource:0}: Error finding container eb98eb8a6044495ca13a52c97181ffa3aa647c2274ce7adab048fcc484a50d44: Status 404 returned error can't find the container with id eb98eb8a6044495ca13a52c97181ffa3aa647c2274ce7adab048fcc484a50d44 Jul 30 23:16:35.727160 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.727128 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:16:35.727235 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.727193 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:16:35.727235 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:35.727226 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:16:36.735793 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:36.735755 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" event={"ID":"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c","Type":"ContainerStarted","Data":"fbc4e9d33debbf7730d09fb7742c0d954cc8bd3698f78bdf2155d2915384f9c8"} Jul 30 23:16:36.736197 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:36.735825 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" event={"ID":"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c","Type":"ContainerStarted","Data":"eb98eb8a6044495ca13a52c97181ffa3aa647c2274ce7adab048fcc484a50d44"} Jul 30 23:16:36.757265 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:36.757215 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" podStartSLOduration=1.757200216 podStartE2EDuration="1.757200216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:16:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:16:36.755585149 +0000 UTC m=+1723.959404427" watchObservedRunningTime="2026-07-30 23:16:36.757200216 +0000 UTC m=+1723.961019450" Jul 30 23:16:37.586553 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:37.586515 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:37.591615 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:37.591591 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:37.740977 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:37.740943 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:37.741982 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:37.741962 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:39.962786 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:39.962744 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm"] Jul 30 23:16:39.966074 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:39.966059 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" Jul 30 23:16:39.968669 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:39.968648 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c86f68a7-dockercfg-2mxsh\"" Jul 30 23:16:39.969143 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:39.969126 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c86f68a7\"" Jul 30 23:16:39.980443 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:39.980424 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm"] Jul 30 23:16:40.023724 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.023693 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4"] Jul 30 23:16:40.027014 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.026993 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" Jul 30 23:16:40.037402 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.037377 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4"] Jul 30 23:16:40.060607 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.060581 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-425c8\" (UniqueName: \"kubernetes.io/projected/de183ee6-7254-4d16-b9f5-fe36dea52219-kube-api-access-425c8\") pod \"payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm\" (UID: \"de183ee6-7254-4d16-b9f5-fe36dea52219\") " pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" Jul 30 23:16:40.060733 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.060635 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h427x\" (UniqueName: \"kubernetes.io/projected/daa4bb6f-a8a8-404f-b54d-2b84672dd28e-kube-api-access-h427x\") pod \"payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4\" (UID: \"daa4bb6f-a8a8-404f-b54d-2b84672dd28e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" Jul 30 23:16:40.060733 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.060716 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/daa4bb6f-a8a8-404f-b54d-2b84672dd28e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4\" (UID: \"daa4bb6f-a8a8-404f-b54d-2b84672dd28e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" Jul 30 23:16:40.060878 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.060792 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de183ee6-7254-4d16-b9f5-fe36dea52219-plugins-config-volume\") pod \"payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm\" (UID: \"de183ee6-7254-4d16-b9f5-fe36dea52219\") " pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" Jul 30 23:16:40.162093 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.162049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de183ee6-7254-4d16-b9f5-fe36dea52219-plugins-config-volume\") pod \"payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm\" (UID: \"de183ee6-7254-4d16-b9f5-fe36dea52219\") " pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" Jul 30 23:16:40.162312 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.162108 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-425c8\" (UniqueName: \"kubernetes.io/projected/de183ee6-7254-4d16-b9f5-fe36dea52219-kube-api-access-425c8\") pod \"payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm\" (UID: \"de183ee6-7254-4d16-b9f5-fe36dea52219\") " pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" Jul 30 23:16:40.162312 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.162189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h427x\" (UniqueName: \"kubernetes.io/projected/daa4bb6f-a8a8-404f-b54d-2b84672dd28e-kube-api-access-h427x\") pod \"payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4\" (UID: \"daa4bb6f-a8a8-404f-b54d-2b84672dd28e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" Jul 30 23:16:40.162312 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.162244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/daa4bb6f-a8a8-404f-b54d-2b84672dd28e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4\" (UID: \"daa4bb6f-a8a8-404f-b54d-2b84672dd28e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" Jul 30 23:16:40.162985 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.162962 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de183ee6-7254-4d16-b9f5-fe36dea52219-plugins-config-volume\") pod \"payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm\" (UID: \"de183ee6-7254-4d16-b9f5-fe36dea52219\") " pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" Jul 30 23:16:40.162985 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.162981 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/daa4bb6f-a8a8-404f-b54d-2b84672dd28e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4\" (UID: \"daa4bb6f-a8a8-404f-b54d-2b84672dd28e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" Jul 30 23:16:40.170161 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.170134 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-425c8\" (UniqueName: \"kubernetes.io/projected/de183ee6-7254-4d16-b9f5-fe36dea52219-kube-api-access-425c8\") pod \"payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm\" (UID: \"de183ee6-7254-4d16-b9f5-fe36dea52219\") " pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" Jul 30 23:16:40.170256 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.170238 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h427x\" (UniqueName: \"kubernetes.io/projected/daa4bb6f-a8a8-404f-b54d-2b84672dd28e-kube-api-access-h427x\") pod \"payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4\" (UID: \"daa4bb6f-a8a8-404f-b54d-2b84672dd28e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" Jul 30 23:16:40.277027 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.276954 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" Jul 30 23:16:40.338396 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.338368 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" Jul 30 23:16:40.413985 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.413953 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm"] Jul 30 23:16:40.417209 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:16:40.417180 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde183ee6_7254_4d16_b9f5_fe36dea52219.slice/crio-2bc51adbf0825836f8649ecdc6e2d5d5993a411a41632fe9751257edcfd2bf0c WatchSource:0}: Error finding container 2bc51adbf0825836f8649ecdc6e2d5d5993a411a41632fe9751257edcfd2bf0c: Status 404 returned error can't find the container with id 2bc51adbf0825836f8649ecdc6e2d5d5993a411a41632fe9751257edcfd2bf0c Jul 30 23:16:40.419901 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.419883 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 23:16:40.471840 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.471819 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4"] Jul 30 23:16:40.472879 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:16:40.472842 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa4bb6f_a8a8_404f_b54d_2b84672dd28e.slice/crio-805ff3b06f710ba0aa921919b335a2c1dfe8e4908323a1dc1794c77b31404e48 WatchSource:0}: Error finding container 805ff3b06f710ba0aa921919b335a2c1dfe8e4908323a1dc1794c77b31404e48: Status 404 returned error can't find the container with id 805ff3b06f710ba0aa921919b335a2c1dfe8e4908323a1dc1794c77b31404e48 Jul 30 23:16:40.756616 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.756580 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" event={"ID":"de183ee6-7254-4d16-b9f5-fe36dea52219","Type":"ContainerStarted","Data":"2bc51adbf0825836f8649ecdc6e2d5d5993a411a41632fe9751257edcfd2bf0c"} Jul 30 23:16:40.757702 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:40.757673 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" event={"ID":"daa4bb6f-a8a8-404f-b54d-2b84672dd28e","Type":"ContainerStarted","Data":"805ff3b06f710ba0aa921919b335a2c1dfe8e4908323a1dc1794c77b31404e48"} Jul 30 23:16:42.772444 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:42.772404 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" event={"ID":"de183ee6-7254-4d16-b9f5-fe36dea52219","Type":"ContainerStarted","Data":"4acdc021eb46334a4a4ecd8ce8f0c443646078c9f54b3e857b42301951571b5b"} Jul 30 23:16:42.772906 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:42.772504 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" Jul 30 23:16:42.773975 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:42.773953 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" event={"ID":"daa4bb6f-a8a8-404f-b54d-2b84672dd28e","Type":"ContainerStarted","Data":"f986e946859e346e1929612974f24b95c837f94b19b26685cea63d326ae24896"} Jul 30 23:16:42.774078 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:42.774051 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" Jul 30 23:16:42.788171 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:42.788122 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" podStartSLOduration=2.001053553 podStartE2EDuration="3.788105177s" totalImagesPullingTime="1.787051624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:16:42.787677307 +0000 UTC m=+1729.991496542" watchObservedRunningTime="2026-07-30 23:16:42.788105177 +0000 UTC m=+1729.991924412" Jul 30 23:16:42.803713 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:42.803675 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" podStartSLOduration=1.065491297 podStartE2EDuration="2.803661752s" totalImagesPullingTime="1.738170455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:16:42.801917171 +0000 UTC m=+1730.005736405" watchObservedRunningTime="2026-07-30 23:16:42.803661752 +0000 UTC m=+1730.007481033" Jul 30 23:16:52.742420 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:52.742383 2576 patch_prober.go:28] interesting pod/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 30 23:16:52.742831 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:52.742439 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" podUID="6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 30 23:16:52.834611 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:52.834577 2576 generic.go:356] "Generic (PLEG): container finished" podID="6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" containerID="fbc4e9d33debbf7730d09fb7742c0d954cc8bd3698f78bdf2155d2915384f9c8" exitCode=0 Jul 30 23:16:52.834784 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:52.834649 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" event={"ID":"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c","Type":"ContainerDied","Data":"fbc4e9d33debbf7730d09fb7742c0d954cc8bd3698f78bdf2155d2915384f9c8"} Jul 30 23:16:52.835086 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:52.835073 2576 scope.go:117] "RemoveContainer" containerID="fbc4e9d33debbf7730d09fb7742c0d954cc8bd3698f78bdf2155d2915384f9c8" Jul 30 23:16:52.836088 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:52.836059 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:16:52.836149 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:52.836128 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:16:52.836184 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:52.836164 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:16:53.781359 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:53.781314 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" Jul 30 23:16:53.781783 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:53.781628 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" Jul 30 23:16:53.865666 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:53.865626 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" event={"ID":"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c","Type":"ContainerStarted","Data":"4ef3986cd87baaa0ae8c6ef2e3f89a95f83fc519d9226c15d338549f8341ad7b"} Jul 30 23:16:54.586941 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:54.586907 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:54.587301 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:54.587279 2576 patch_prober.go:28] interesting pod/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 30 23:16:54.587399 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:54.587347 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" podUID="6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 30 23:16:55.586371 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:55.586334 2576 patch_prober.go:28] interesting pod/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 30 23:16:55.586769 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:55.586388 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" podUID="6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 30 23:16:56.586683 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:56.586645 2576 patch_prober.go:28] interesting pod/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 30 23:16:56.587131 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:56.586699 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" podUID="6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 30 23:16:57.586460 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:57.586421 2576 patch_prober.go:28] interesting pod/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 30 23:16:57.586671 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:57.586502 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" podUID="6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 30 23:16:58.587178 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:58.587134 2576 patch_prober.go:28] interesting pod/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 30 23:16:58.587596 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:58.587210 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" podUID="6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 30 23:16:59.590648 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:59.590617 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:59.591072 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:59.590977 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:16:59.591639 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:16:59.591620 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:17:03.796572 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:03.796539 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8"] Jul 30 23:17:03.798779 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:03.798762 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8" Jul 30 23:17:03.801242 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:03.801215 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52wcc\"" Jul 30 23:17:03.801378 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:03.801243 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 23:17:03.807347 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:03.807321 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8"] Jul 30 23:17:03.878716 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:03.878681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8\" (UID: \"9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8" Jul 30 23:17:03.979260 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:03.979229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8\" (UID: \"9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8" Jul 30 23:17:03.979809 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:03.979790 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8\" (UID: \"9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8" Jul 30 23:17:04.110675 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:04.110591 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8" Jul 30 23:17:04.445025 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:04.444999 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8"] Jul 30 23:17:04.446589 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:17:04.446564 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9db5e9f3_ac5e_46cb_8467_e32c3a47dbe9.slice/crio-3c35f5b937d4be6438f0f45134cc409674b8b10f53e038322bd64edbb7f5bb4d WatchSource:0}: Error finding container 3c35f5b937d4be6438f0f45134cc409674b8b10f53e038322bd64edbb7f5bb4d: Status 404 returned error can't find the container with id 3c35f5b937d4be6438f0f45134cc409674b8b10f53e038322bd64edbb7f5bb4d Jul 30 23:17:04.922755 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:04.922721 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8" event={"ID":"9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9","Type":"ContainerStarted","Data":"fdeb8249f80d7711b825318e492453ea73b06c6d51299cf46fbf7f0038b48130"} Jul 30 23:17:04.923160 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:04.922776 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8" event={"ID":"9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9","Type":"ContainerStarted","Data":"3c35f5b937d4be6438f0f45134cc409674b8b10f53e038322bd64edbb7f5bb4d"} Jul 30 23:17:04.940377 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:04.940325 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8" podStartSLOduration=1.9403051310000001 podStartE2EDuration="1.940305131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:17:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:17:04.937531664 +0000 UTC m=+1752.141350911" watchObservedRunningTime="2026-07-30 23:17:04.940305131 +0000 UTC m=+1752.144124366" Jul 30 23:17:05.930440 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:05.930406 2576 generic.go:356] "Generic (PLEG): container finished" podID="9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9" containerID="fdeb8249f80d7711b825318e492453ea73b06c6d51299cf46fbf7f0038b48130" exitCode=0 Jul 30 23:17:05.930937 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:05.930494 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8" event={"ID":"9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9","Type":"ContainerDied","Data":"fdeb8249f80d7711b825318e492453ea73b06c6d51299cf46fbf7f0038b48130"} Jul 30 23:17:07.065263 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:07.065238 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8" Jul 30 23:17:07.209118 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:07.209031 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9-maas-api-service-ca\") pod \"9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9\" (UID: \"9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9\") " Jul 30 23:17:07.209456 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:07.209434 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9" (UID: "9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:17:07.310005 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:07.309976 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9-maas-api-service-ca\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:07.942025 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:07.941995 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8" Jul 30 23:17:07.942202 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:07.942033 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8" event={"ID":"9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9","Type":"ContainerDied","Data":"3c35f5b937d4be6438f0f45134cc409674b8b10f53e038322bd64edbb7f5bb4d"} Jul 30 23:17:07.942202 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:07.942078 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c35f5b937d4be6438f0f45134cc409674b8b10f53e038322bd64edbb7f5bb4d" Jul 30 23:17:09.785671 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:09.785633 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm"] Jul 30 23:17:09.786163 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:09.785901 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" podUID="de183ee6-7254-4d16-b9f5-fe36dea52219" containerName="payload-processing" containerID="cri-o://4acdc021eb46334a4a4ecd8ce8f0c443646078c9f54b3e857b42301951571b5b" gracePeriod=30 Jul 30 23:17:09.797035 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:09.797008 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4"] Jul 30 23:17:09.797822 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:09.797465 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" podUID="daa4bb6f-a8a8-404f-b54d-2b84672dd28e" containerName="payload-pre-processing" containerID="cri-o://f986e946859e346e1929612974f24b95c837f94b19b26685cea63d326ae24896" gracePeriod=30 Jul 30 23:17:09.934944 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:09.934909 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8"] Jul 30 23:17:09.937776 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:09.937746 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c86f68a7-bccm8"] Jul 30 23:17:09.957048 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:09.956996 2576 generic.go:356] "Generic (PLEG): container finished" podID="de183ee6-7254-4d16-b9f5-fe36dea52219" containerID="4acdc021eb46334a4a4ecd8ce8f0c443646078c9f54b3e857b42301951571b5b" exitCode=0 Jul 30 23:17:09.957216 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:09.957125 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" event={"ID":"de183ee6-7254-4d16-b9f5-fe36dea52219","Type":"ContainerDied","Data":"4acdc021eb46334a4a4ecd8ce8f0c443646078c9f54b3e857b42301951571b5b"} Jul 30 23:17:09.959247 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:09.959215 2576 generic.go:356] "Generic (PLEG): container finished" podID="daa4bb6f-a8a8-404f-b54d-2b84672dd28e" containerID="f986e946859e346e1929612974f24b95c837f94b19b26685cea63d326ae24896" exitCode=0 Jul 30 23:17:09.959373 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:09.959342 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" event={"ID":"daa4bb6f-a8a8-404f-b54d-2b84672dd28e","Type":"ContainerDied","Data":"f986e946859e346e1929612974f24b95c837f94b19b26685cea63d326ae24896"} Jul 30 23:17:10.069717 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.069627 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4"] Jul 30 23:17:10.069922 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.069893 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" podUID="6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" containerName="istio-proxy" containerID="cri-o://4ef3986cd87baaa0ae8c6ef2e3f89a95f83fc519d9226c15d338549f8341ad7b" gracePeriod=30 Jul 30 23:17:10.074689 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.074668 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" Jul 30 23:17:10.109540 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.108996 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" Jul 30 23:17:10.237500 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.237447 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de183ee6-7254-4d16-b9f5-fe36dea52219-plugins-config-volume\") pod \"de183ee6-7254-4d16-b9f5-fe36dea52219\" (UID: \"de183ee6-7254-4d16-b9f5-fe36dea52219\") " Jul 30 23:17:10.237677 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.237535 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h427x\" (UniqueName: \"kubernetes.io/projected/daa4bb6f-a8a8-404f-b54d-2b84672dd28e-kube-api-access-h427x\") pod \"daa4bb6f-a8a8-404f-b54d-2b84672dd28e\" (UID: \"daa4bb6f-a8a8-404f-b54d-2b84672dd28e\") " Jul 30 23:17:10.237677 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.237571 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-425c8\" (UniqueName: \"kubernetes.io/projected/de183ee6-7254-4d16-b9f5-fe36dea52219-kube-api-access-425c8\") pod \"de183ee6-7254-4d16-b9f5-fe36dea52219\" (UID: \"de183ee6-7254-4d16-b9f5-fe36dea52219\") " Jul 30 23:17:10.237677 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.237600 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/daa4bb6f-a8a8-404f-b54d-2b84672dd28e-plugins-config-volume\") pod \"daa4bb6f-a8a8-404f-b54d-2b84672dd28e\" (UID: \"daa4bb6f-a8a8-404f-b54d-2b84672dd28e\") " Jul 30 23:17:10.237900 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.237874 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de183ee6-7254-4d16-b9f5-fe36dea52219-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de183ee6-7254-4d16-b9f5-fe36dea52219" (UID: "de183ee6-7254-4d16-b9f5-fe36dea52219"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:17:10.238084 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.238062 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daa4bb6f-a8a8-404f-b54d-2b84672dd28e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "daa4bb6f-a8a8-404f-b54d-2b84672dd28e" (UID: "daa4bb6f-a8a8-404f-b54d-2b84672dd28e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:17:10.239663 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.239645 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de183ee6-7254-4d16-b9f5-fe36dea52219-kube-api-access-425c8" (OuterVolumeSpecName: "kube-api-access-425c8") pod "de183ee6-7254-4d16-b9f5-fe36dea52219" (UID: "de183ee6-7254-4d16-b9f5-fe36dea52219"). InnerVolumeSpecName "kube-api-access-425c8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:17:10.239719 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.239677 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daa4bb6f-a8a8-404f-b54d-2b84672dd28e-kube-api-access-h427x" (OuterVolumeSpecName: "kube-api-access-h427x") pod "daa4bb6f-a8a8-404f-b54d-2b84672dd28e" (UID: "daa4bb6f-a8a8-404f-b54d-2b84672dd28e"). InnerVolumeSpecName "kube-api-access-h427x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:17:10.338898 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.338793 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-425c8\" (UniqueName: \"kubernetes.io/projected/de183ee6-7254-4d16-b9f5-fe36dea52219-kube-api-access-425c8\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:10.338898 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.338825 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/daa4bb6f-a8a8-404f-b54d-2b84672dd28e-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:10.338898 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.338837 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de183ee6-7254-4d16-b9f5-fe36dea52219-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:10.338898 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.338851 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h427x\" (UniqueName: \"kubernetes.io/projected/daa4bb6f-a8a8-404f-b54d-2b84672dd28e-kube-api-access-h427x\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:10.965516 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.965488 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" Jul 30 23:17:10.965968 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.965532 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4" event={"ID":"daa4bb6f-a8a8-404f-b54d-2b84672dd28e","Type":"ContainerDied","Data":"805ff3b06f710ba0aa921919b335a2c1dfe8e4908323a1dc1794c77b31404e48"} Jul 30 23:17:10.965968 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.965597 2576 scope.go:117] "RemoveContainer" containerID="f986e946859e346e1929612974f24b95c837f94b19b26685cea63d326ae24896" Jul 30 23:17:10.967025 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.967005 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" event={"ID":"de183ee6-7254-4d16-b9f5-fe36dea52219","Type":"ContainerDied","Data":"2bc51adbf0825836f8649ecdc6e2d5d5993a411a41632fe9751257edcfd2bf0c"} Jul 30 23:17:10.967125 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.967052 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm" Jul 30 23:17:10.974643 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.974619 2576 scope.go:117] "RemoveContainer" containerID="4acdc021eb46334a4a4ecd8ce8f0c443646078c9f54b3e857b42301951571b5b" Jul 30 23:17:10.992779 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.992758 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm"] Jul 30 23:17:10.994834 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:10.994817 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c86f68a7-6f8cc88786-8qsqm"] Jul 30 23:17:11.004060 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.004038 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4"] Jul 30 23:17:11.009551 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.009532 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c86f68a7-85768f9dbd-mzqf4"] Jul 30 23:17:11.101556 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.101485 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr"] Jul 30 23:17:11.101829 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.101817 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9" containerName="revoke-keys" Jul 30 23:17:11.101894 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.101831 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9" containerName="revoke-keys" Jul 30 23:17:11.101894 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.101848 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de183ee6-7254-4d16-b9f5-fe36dea52219" containerName="payload-processing" Jul 30 23:17:11.101894 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.101871 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="de183ee6-7254-4d16-b9f5-fe36dea52219" containerName="payload-processing" Jul 30 23:17:11.101894 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.101883 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa4bb6f-a8a8-404f-b54d-2b84672dd28e" containerName="payload-pre-processing" Jul 30 23:17:11.101894 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.101888 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa4bb6f-a8a8-404f-b54d-2b84672dd28e" containerName="payload-pre-processing" Jul 30 23:17:11.102064 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.101944 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="daa4bb6f-a8a8-404f-b54d-2b84672dd28e" containerName="payload-pre-processing" Jul 30 23:17:11.102064 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.101955 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="de183ee6-7254-4d16-b9f5-fe36dea52219" containerName="payload-processing" Jul 30 23:17:11.102064 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.101962 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9" containerName="revoke-keys" Jul 30 23:17:11.106260 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.106244 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.108844 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.108823 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-9d271187-gw-openshift-default-dockercfg-hlngt\"" Jul 30 23:17:11.121557 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.121532 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr"] Jul 30 23:17:11.235884 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.235836 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9" path="/var/lib/kubelet/pods/9db5e9f3-ac5e-46cb-8467-e32c3a47dbe9/volumes" Jul 30 23:17:11.236340 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.236318 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daa4bb6f-a8a8-404f-b54d-2b84672dd28e" path="/var/lib/kubelet/pods/daa4bb6f-a8a8-404f-b54d-2b84672dd28e/volumes" Jul 30 23:17:11.236915 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.236814 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de183ee6-7254-4d16-b9f5-fe36dea52219" path="/var/lib/kubelet/pods/de183ee6-7254-4d16-b9f5-fe36dea52219/volumes" Jul 30 23:17:11.246535 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.246510 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-data\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.246652 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.246550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-workload-socket\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.246652 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.246622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-credential-socket\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.246752 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.246686 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8229m\" (UniqueName: \"kubernetes.io/projected/91f43ffd-7d0e-4b91-a875-253e9b545726-kube-api-access-8229m\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.246752 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.246712 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-podinfo\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.246882 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.246777 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-token\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.246882 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.246808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91f43ffd-7d0e-4b91-a875-253e9b545726-istiod-ca-cert\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.246882 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.246850 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-envoy\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.247029 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.246914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-workload-certs\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.347610 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.347578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-podinfo\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.347761 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.347619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-token\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.347761 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.347634 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91f43ffd-7d0e-4b91-a875-253e9b545726-istiod-ca-cert\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.347761 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.347659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-envoy\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.347761 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.347687 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-workload-certs\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.347761 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.347712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-data\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.347761 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.347752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-workload-socket\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.348082 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.347808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-credential-socket\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.348082 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.347851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8229m\" (UniqueName: \"kubernetes.io/projected/91f43ffd-7d0e-4b91-a875-253e9b545726-kube-api-access-8229m\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.348274 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.348251 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-data\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.348340 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.348309 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-workload-certs\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.348379 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.348339 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-workload-socket\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.348431 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.348382 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-credential-socket\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.348527 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.348498 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91f43ffd-7d0e-4b91-a875-253e9b545726-istiod-ca-cert\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.350492 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.350470 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-envoy\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.350727 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.350709 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-podinfo\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.355737 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.355680 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-token\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.355985 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.355968 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8229m\" (UniqueName: \"kubernetes.io/projected/91f43ffd-7d0e-4b91-a875-253e9b545726-kube-api-access-8229m\") pod \"e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.422962 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.422937 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:11.561311 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.561276 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr"] Jul 30 23:17:11.562477 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:17:11.562443 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f43ffd_7d0e_4b91_a875_253e9b545726.slice/crio-d9b50b3012145deb2edde26ceddeac728b0fb02c12464f1b5a2b6deb51d9d2d6 WatchSource:0}: Error finding container d9b50b3012145deb2edde26ceddeac728b0fb02c12464f1b5a2b6deb51d9d2d6: Status 404 returned error can't find the container with id d9b50b3012145deb2edde26ceddeac728b0fb02c12464f1b5a2b6deb51d9d2d6 Jul 30 23:17:11.564459 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.564428 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:17:11.564546 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.564501 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:17:11.564611 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.564548 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:17:11.976029 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.975942 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" event={"ID":"91f43ffd-7d0e-4b91-a875-253e9b545726","Type":"ContainerStarted","Data":"a31c7e59544ee1fd6afe0e90245a3018a7df45ff6f8bbb3fef10f3870b9ced2b"} Jul 30 23:17:11.976029 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.975996 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" event={"ID":"91f43ffd-7d0e-4b91-a875-253e9b545726","Type":"ContainerStarted","Data":"d9b50b3012145deb2edde26ceddeac728b0fb02c12464f1b5a2b6deb51d9d2d6"} Jul 30 23:17:11.996365 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:11.996318 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" podStartSLOduration=0.996301722 podStartE2EDuration="996.301722ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:17:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:17:11.994052207 +0000 UTC m=+1759.197871442" watchObservedRunningTime="2026-07-30 23:17:11.996301722 +0000 UTC m=+1759.200120955" Jul 30 23:17:12.423641 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:12.423611 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:12.428230 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:12.428204 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:12.981342 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:12.981312 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:12.982355 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:12.982336 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:14.230132 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.230103 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst"] Jul 30 23:17:14.233555 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.233533 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" Jul 30 23:17:14.236137 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.236111 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-9d271187\"" Jul 30 23:17:14.236528 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.236515 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-9d271187-dockercfg-qmdxt\"" Jul 30 23:17:14.244229 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.244206 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst"] Jul 30 23:17:14.269588 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.269559 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl"] Jul 30 23:17:14.272897 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.272854 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" Jul 30 23:17:14.284517 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.284491 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl"] Jul 30 23:17:14.373793 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.373753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/819710cd-3dcd-48f0-95d4-81bf1cc70654-plugins-config-volume\") pod \"payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst\" (UID: \"819710cd-3dcd-48f0-95d4-81bf1cc70654\") " pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" Jul 30 23:17:14.373993 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.373805 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/907bd744-0d2b-4331-984a-bbf2464acf6c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl\" (UID: \"907bd744-0d2b-4331-984a-bbf2464acf6c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" Jul 30 23:17:14.373993 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.373890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tmlx\" (UniqueName: \"kubernetes.io/projected/907bd744-0d2b-4331-984a-bbf2464acf6c-kube-api-access-2tmlx\") pod \"payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl\" (UID: \"907bd744-0d2b-4331-984a-bbf2464acf6c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" Jul 30 23:17:14.373993 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.373983 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqjtc\" (UniqueName: \"kubernetes.io/projected/819710cd-3dcd-48f0-95d4-81bf1cc70654-kube-api-access-tqjtc\") pod \"payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst\" (UID: \"819710cd-3dcd-48f0-95d4-81bf1cc70654\") " pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" Jul 30 23:17:14.474993 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.474955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqjtc\" (UniqueName: \"kubernetes.io/projected/819710cd-3dcd-48f0-95d4-81bf1cc70654-kube-api-access-tqjtc\") pod \"payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst\" (UID: \"819710cd-3dcd-48f0-95d4-81bf1cc70654\") " pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" Jul 30 23:17:14.475189 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.475036 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/819710cd-3dcd-48f0-95d4-81bf1cc70654-plugins-config-volume\") pod \"payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst\" (UID: \"819710cd-3dcd-48f0-95d4-81bf1cc70654\") " pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" Jul 30 23:17:14.475189 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.475062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/907bd744-0d2b-4331-984a-bbf2464acf6c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl\" (UID: \"907bd744-0d2b-4331-984a-bbf2464acf6c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" Jul 30 23:17:14.475189 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.475095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tmlx\" (UniqueName: \"kubernetes.io/projected/907bd744-0d2b-4331-984a-bbf2464acf6c-kube-api-access-2tmlx\") pod \"payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl\" (UID: \"907bd744-0d2b-4331-984a-bbf2464acf6c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" Jul 30 23:17:14.475988 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.475961 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/819710cd-3dcd-48f0-95d4-81bf1cc70654-plugins-config-volume\") pod \"payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst\" (UID: \"819710cd-3dcd-48f0-95d4-81bf1cc70654\") " pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" Jul 30 23:17:14.476047 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.475971 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/907bd744-0d2b-4331-984a-bbf2464acf6c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl\" (UID: \"907bd744-0d2b-4331-984a-bbf2464acf6c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" Jul 30 23:17:14.482772 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.482709 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tmlx\" (UniqueName: \"kubernetes.io/projected/907bd744-0d2b-4331-984a-bbf2464acf6c-kube-api-access-2tmlx\") pod \"payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl\" (UID: \"907bd744-0d2b-4331-984a-bbf2464acf6c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" Jul 30 23:17:14.482892 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.482788 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqjtc\" (UniqueName: \"kubernetes.io/projected/819710cd-3dcd-48f0-95d4-81bf1cc70654-kube-api-access-tqjtc\") pod \"payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst\" (UID: \"819710cd-3dcd-48f0-95d4-81bf1cc70654\") " pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" Jul 30 23:17:14.546061 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.546031 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" Jul 30 23:17:14.583411 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.583376 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" Jul 30 23:17:14.596650 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.596614 2576 patch_prober.go:28] interesting pod/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 30 23:17:14.596789 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.596683 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" podUID="6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 23:17:14.690698 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.690530 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst"] Jul 30 23:17:14.693105 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:17:14.693067 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819710cd_3dcd_48f0_95d4_81bf1cc70654.slice/crio-74aa51f6a90b7cc40205da358a0006838699575f385e3b843555f9c3ba8e23b2 WatchSource:0}: Error finding container 74aa51f6a90b7cc40205da358a0006838699575f385e3b843555f9c3ba8e23b2: Status 404 returned error can't find the container with id 74aa51f6a90b7cc40205da358a0006838699575f385e3b843555f9c3ba8e23b2 Jul 30 23:17:14.732419 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.732394 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl"] Jul 30 23:17:14.734144 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:17:14.734091 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod907bd744_0d2b_4331_984a_bbf2464acf6c.slice/crio-83d228823bc8351c023de9cfa51312e9650fbdc3389891ec16aed9a749ad6960 WatchSource:0}: Error finding container 83d228823bc8351c023de9cfa51312e9650fbdc3389891ec16aed9a749ad6960: Status 404 returned error can't find the container with id 83d228823bc8351c023de9cfa51312e9650fbdc3389891ec16aed9a749ad6960 Jul 30 23:17:14.993538 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.993450 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" event={"ID":"907bd744-0d2b-4331-984a-bbf2464acf6c","Type":"ContainerStarted","Data":"fd7a63047c5f9780862bbe3166879759d2bbeeecaab05d677d695e6fde28dcce"} Jul 30 23:17:14.993705 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.993536 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" event={"ID":"907bd744-0d2b-4331-984a-bbf2464acf6c","Type":"ContainerStarted","Data":"83d228823bc8351c023de9cfa51312e9650fbdc3389891ec16aed9a749ad6960"} Jul 30 23:17:14.993705 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.993561 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" Jul 30 23:17:14.995065 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.995039 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" event={"ID":"819710cd-3dcd-48f0-95d4-81bf1cc70654","Type":"ContainerStarted","Data":"7f0d6cf0106a4411244c6b0a2cc1d0933b8c37901873b5e3d01e977f34ca26db"} Jul 30 23:17:14.995169 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.995088 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" event={"ID":"819710cd-3dcd-48f0-95d4-81bf1cc70654","Type":"ContainerStarted","Data":"74aa51f6a90b7cc40205da358a0006838699575f385e3b843555f9c3ba8e23b2"} Jul 30 23:17:14.995245 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:14.995228 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" Jul 30 23:17:15.009064 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.009014 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" podStartSLOduration=1.008996489 podStartE2EDuration="1.008996489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:17:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:17:15.007381752 +0000 UTC m=+1762.211200989" watchObservedRunningTime="2026-07-30 23:17:15.008996489 +0000 UTC m=+1762.212815726" Jul 30 23:17:15.024616 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.024571 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" podStartSLOduration=1.024558551 podStartE2EDuration="1.024558551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:17:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:17:15.022187324 +0000 UTC m=+1762.226006551" watchObservedRunningTime="2026-07-30 23:17:15.024558551 +0000 UTC m=+1762.228377784" Jul 30 23:17:15.310109 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.310085 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:17:15.383482 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.383451 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-token\") pod \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " Jul 30 23:17:15.383654 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.383491 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-envoy\") pod \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " Jul 30 23:17:15.383654 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.383528 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istiod-ca-cert\") pod \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " Jul 30 23:17:15.383654 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.383547 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mpnm\" (UniqueName: \"kubernetes.io/projected/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-kube-api-access-4mpnm\") pod \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " Jul 30 23:17:15.383823 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.383662 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-podinfo\") pod \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " Jul 30 23:17:15.383823 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.383755 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-workload-certs\") pod \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " Jul 30 23:17:15.383823 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.383794 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-credential-socket\") pod \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " Jul 30 23:17:15.384040 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.383825 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-data\") pod \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " Jul 30 23:17:15.384040 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.383882 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-workload-socket\") pod \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\" (UID: \"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c\") " Jul 30 23:17:15.384142 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.384052 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" (UID: "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:17:15.384142 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.384064 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" (UID: "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:17:15.384256 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.384219 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" (UID: "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:17:15.384316 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.384254 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" (UID: "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:17:15.384439 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.384413 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" (UID: "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:17:15.384648 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.384625 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:15.384726 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.384656 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:15.384726 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.384671 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:15.384726 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.384703 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:15.384726 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.384717 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:15.385931 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.385907 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" (UID: "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 23:17:15.386031 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.385998 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-kube-api-access-4mpnm" (OuterVolumeSpecName: "kube-api-access-4mpnm") pod "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" (UID: "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c"). InnerVolumeSpecName "kube-api-access-4mpnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:17:15.386148 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.386131 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" (UID: "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:17:15.386225 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.386177 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" (UID: "6f33d3bf-d617-48e8-8a1f-07fc8d2e042c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:17:15.485977 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.485949 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:15.485977 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.485977 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:15.486111 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.485991 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mpnm\" (UniqueName: \"kubernetes.io/projected/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-kube-api-access-4mpnm\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:15.486111 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:15.486004 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:16.003435 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:16.003405 2576 generic.go:356] "Generic (PLEG): container finished" podID="6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" containerID="4ef3986cd87baaa0ae8c6ef2e3f89a95f83fc519d9226c15d338549f8341ad7b" exitCode=0 Jul 30 23:17:16.003584 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:16.003459 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" event={"ID":"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c","Type":"ContainerDied","Data":"4ef3986cd87baaa0ae8c6ef2e3f89a95f83fc519d9226c15d338549f8341ad7b"} Jul 30 23:17:16.003584 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:16.003473 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" Jul 30 23:17:16.003584 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:16.003522 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4" event={"ID":"6f33d3bf-d617-48e8-8a1f-07fc8d2e042c","Type":"ContainerDied","Data":"eb98eb8a6044495ca13a52c97181ffa3aa647c2274ce7adab048fcc484a50d44"} Jul 30 23:17:16.003584 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:16.003547 2576 scope.go:117] "RemoveContainer" containerID="4ef3986cd87baaa0ae8c6ef2e3f89a95f83fc519d9226c15d338549f8341ad7b" Jul 30 23:17:16.013175 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:16.013161 2576 scope.go:117] "RemoveContainer" containerID="fbc4e9d33debbf7730d09fb7742c0d954cc8bd3698f78bdf2155d2915384f9c8" Jul 30 23:17:16.021242 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:16.021223 2576 scope.go:117] "RemoveContainer" containerID="4ef3986cd87baaa0ae8c6ef2e3f89a95f83fc519d9226c15d338549f8341ad7b" Jul 30 23:17:16.021481 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:17:16.021462 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ef3986cd87baaa0ae8c6ef2e3f89a95f83fc519d9226c15d338549f8341ad7b\": container with ID starting with 4ef3986cd87baaa0ae8c6ef2e3f89a95f83fc519d9226c15d338549f8341ad7b not found: ID does not exist" containerID="4ef3986cd87baaa0ae8c6ef2e3f89a95f83fc519d9226c15d338549f8341ad7b" Jul 30 23:17:16.021549 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:16.021493 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef3986cd87baaa0ae8c6ef2e3f89a95f83fc519d9226c15d338549f8341ad7b"} err="failed to get container status \"4ef3986cd87baaa0ae8c6ef2e3f89a95f83fc519d9226c15d338549f8341ad7b\": rpc error: code = NotFound desc = could not find container \"4ef3986cd87baaa0ae8c6ef2e3f89a95f83fc519d9226c15d338549f8341ad7b\": container with ID starting with 4ef3986cd87baaa0ae8c6ef2e3f89a95f83fc519d9226c15d338549f8341ad7b not found: ID does not exist" Jul 30 23:17:16.021549 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:16.021519 2576 scope.go:117] "RemoveContainer" containerID="fbc4e9d33debbf7730d09fb7742c0d954cc8bd3698f78bdf2155d2915384f9c8" Jul 30 23:17:16.021742 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:17:16.021726 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbc4e9d33debbf7730d09fb7742c0d954cc8bd3698f78bdf2155d2915384f9c8\": container with ID starting with fbc4e9d33debbf7730d09fb7742c0d954cc8bd3698f78bdf2155d2915384f9c8 not found: ID does not exist" containerID="fbc4e9d33debbf7730d09fb7742c0d954cc8bd3698f78bdf2155d2915384f9c8" Jul 30 23:17:16.021779 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:16.021751 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbc4e9d33debbf7730d09fb7742c0d954cc8bd3698f78bdf2155d2915384f9c8"} err="failed to get container status \"fbc4e9d33debbf7730d09fb7742c0d954cc8bd3698f78bdf2155d2915384f9c8\": rpc error: code = NotFound desc = could not find container \"fbc4e9d33debbf7730d09fb7742c0d954cc8bd3698f78bdf2155d2915384f9c8\": container with ID starting with fbc4e9d33debbf7730d09fb7742c0d954cc8bd3698f78bdf2155d2915384f9c8 not found: ID does not exist" Jul 30 23:17:16.025869 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:16.025837 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4"] Jul 30 23:17:16.029451 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:16.029433 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c86f68a7-openshift-default-7f5fb7d49d-t5sq4"] Jul 30 23:17:17.236737 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:17.236704 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" path="/var/lib/kubelet/pods/6f33d3bf-d617-48e8-8a1f-07fc8d2e042c/volumes" Jul 30 23:17:26.005896 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:26.005849 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" Jul 30 23:17:26.006264 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:26.005945 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" Jul 30 23:17:27.068871 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:27.068815 2576 generic.go:356] "Generic (PLEG): container finished" podID="91f43ffd-7d0e-4b91-a875-253e9b545726" containerID="a31c7e59544ee1fd6afe0e90245a3018a7df45ff6f8bbb3fef10f3870b9ced2b" exitCode=0 Jul 30 23:17:27.069276 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:27.068888 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" event={"ID":"91f43ffd-7d0e-4b91-a875-253e9b545726","Type":"ContainerDied","Data":"a31c7e59544ee1fd6afe0e90245a3018a7df45ff6f8bbb3fef10f3870b9ced2b"} Jul 30 23:17:27.069337 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:27.069322 2576 scope.go:117] "RemoveContainer" containerID="a31c7e59544ee1fd6afe0e90245a3018a7df45ff6f8bbb3fef10f3870b9ced2b" Jul 30 23:17:27.070443 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:27.070419 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:17:27.070512 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:27.070486 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:17:27.070555 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:27.070517 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:17:27.981245 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:27.981210 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:28.076641 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:28.076609 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" event={"ID":"91f43ffd-7d0e-4b91-a875-253e9b545726","Type":"ContainerStarted","Data":"3cb187a60823eb26510e2d5114d5d865321f157fbd0ffe4dbafccf946b7137bc"} Jul 30 23:17:28.423939 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:28.423900 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:28.425086 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:28.425063 2576 patch_prober.go:28] interesting pod/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 30 23:17:28.425191 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:28.425112 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" podUID="91f43ffd-7d0e-4b91-a875-253e9b545726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 30 23:17:29.423541 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:29.423505 2576 patch_prober.go:28] interesting pod/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 30 23:17:29.423952 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:29.423560 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" podUID="91f43ffd-7d0e-4b91-a875-253e9b545726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 30 23:17:30.423686 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:30.423646 2576 patch_prober.go:28] interesting pod/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 30 23:17:30.424115 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:30.423701 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" podUID="91f43ffd-7d0e-4b91-a875-253e9b545726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 30 23:17:31.423541 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:31.423502 2576 patch_prober.go:28] interesting pod/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 30 23:17:31.423735 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:31.423561 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" podUID="91f43ffd-7d0e-4b91-a875-253e9b545726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 30 23:17:32.424109 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:32.424072 2576 patch_prober.go:28] interesting pod/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 30 23:17:32.424485 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:32.424129 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" podUID="91f43ffd-7d0e-4b91-a875-253e9b545726" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 30 23:17:33.427810 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:33.427783 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:33.428269 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:33.428080 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:33.428679 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:33.428662 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:38.527651 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:38.527619 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh"] Jul 30 23:17:38.528158 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:38.527981 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" containerName="istio-proxy" Jul 30 23:17:38.528158 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:38.527993 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" containerName="istio-proxy" Jul 30 23:17:38.528158 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:38.528005 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" containerName="istio-proxy" Jul 30 23:17:38.528158 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:38.528010 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" containerName="istio-proxy" Jul 30 23:17:38.528158 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:38.528087 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" containerName="istio-proxy" Jul 30 23:17:38.528158 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:38.528095 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f33d3bf-d617-48e8-8a1f-07fc8d2e042c" containerName="istio-proxy" Jul 30 23:17:38.531539 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:38.531521 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh" Jul 30 23:17:38.533949 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:38.533928 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 23:17:38.534079 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:38.533929 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52wcc\"" Jul 30 23:17:38.538449 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:38.538427 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh"] Jul 30 23:17:38.576740 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:38.576712 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f35693-d53f-4076-9323-602a9dacf509-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh\" (UID: \"22f35693-d53f-4076-9323-602a9dacf509\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh" Jul 30 23:17:38.678086 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:38.678055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f35693-d53f-4076-9323-602a9dacf509-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh\" (UID: \"22f35693-d53f-4076-9323-602a9dacf509\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh" Jul 30 23:17:38.678680 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:38.678657 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f35693-d53f-4076-9323-602a9dacf509-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh\" (UID: \"22f35693-d53f-4076-9323-602a9dacf509\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh" Jul 30 23:17:38.844986 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:38.844902 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh" Jul 30 23:17:38.999527 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:38.999501 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh"] Jul 30 23:17:39.000805 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:17:39.000780 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f35693_d53f_4076_9323_602a9dacf509.slice/crio-63e587df5aaecbad908313b5a58b226c919a200d4b5aaf6dbcd82bd8435aaed8 WatchSource:0}: Error finding container 63e587df5aaecbad908313b5a58b226c919a200d4b5aaf6dbcd82bd8435aaed8: Status 404 returned error can't find the container with id 63e587df5aaecbad908313b5a58b226c919a200d4b5aaf6dbcd82bd8435aaed8 Jul 30 23:17:39.138236 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:39.138210 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh" event={"ID":"22f35693-d53f-4076-9323-602a9dacf509","Type":"ContainerStarted","Data":"63e587df5aaecbad908313b5a58b226c919a200d4b5aaf6dbcd82bd8435aaed8"} Jul 30 23:17:40.144939 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:40.144908 2576 generic.go:356] "Generic (PLEG): container finished" podID="22f35693-d53f-4076-9323-602a9dacf509" containerID="f085b9bf7ec5f7163761468c2493bbdb45c61e76c1fe357820220a9a10b60ef3" exitCode=0 Jul 30 23:17:40.145323 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:40.144992 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh" event={"ID":"22f35693-d53f-4076-9323-602a9dacf509","Type":"ContainerDied","Data":"f085b9bf7ec5f7163761468c2493bbdb45c61e76c1fe357820220a9a10b60ef3"} Jul 30 23:17:41.278439 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:41.278419 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh" Jul 30 23:17:41.299585 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:41.299559 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f35693-d53f-4076-9323-602a9dacf509-maas-api-service-ca\") pod \"22f35693-d53f-4076-9323-602a9dacf509\" (UID: \"22f35693-d53f-4076-9323-602a9dacf509\") " Jul 30 23:17:41.299990 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:41.299963 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22f35693-d53f-4076-9323-602a9dacf509-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "22f35693-d53f-4076-9323-602a9dacf509" (UID: "22f35693-d53f-4076-9323-602a9dacf509"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:17:41.400779 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:41.400753 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f35693-d53f-4076-9323-602a9dacf509-maas-api-service-ca\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:42.157308 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:42.157270 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh" event={"ID":"22f35693-d53f-4076-9323-602a9dacf509","Type":"ContainerDied","Data":"63e587df5aaecbad908313b5a58b226c919a200d4b5aaf6dbcd82bd8435aaed8"} Jul 30 23:17:42.157483 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:42.157314 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh" Jul 30 23:17:42.157483 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:42.157327 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63e587df5aaecbad908313b5a58b226c919a200d4b5aaf6dbcd82bd8435aaed8" Jul 30 23:17:45.014334 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.014254 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst"] Jul 30 23:17:45.014742 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.014492 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" podUID="819710cd-3dcd-48f0-95d4-81bf1cc70654" containerName="payload-processing" containerID="cri-o://7f0d6cf0106a4411244c6b0a2cc1d0933b8c37901873b5e3d01e977f34ca26db" gracePeriod=30 Jul 30 23:17:45.024062 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.023933 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl"] Jul 30 23:17:45.025147 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.025099 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" podUID="907bd744-0d2b-4331-984a-bbf2464acf6c" containerName="payload-pre-processing" containerID="cri-o://fd7a63047c5f9780862bbe3166879759d2bbeeecaab05d677d695e6fde28dcce" gracePeriod=30 Jul 30 23:17:45.153456 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.153428 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh"] Jul 30 23:17:45.157057 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.157031 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-9d271187-7fhsh"] Jul 30 23:17:45.178414 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.178260 2576 generic.go:356] "Generic (PLEG): container finished" podID="819710cd-3dcd-48f0-95d4-81bf1cc70654" containerID="7f0d6cf0106a4411244c6b0a2cc1d0933b8c37901873b5e3d01e977f34ca26db" exitCode=0 Jul 30 23:17:45.178414 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.178380 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" event={"ID":"819710cd-3dcd-48f0-95d4-81bf1cc70654","Type":"ContainerDied","Data":"7f0d6cf0106a4411244c6b0a2cc1d0933b8c37901873b5e3d01e977f34ca26db"} Jul 30 23:17:45.180228 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.180203 2576 generic.go:356] "Generic (PLEG): container finished" podID="907bd744-0d2b-4331-984a-bbf2464acf6c" containerID="fd7a63047c5f9780862bbe3166879759d2bbeeecaab05d677d695e6fde28dcce" exitCode=0 Jul 30 23:17:45.180371 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.180266 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" event={"ID":"907bd744-0d2b-4331-984a-bbf2464acf6c","Type":"ContainerDied","Data":"fd7a63047c5f9780862bbe3166879759d2bbeeecaab05d677d695e6fde28dcce"} Jul 30 23:17:45.237424 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.237389 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22f35693-d53f-4076-9323-602a9dacf509" path="/var/lib/kubelet/pods/22f35693-d53f-4076-9323-602a9dacf509/volumes" Jul 30 23:17:45.291592 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.291565 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" Jul 30 23:17:45.300925 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.300899 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr"] Jul 30 23:17:45.301143 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.301120 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" podUID="91f43ffd-7d0e-4b91-a875-253e9b545726" containerName="istio-proxy" containerID="cri-o://3cb187a60823eb26510e2d5114d5d865321f157fbd0ffe4dbafccf946b7137bc" gracePeriod=30 Jul 30 23:17:45.327584 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.327555 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" Jul 30 23:17:45.334552 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.334521 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqjtc\" (UniqueName: \"kubernetes.io/projected/819710cd-3dcd-48f0-95d4-81bf1cc70654-kube-api-access-tqjtc\") pod \"819710cd-3dcd-48f0-95d4-81bf1cc70654\" (UID: \"819710cd-3dcd-48f0-95d4-81bf1cc70654\") " Jul 30 23:17:45.334697 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.334621 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/819710cd-3dcd-48f0-95d4-81bf1cc70654-plugins-config-volume\") pod \"819710cd-3dcd-48f0-95d4-81bf1cc70654\" (UID: \"819710cd-3dcd-48f0-95d4-81bf1cc70654\") " Jul 30 23:17:45.335015 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.334991 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/819710cd-3dcd-48f0-95d4-81bf1cc70654-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "819710cd-3dcd-48f0-95d4-81bf1cc70654" (UID: "819710cd-3dcd-48f0-95d4-81bf1cc70654"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:17:45.338226 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.338200 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819710cd-3dcd-48f0-95d4-81bf1cc70654-kube-api-access-tqjtc" (OuterVolumeSpecName: "kube-api-access-tqjtc") pod "819710cd-3dcd-48f0-95d4-81bf1cc70654" (UID: "819710cd-3dcd-48f0-95d4-81bf1cc70654"). InnerVolumeSpecName "kube-api-access-tqjtc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:17:45.435559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.435527 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/907bd744-0d2b-4331-984a-bbf2464acf6c-plugins-config-volume\") pod \"907bd744-0d2b-4331-984a-bbf2464acf6c\" (UID: \"907bd744-0d2b-4331-984a-bbf2464acf6c\") " Jul 30 23:17:45.435747 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.435641 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tmlx\" (UniqueName: \"kubernetes.io/projected/907bd744-0d2b-4331-984a-bbf2464acf6c-kube-api-access-2tmlx\") pod \"907bd744-0d2b-4331-984a-bbf2464acf6c\" (UID: \"907bd744-0d2b-4331-984a-bbf2464acf6c\") " Jul 30 23:17:45.435824 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.435787 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/819710cd-3dcd-48f0-95d4-81bf1cc70654-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:45.435824 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.435799 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqjtc\" (UniqueName: \"kubernetes.io/projected/819710cd-3dcd-48f0-95d4-81bf1cc70654-kube-api-access-tqjtc\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:45.435997 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.435968 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/907bd744-0d2b-4331-984a-bbf2464acf6c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "907bd744-0d2b-4331-984a-bbf2464acf6c" (UID: "907bd744-0d2b-4331-984a-bbf2464acf6c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:17:45.437612 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.437589 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/907bd744-0d2b-4331-984a-bbf2464acf6c-kube-api-access-2tmlx" (OuterVolumeSpecName: "kube-api-access-2tmlx") pod "907bd744-0d2b-4331-984a-bbf2464acf6c" (UID: "907bd744-0d2b-4331-984a-bbf2464acf6c"). InnerVolumeSpecName "kube-api-access-2tmlx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:17:45.537088 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.537018 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tmlx\" (UniqueName: \"kubernetes.io/projected/907bd744-0d2b-4331-984a-bbf2464acf6c-kube-api-access-2tmlx\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:45.537088 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:45.537040 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/907bd744-0d2b-4331-984a-bbf2464acf6c-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:46.097112 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.097084 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl"] Jul 30 23:17:46.097457 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.097421 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22f35693-d53f-4076-9323-602a9dacf509" containerName="revoke-keys" Jul 30 23:17:46.097457 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.097432 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="22f35693-d53f-4076-9323-602a9dacf509" containerName="revoke-keys" Jul 30 23:17:46.097457 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.097454 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="819710cd-3dcd-48f0-95d4-81bf1cc70654" containerName="payload-processing" Jul 30 23:17:46.097580 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.097464 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="819710cd-3dcd-48f0-95d4-81bf1cc70654" containerName="payload-processing" Jul 30 23:17:46.097580 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.097473 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="907bd744-0d2b-4331-984a-bbf2464acf6c" containerName="payload-pre-processing" Jul 30 23:17:46.097580 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.097481 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="907bd744-0d2b-4331-984a-bbf2464acf6c" containerName="payload-pre-processing" Jul 30 23:17:46.097580 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.097568 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="819710cd-3dcd-48f0-95d4-81bf1cc70654" containerName="payload-processing" Jul 30 23:17:46.097580 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.097580 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="22f35693-d53f-4076-9323-602a9dacf509" containerName="revoke-keys" Jul 30 23:17:46.097744 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.097590 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="907bd744-0d2b-4331-984a-bbf2464acf6c" containerName="payload-pre-processing" Jul 30 23:17:46.101009 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.100989 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.103494 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.103471 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-68124529-openshift-default-dockercfg-c6c2n\"" Jul 30 23:17:46.112330 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.112310 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl"] Jul 30 23:17:46.142586 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.142566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-istio-envoy\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.142693 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.142594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a14e746-70f3-49c2-b928-00213927266e-istio-podinfo\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.142693 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.142630 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-workload-socket\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.142693 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.142671 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-workload-certs\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.142693 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.142690 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-istio-data\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.142878 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.142760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq54f\" (UniqueName: \"kubernetes.io/projected/2a14e746-70f3-49c2-b928-00213927266e-kube-api-access-dq54f\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.142878 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.142797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-credential-socket\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.142878 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.142813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a14e746-70f3-49c2-b928-00213927266e-istiod-ca-cert\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.142878 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.142840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a14e746-70f3-49c2-b928-00213927266e-istio-token\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.189915 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.189581 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" Jul 30 23:17:46.189915 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.189606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst" event={"ID":"819710cd-3dcd-48f0-95d4-81bf1cc70654","Type":"ContainerDied","Data":"74aa51f6a90b7cc40205da358a0006838699575f385e3b843555f9c3ba8e23b2"} Jul 30 23:17:46.189915 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.189677 2576 scope.go:117] "RemoveContainer" containerID="7f0d6cf0106a4411244c6b0a2cc1d0933b8c37901873b5e3d01e977f34ca26db" Jul 30 23:17:46.191475 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.191450 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" event={"ID":"907bd744-0d2b-4331-984a-bbf2464acf6c","Type":"ContainerDied","Data":"83d228823bc8351c023de9cfa51312e9650fbdc3389891ec16aed9a749ad6960"} Jul 30 23:17:46.191589 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.191561 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl" Jul 30 23:17:46.209522 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.209498 2576 scope.go:117] "RemoveContainer" containerID="fd7a63047c5f9780862bbe3166879759d2bbeeecaab05d677d695e6fde28dcce" Jul 30 23:17:46.216942 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.216919 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst"] Jul 30 23:17:46.221024 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.221007 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-9d271187-6b57c57885-vjsst"] Jul 30 23:17:46.231233 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.231210 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl"] Jul 30 23:17:46.235199 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.235180 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-9d271187-6d59d6bd56-zqjwl"] Jul 30 23:17:46.243376 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.243358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-workload-certs\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.243456 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.243390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-istio-data\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.243456 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.243422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq54f\" (UniqueName: \"kubernetes.io/projected/2a14e746-70f3-49c2-b928-00213927266e-kube-api-access-dq54f\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.243566 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.243541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-credential-socket\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.243623 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.243572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a14e746-70f3-49c2-b928-00213927266e-istiod-ca-cert\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.243623 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.243613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a14e746-70f3-49c2-b928-00213927266e-istio-token\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.243736 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.243649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-istio-envoy\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.243736 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.243673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a14e746-70f3-49c2-b928-00213927266e-istio-podinfo\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.243736 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.243698 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-istio-data\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.243894 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.243770 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-workload-certs\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.243894 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.243808 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-workload-socket\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.243996 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.243916 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-credential-socket\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.244149 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.244129 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-workload-socket\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.244294 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.244277 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a14e746-70f3-49c2-b928-00213927266e-istiod-ca-cert\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.245718 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.245702 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-istio-envoy\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.246100 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.246079 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a14e746-70f3-49c2-b928-00213927266e-istio-podinfo\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.251878 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.251848 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a14e746-70f3-49c2-b928-00213927266e-istio-token\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.252363 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.252342 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq54f\" (UniqueName: \"kubernetes.io/projected/2a14e746-70f3-49c2-b928-00213927266e-kube-api-access-dq54f\") pod \"e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.411895 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.411844 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:46.549768 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.549730 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl"] Jul 30 23:17:46.554980 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:17:46.554939 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a14e746_70f3_49c2_b928_00213927266e.slice/crio-67da748f04f07c7db0e7f3e91daf9bd526b853369257ff51057dc6681f7ab876 WatchSource:0}: Error finding container 67da748f04f07c7db0e7f3e91daf9bd526b853369257ff51057dc6681f7ab876: Status 404 returned error can't find the container with id 67da748f04f07c7db0e7f3e91daf9bd526b853369257ff51057dc6681f7ab876 Jul 30 23:17:46.556961 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.556926 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:17:46.557032 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.556994 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:17:46.557032 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:46.557021 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:17:47.199597 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:47.199558 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" event={"ID":"2a14e746-70f3-49c2-b928-00213927266e","Type":"ContainerStarted","Data":"22f6e59056436df70e866eb37555eed381d723f72afaf26d9ead2799c93db154"} Jul 30 23:17:47.200032 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:47.199615 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" event={"ID":"2a14e746-70f3-49c2-b928-00213927266e","Type":"ContainerStarted","Data":"67da748f04f07c7db0e7f3e91daf9bd526b853369257ff51057dc6681f7ab876"} Jul 30 23:17:47.222745 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:47.222693 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" podStartSLOduration=1.22267979 podStartE2EDuration="1.22267979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:17:47.220166386 +0000 UTC m=+1794.423985630" watchObservedRunningTime="2026-07-30 23:17:47.22267979 +0000 UTC m=+1794.426499024" Jul 30 23:17:47.235635 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:47.235608 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="819710cd-3dcd-48f0-95d4-81bf1cc70654" path="/var/lib/kubelet/pods/819710cd-3dcd-48f0-95d4-81bf1cc70654/volumes" Jul 30 23:17:47.235976 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:47.235962 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="907bd744-0d2b-4331-984a-bbf2464acf6c" path="/var/lib/kubelet/pods/907bd744-0d2b-4331-984a-bbf2464acf6c/volumes" Jul 30 23:17:47.412428 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:47.412395 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:47.417093 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:47.417070 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:48.204775 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:48.204745 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:48.205808 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:48.205786 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:17:48.430600 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:48.430563 2576 patch_prober.go:28] interesting pod/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 23:17:48.430756 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:48.430622 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" podUID="91f43ffd-7d0e-4b91-a875-253e9b545726" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 23:17:50.376976 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.376941 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r"] Jul 30 23:17:50.380279 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.380262 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" Jul 30 23:17:50.382902 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.382883 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-68124529\"" Jul 30 23:17:50.389473 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.389442 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r"] Jul 30 23:17:50.427400 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.427376 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7"] Jul 30 23:17:50.430662 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.430642 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" Jul 30 23:17:50.433441 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.433422 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-68124529-dockercfg-lckq9\"" Jul 30 23:17:50.441987 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.441962 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7"] Jul 30 23:17:50.502652 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.502614 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgf8z\" (UniqueName: \"kubernetes.io/projected/f6c0842f-3f57-4e53-bf95-5d3d266a5c88-kube-api-access-sgf8z\") pod \"payload-processing-e2e-ait-68124529-7b997dd698-2svp7\" (UID: \"f6c0842f-3f57-4e53-bf95-5d3d266a5c88\") " pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" Jul 30 23:17:50.503978 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.503194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6c0842f-3f57-4e53-bf95-5d3d266a5c88-plugins-config-volume\") pod \"payload-processing-e2e-ait-68124529-7b997dd698-2svp7\" (UID: \"f6c0842f-3f57-4e53-bf95-5d3d266a5c88\") " pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" Jul 30 23:17:50.503978 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.503284 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8c17988-6c74-4211-936a-f20696feb1dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r\" (UID: \"f8c17988-6c74-4211-936a-f20696feb1dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" Jul 30 23:17:50.503978 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.503390 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnlfz\" (UniqueName: \"kubernetes.io/projected/f8c17988-6c74-4211-936a-f20696feb1dc-kube-api-access-nnlfz\") pod \"payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r\" (UID: \"f8c17988-6c74-4211-936a-f20696feb1dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" Jul 30 23:17:50.566212 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.566187 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:50.604045 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.604018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgf8z\" (UniqueName: \"kubernetes.io/projected/f6c0842f-3f57-4e53-bf95-5d3d266a5c88-kube-api-access-sgf8z\") pod \"payload-processing-e2e-ait-68124529-7b997dd698-2svp7\" (UID: \"f6c0842f-3f57-4e53-bf95-5d3d266a5c88\") " pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" Jul 30 23:17:50.604225 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.604066 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6c0842f-3f57-4e53-bf95-5d3d266a5c88-plugins-config-volume\") pod \"payload-processing-e2e-ait-68124529-7b997dd698-2svp7\" (UID: \"f6c0842f-3f57-4e53-bf95-5d3d266a5c88\") " pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" Jul 30 23:17:50.604225 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.604119 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8c17988-6c74-4211-936a-f20696feb1dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r\" (UID: \"f8c17988-6c74-4211-936a-f20696feb1dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" Jul 30 23:17:50.604225 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.604195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnlfz\" (UniqueName: \"kubernetes.io/projected/f8c17988-6c74-4211-936a-f20696feb1dc-kube-api-access-nnlfz\") pod \"payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r\" (UID: \"f8c17988-6c74-4211-936a-f20696feb1dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" Jul 30 23:17:50.604941 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.604917 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8c17988-6c74-4211-936a-f20696feb1dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r\" (UID: \"f8c17988-6c74-4211-936a-f20696feb1dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" Jul 30 23:17:50.605020 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.604979 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6c0842f-3f57-4e53-bf95-5d3d266a5c88-plugins-config-volume\") pod \"payload-processing-e2e-ait-68124529-7b997dd698-2svp7\" (UID: \"f6c0842f-3f57-4e53-bf95-5d3d266a5c88\") " pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" Jul 30 23:17:50.612697 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.612675 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgf8z\" (UniqueName: \"kubernetes.io/projected/f6c0842f-3f57-4e53-bf95-5d3d266a5c88-kube-api-access-sgf8z\") pod \"payload-processing-e2e-ait-68124529-7b997dd698-2svp7\" (UID: \"f6c0842f-3f57-4e53-bf95-5d3d266a5c88\") " pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" Jul 30 23:17:50.612777 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.612744 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnlfz\" (UniqueName: \"kubernetes.io/projected/f8c17988-6c74-4211-936a-f20696feb1dc-kube-api-access-nnlfz\") pod \"payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r\" (UID: \"f8c17988-6c74-4211-936a-f20696feb1dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" Jul 30 23:17:50.705129 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705094 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-podinfo\") pod \"91f43ffd-7d0e-4b91-a875-253e9b545726\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " Jul 30 23:17:50.705129 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705131 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-credential-socket\") pod \"91f43ffd-7d0e-4b91-a875-253e9b545726\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " Jul 30 23:17:50.705336 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705149 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91f43ffd-7d0e-4b91-a875-253e9b545726-istiod-ca-cert\") pod \"91f43ffd-7d0e-4b91-a875-253e9b545726\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " Jul 30 23:17:50.705336 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705167 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-workload-certs\") pod \"91f43ffd-7d0e-4b91-a875-253e9b545726\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " Jul 30 23:17:50.705336 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705190 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-data\") pod \"91f43ffd-7d0e-4b91-a875-253e9b545726\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " Jul 30 23:17:50.705336 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705237 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-workload-socket\") pod \"91f43ffd-7d0e-4b91-a875-253e9b545726\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " Jul 30 23:17:50.705544 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705359 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8229m\" (UniqueName: \"kubernetes.io/projected/91f43ffd-7d0e-4b91-a875-253e9b545726-kube-api-access-8229m\") pod \"91f43ffd-7d0e-4b91-a875-253e9b545726\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " Jul 30 23:17:50.705544 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705403 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-token\") pod \"91f43ffd-7d0e-4b91-a875-253e9b545726\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " Jul 30 23:17:50.705544 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705426 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-envoy\") pod \"91f43ffd-7d0e-4b91-a875-253e9b545726\" (UID: \"91f43ffd-7d0e-4b91-a875-253e9b545726\") " Jul 30 23:17:50.705703 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705394 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "91f43ffd-7d0e-4b91-a875-253e9b545726" (UID: "91f43ffd-7d0e-4b91-a875-253e9b545726"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:17:50.705703 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705488 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "91f43ffd-7d0e-4b91-a875-253e9b545726" (UID: "91f43ffd-7d0e-4b91-a875-253e9b545726"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:17:50.705703 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705603 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-data" (OuterVolumeSpecName: "istio-data") pod "91f43ffd-7d0e-4b91-a875-253e9b545726" (UID: "91f43ffd-7d0e-4b91-a875-253e9b545726"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:17:50.705703 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705627 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "91f43ffd-7d0e-4b91-a875-253e9b545726" (UID: "91f43ffd-7d0e-4b91-a875-253e9b545726"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:17:50.705703 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705688 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91f43ffd-7d0e-4b91-a875-253e9b545726-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "91f43ffd-7d0e-4b91-a875-253e9b545726" (UID: "91f43ffd-7d0e-4b91-a875-253e9b545726"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:17:50.706057 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705825 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:50.706057 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705843 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91f43ffd-7d0e-4b91-a875-253e9b545726-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:50.706057 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705882 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:50.706057 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705895 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:50.706057 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.705908 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:50.707431 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.707401 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "91f43ffd-7d0e-4b91-a875-253e9b545726" (UID: "91f43ffd-7d0e-4b91-a875-253e9b545726"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 23:17:50.707522 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.707461 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91f43ffd-7d0e-4b91-a875-253e9b545726-kube-api-access-8229m" (OuterVolumeSpecName: "kube-api-access-8229m") pod "91f43ffd-7d0e-4b91-a875-253e9b545726" (UID: "91f43ffd-7d0e-4b91-a875-253e9b545726"). InnerVolumeSpecName "kube-api-access-8229m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:17:50.707522 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.707490 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-token" (OuterVolumeSpecName: "istio-token") pod "91f43ffd-7d0e-4b91-a875-253e9b545726" (UID: "91f43ffd-7d0e-4b91-a875-253e9b545726"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:17:50.707522 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.707489 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "91f43ffd-7d0e-4b91-a875-253e9b545726" (UID: "91f43ffd-7d0e-4b91-a875-253e9b545726"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:17:50.745295 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.745266 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" Jul 30 23:17:50.750418 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.750400 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" Jul 30 23:17:50.806600 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.806509 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:50.806600 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.806544 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:50.806600 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.806558 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91f43ffd-7d0e-4b91-a875-253e9b545726-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:50.806600 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:50.806571 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8229m\" (UniqueName: \"kubernetes.io/projected/91f43ffd-7d0e-4b91-a875-253e9b545726-kube-api-access-8229m\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:17:51.090508 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.090481 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r"] Jul 30 23:17:51.092312 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:17:51.092287 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c17988_6c74_4211_936a_f20696feb1dc.slice/crio-1289f41b7490c49be7226064f57633186996d6e3a61be3728f97fecbc3dae033 WatchSource:0}: Error finding container 1289f41b7490c49be7226064f57633186996d6e3a61be3728f97fecbc3dae033: Status 404 returned error can't find the container with id 1289f41b7490c49be7226064f57633186996d6e3a61be3728f97fecbc3dae033 Jul 30 23:17:51.115261 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.115235 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7"] Jul 30 23:17:51.124931 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:17:51.124905 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6c0842f_3f57_4e53_bf95_5d3d266a5c88.slice/crio-d02ac6d6d98e4ef86582512b191c1cd6ccc32cb036615a0cf138ad252a2fb59c WatchSource:0}: Error finding container d02ac6d6d98e4ef86582512b191c1cd6ccc32cb036615a0cf138ad252a2fb59c: Status 404 returned error can't find the container with id d02ac6d6d98e4ef86582512b191c1cd6ccc32cb036615a0cf138ad252a2fb59c Jul 30 23:17:51.222350 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.222317 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" event={"ID":"f8c17988-6c74-4211-936a-f20696feb1dc","Type":"ContainerStarted","Data":"bf70e1e73e191b8b47808977d23af135fe264b0a5245b47f99770dfc7e6ef873"} Jul 30 23:17:51.222529 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.222378 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" event={"ID":"f8c17988-6c74-4211-936a-f20696feb1dc","Type":"ContainerStarted","Data":"1289f41b7490c49be7226064f57633186996d6e3a61be3728f97fecbc3dae033"} Jul 30 23:17:51.222529 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.222482 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" Jul 30 23:17:51.223916 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.223890 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" event={"ID":"f6c0842f-3f57-4e53-bf95-5d3d266a5c88","Type":"ContainerStarted","Data":"2434f3fba3e8f800afd4420b8738942c614f5afdb522cd9dda534c3453dd3238"} Jul 30 23:17:51.224033 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.223939 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" event={"ID":"f6c0842f-3f57-4e53-bf95-5d3d266a5c88","Type":"ContainerStarted","Data":"d02ac6d6d98e4ef86582512b191c1cd6ccc32cb036615a0cf138ad252a2fb59c"} Jul 30 23:17:51.224033 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.223988 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" Jul 30 23:17:51.225651 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.225630 2576 generic.go:356] "Generic (PLEG): container finished" podID="91f43ffd-7d0e-4b91-a875-253e9b545726" containerID="3cb187a60823eb26510e2d5114d5d865321f157fbd0ffe4dbafccf946b7137bc" exitCode=0 Jul 30 23:17:51.225775 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.225663 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" event={"ID":"91f43ffd-7d0e-4b91-a875-253e9b545726","Type":"ContainerDied","Data":"3cb187a60823eb26510e2d5114d5d865321f157fbd0ffe4dbafccf946b7137bc"} Jul 30 23:17:51.225775 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.225673 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" Jul 30 23:17:51.225775 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.225694 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr" event={"ID":"91f43ffd-7d0e-4b91-a875-253e9b545726","Type":"ContainerDied","Data":"d9b50b3012145deb2edde26ceddeac728b0fb02c12464f1b5a2b6deb51d9d2d6"} Jul 30 23:17:51.225775 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.225718 2576 scope.go:117] "RemoveContainer" containerID="3cb187a60823eb26510e2d5114d5d865321f157fbd0ffe4dbafccf946b7137bc" Jul 30 23:17:51.234562 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.234546 2576 scope.go:117] "RemoveContainer" containerID="a31c7e59544ee1fd6afe0e90245a3018a7df45ff6f8bbb3fef10f3870b9ced2b" Jul 30 23:17:51.239391 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.239335 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" podStartSLOduration=1.239323008 podStartE2EDuration="1.239323008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:17:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:17:51.237922801 +0000 UTC m=+1798.441742036" watchObservedRunningTime="2026-07-30 23:17:51.239323008 +0000 UTC m=+1798.443142283" Jul 30 23:17:51.246893 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.246851 2576 scope.go:117] "RemoveContainer" containerID="3cb187a60823eb26510e2d5114d5d865321f157fbd0ffe4dbafccf946b7137bc" Jul 30 23:17:51.247177 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:17:51.247148 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cb187a60823eb26510e2d5114d5d865321f157fbd0ffe4dbafccf946b7137bc\": container with ID starting with 3cb187a60823eb26510e2d5114d5d865321f157fbd0ffe4dbafccf946b7137bc not found: ID does not exist" containerID="3cb187a60823eb26510e2d5114d5d865321f157fbd0ffe4dbafccf946b7137bc" Jul 30 23:17:51.247283 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.247185 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb187a60823eb26510e2d5114d5d865321f157fbd0ffe4dbafccf946b7137bc"} err="failed to get container status \"3cb187a60823eb26510e2d5114d5d865321f157fbd0ffe4dbafccf946b7137bc\": rpc error: code = NotFound desc = could not find container \"3cb187a60823eb26510e2d5114d5d865321f157fbd0ffe4dbafccf946b7137bc\": container with ID starting with 3cb187a60823eb26510e2d5114d5d865321f157fbd0ffe4dbafccf946b7137bc not found: ID does not exist" Jul 30 23:17:51.247283 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.247209 2576 scope.go:117] "RemoveContainer" containerID="a31c7e59544ee1fd6afe0e90245a3018a7df45ff6f8bbb3fef10f3870b9ced2b" Jul 30 23:17:51.247527 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:17:51.247502 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a31c7e59544ee1fd6afe0e90245a3018a7df45ff6f8bbb3fef10f3870b9ced2b\": container with ID starting with a31c7e59544ee1fd6afe0e90245a3018a7df45ff6f8bbb3fef10f3870b9ced2b not found: ID does not exist" containerID="a31c7e59544ee1fd6afe0e90245a3018a7df45ff6f8bbb3fef10f3870b9ced2b" Jul 30 23:17:51.247615 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.247531 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a31c7e59544ee1fd6afe0e90245a3018a7df45ff6f8bbb3fef10f3870b9ced2b"} err="failed to get container status \"a31c7e59544ee1fd6afe0e90245a3018a7df45ff6f8bbb3fef10f3870b9ced2b\": rpc error: code = NotFound desc = could not find container \"a31c7e59544ee1fd6afe0e90245a3018a7df45ff6f8bbb3fef10f3870b9ced2b\": container with ID starting with a31c7e59544ee1fd6afe0e90245a3018a7df45ff6f8bbb3fef10f3870b9ced2b not found: ID does not exist" Jul 30 23:17:51.252712 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.252688 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr"] Jul 30 23:17:51.256758 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.256732 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-9d271187-gw-openshift-default-5dbc665644-8zzdr"] Jul 30 23:17:51.270610 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:51.270570 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" podStartSLOduration=1.270556544 podStartE2EDuration="1.270556544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:17:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:17:51.268440599 +0000 UTC m=+1798.472259834" watchObservedRunningTime="2026-07-30 23:17:51.270556544 +0000 UTC m=+1798.474375777" Jul 30 23:17:53.251496 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:53.251452 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91f43ffd-7d0e-4b91-a875-253e9b545726" path="/var/lib/kubelet/pods/91f43ffd-7d0e-4b91-a875-253e9b545726/volumes" Jul 30 23:17:53.296743 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:53.296705 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:17:53.301551 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:17:53.301529 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:18:02.235179 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:02.235149 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" Jul 30 23:18:02.235658 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:02.235210 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" Jul 30 23:18:02.321666 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:02.321633 2576 generic.go:356] "Generic (PLEG): container finished" podID="2a14e746-70f3-49c2-b928-00213927266e" containerID="22f6e59056436df70e866eb37555eed381d723f72afaf26d9ead2799c93db154" exitCode=0 Jul 30 23:18:02.321836 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:02.321701 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" event={"ID":"2a14e746-70f3-49c2-b928-00213927266e","Type":"ContainerDied","Data":"22f6e59056436df70e866eb37555eed381d723f72afaf26d9ead2799c93db154"} Jul 30 23:18:02.322097 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:02.322082 2576 scope.go:117] "RemoveContainer" containerID="22f6e59056436df70e866eb37555eed381d723f72afaf26d9ead2799c93db154" Jul 30 23:18:02.323086 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:02.323063 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:18:02.323153 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:02.323126 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:18:02.323194 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:02.323158 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:18:03.205612 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:03.205553 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:18:03.329176 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:03.329141 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" event={"ID":"2a14e746-70f3-49c2-b928-00213927266e","Type":"ContainerStarted","Data":"4d9a1f96924b3c28367f63fbc0cac87dac2d3ca04ae1875d7b502fcad4419b46"} Jul 30 23:18:03.412337 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:03.412296 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:18:03.413358 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:03.413320 2576 patch_prober.go:28] interesting pod/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 30 23:18:03.413489 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:03.413389 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" podUID="2a14e746-70f3-49c2-b928-00213927266e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 30 23:18:04.413071 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:04.413034 2576 patch_prober.go:28] interesting pod/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 30 23:18:04.413476 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:04.413097 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" podUID="2a14e746-70f3-49c2-b928-00213927266e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 30 23:18:05.412276 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:05.412239 2576 patch_prober.go:28] interesting pod/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 30 23:18:05.412480 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:05.412296 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" podUID="2a14e746-70f3-49c2-b928-00213927266e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 30 23:18:06.412382 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:06.412343 2576 patch_prober.go:28] interesting pod/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 30 23:18:06.412768 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:06.412423 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" podUID="2a14e746-70f3-49c2-b928-00213927266e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 30 23:18:07.412649 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:07.412613 2576 patch_prober.go:28] interesting pod/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body= Jul 30 23:18:07.413052 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:07.412680 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" podUID="2a14e746-70f3-49c2-b928-00213927266e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" Jul 30 23:18:08.416118 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:08.416084 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:18:08.416532 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:08.416346 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:18:08.417066 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:08.417046 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:18:14.432596 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:14.432567 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68124529-vv94t"] Jul 30 23:18:14.433009 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:14.432915 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91f43ffd-7d0e-4b91-a875-253e9b545726" containerName="istio-proxy" Jul 30 23:18:14.433009 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:14.432926 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="91f43ffd-7d0e-4b91-a875-253e9b545726" containerName="istio-proxy" Jul 30 23:18:14.433009 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:14.432936 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91f43ffd-7d0e-4b91-a875-253e9b545726" containerName="istio-proxy" Jul 30 23:18:14.433009 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:14.432941 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="91f43ffd-7d0e-4b91-a875-253e9b545726" containerName="istio-proxy" Jul 30 23:18:14.433009 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:14.432997 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="91f43ffd-7d0e-4b91-a875-253e9b545726" containerName="istio-proxy" Jul 30 23:18:14.436198 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:14.436180 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68124529-vv94t" Jul 30 23:18:14.438616 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:14.438592 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52wcc\"" Jul 30 23:18:14.438836 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:14.438818 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 23:18:14.442837 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:14.442805 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68124529-vv94t"] Jul 30 23:18:14.537928 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:14.537887 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7fac8a7-0c10-4b94-91e8-cb81c569f9d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-68124529-vv94t\" (UID: \"b7fac8a7-0c10-4b94-91e8-cb81c569f9d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68124529-vv94t" Jul 30 23:18:14.639129 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:14.639093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7fac8a7-0c10-4b94-91e8-cb81c569f9d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-68124529-vv94t\" (UID: \"b7fac8a7-0c10-4b94-91e8-cb81c569f9d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68124529-vv94t" Jul 30 23:18:14.639704 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:14.639682 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7fac8a7-0c10-4b94-91e8-cb81c569f9d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-68124529-vv94t\" (UID: \"b7fac8a7-0c10-4b94-91e8-cb81c569f9d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68124529-vv94t" Jul 30 23:18:14.749348 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:14.749241 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68124529-vv94t" Jul 30 23:18:14.889291 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:14.889264 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68124529-vv94t"] Jul 30 23:18:14.891112 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:18:14.891083 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7fac8a7_0c10_4b94_91e8_cb81c569f9d6.slice/crio-2beb9de09b424d3a30468385bb307dd4e874e9078de26e86ebb6210a6af38d6b WatchSource:0}: Error finding container 2beb9de09b424d3a30468385bb307dd4e874e9078de26e86ebb6210a6af38d6b: Status 404 returned error can't find the container with id 2beb9de09b424d3a30468385bb307dd4e874e9078de26e86ebb6210a6af38d6b Jul 30 23:18:15.406411 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:15.406371 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68124529-vv94t" event={"ID":"b7fac8a7-0c10-4b94-91e8-cb81c569f9d6","Type":"ContainerStarted","Data":"62c6862a2cc91c025000ffec0ed1ed391292abd4ddfaca7db4b2e734015a2b6c"} Jul 30 23:18:15.406603 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:15.406429 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68124529-vv94t" event={"ID":"b7fac8a7-0c10-4b94-91e8-cb81c569f9d6","Type":"ContainerStarted","Data":"2beb9de09b424d3a30468385bb307dd4e874e9078de26e86ebb6210a6af38d6b"} Jul 30 23:18:15.423170 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:15.423116 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68124529-vv94t" podStartSLOduration=1.423102063 podStartE2EDuration="1.423102063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:18:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:18:15.422797429 +0000 UTC m=+1822.626616664" watchObservedRunningTime="2026-07-30 23:18:15.423102063 +0000 UTC m=+1822.626921296" Jul 30 23:18:16.412824 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:16.412784 2576 generic.go:356] "Generic (PLEG): container finished" podID="b7fac8a7-0c10-4b94-91e8-cb81c569f9d6" containerID="62c6862a2cc91c025000ffec0ed1ed391292abd4ddfaca7db4b2e734015a2b6c" exitCode=0 Jul 30 23:18:16.413255 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:16.412876 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68124529-vv94t" event={"ID":"b7fac8a7-0c10-4b94-91e8-cb81c569f9d6","Type":"ContainerDied","Data":"62c6862a2cc91c025000ffec0ed1ed391292abd4ddfaca7db4b2e734015a2b6c"} Jul 30 23:18:17.546757 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:17.546730 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68124529-vv94t" Jul 30 23:18:17.564545 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:17.564516 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7fac8a7-0c10-4b94-91e8-cb81c569f9d6-maas-api-service-ca\") pod \"b7fac8a7-0c10-4b94-91e8-cb81c569f9d6\" (UID: \"b7fac8a7-0c10-4b94-91e8-cb81c569f9d6\") " Jul 30 23:18:17.564956 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:17.564923 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7fac8a7-0c10-4b94-91e8-cb81c569f9d6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b7fac8a7-0c10-4b94-91e8-cb81c569f9d6" (UID: "b7fac8a7-0c10-4b94-91e8-cb81c569f9d6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:18:17.665578 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:17.665531 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7fac8a7-0c10-4b94-91e8-cb81c569f9d6-maas-api-service-ca\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:18.424171 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:18.424144 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68124529-vv94t" Jul 30 23:18:18.424351 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:18.424139 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68124529-vv94t" event={"ID":"b7fac8a7-0c10-4b94-91e8-cb81c569f9d6","Type":"ContainerDied","Data":"2beb9de09b424d3a30468385bb307dd4e874e9078de26e86ebb6210a6af38d6b"} Jul 30 23:18:18.424351 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:18.424268 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2beb9de09b424d3a30468385bb307dd4e874e9078de26e86ebb6210a6af38d6b" Jul 30 23:18:20.320579 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.320543 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7"] Jul 30 23:18:20.321030 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.320793 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" podUID="f6c0842f-3f57-4e53-bf95-5d3d266a5c88" containerName="payload-processing" containerID="cri-o://2434f3fba3e8f800afd4420b8738942c614f5afdb522cd9dda534c3453dd3238" gracePeriod=30 Jul 30 23:18:20.327677 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.327650 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r"] Jul 30 23:18:20.327931 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.327902 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" podUID="f8c17988-6c74-4211-936a-f20696feb1dc" containerName="payload-pre-processing" containerID="cri-o://bf70e1e73e191b8b47808977d23af135fe264b0a5245b47f99770dfc7e6ef873" gracePeriod=30 Jul 30 23:18:20.436308 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.436279 2576 generic.go:356] "Generic (PLEG): container finished" podID="f6c0842f-3f57-4e53-bf95-5d3d266a5c88" containerID="2434f3fba3e8f800afd4420b8738942c614f5afdb522cd9dda534c3453dd3238" exitCode=0 Jul 30 23:18:20.436388 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.436316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" event={"ID":"f6c0842f-3f57-4e53-bf95-5d3d266a5c88","Type":"ContainerDied","Data":"2434f3fba3e8f800afd4420b8738942c614f5afdb522cd9dda534c3453dd3238"} Jul 30 23:18:20.464675 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.464607 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68124529-vv94t"] Jul 30 23:18:20.468508 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.468476 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-68124529-vv94t"] Jul 30 23:18:20.607179 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.607149 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" Jul 30 23:18:20.610175 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.610150 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" Jul 30 23:18:20.690386 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.690357 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8c17988-6c74-4211-936a-f20696feb1dc-plugins-config-volume\") pod \"f8c17988-6c74-4211-936a-f20696feb1dc\" (UID: \"f8c17988-6c74-4211-936a-f20696feb1dc\") " Jul 30 23:18:20.690553 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.690420 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgf8z\" (UniqueName: \"kubernetes.io/projected/f6c0842f-3f57-4e53-bf95-5d3d266a5c88-kube-api-access-sgf8z\") pod \"f6c0842f-3f57-4e53-bf95-5d3d266a5c88\" (UID: \"f6c0842f-3f57-4e53-bf95-5d3d266a5c88\") " Jul 30 23:18:20.690553 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.690492 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnlfz\" (UniqueName: \"kubernetes.io/projected/f8c17988-6c74-4211-936a-f20696feb1dc-kube-api-access-nnlfz\") pod \"f8c17988-6c74-4211-936a-f20696feb1dc\" (UID: \"f8c17988-6c74-4211-936a-f20696feb1dc\") " Jul 30 23:18:20.690553 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.690520 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6c0842f-3f57-4e53-bf95-5d3d266a5c88-plugins-config-volume\") pod \"f6c0842f-3f57-4e53-bf95-5d3d266a5c88\" (UID: \"f6c0842f-3f57-4e53-bf95-5d3d266a5c88\") " Jul 30 23:18:20.690793 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.690767 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8c17988-6c74-4211-936a-f20696feb1dc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f8c17988-6c74-4211-936a-f20696feb1dc" (UID: "f8c17988-6c74-4211-936a-f20696feb1dc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:18:20.690993 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.690966 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6c0842f-3f57-4e53-bf95-5d3d266a5c88-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f6c0842f-3f57-4e53-bf95-5d3d266a5c88" (UID: "f6c0842f-3f57-4e53-bf95-5d3d266a5c88"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:18:20.692519 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.692497 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c17988-6c74-4211-936a-f20696feb1dc-kube-api-access-nnlfz" (OuterVolumeSpecName: "kube-api-access-nnlfz") pod "f8c17988-6c74-4211-936a-f20696feb1dc" (UID: "f8c17988-6c74-4211-936a-f20696feb1dc"). InnerVolumeSpecName "kube-api-access-nnlfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:18:20.692610 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.692529 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6c0842f-3f57-4e53-bf95-5d3d266a5c88-kube-api-access-sgf8z" (OuterVolumeSpecName: "kube-api-access-sgf8z") pod "f6c0842f-3f57-4e53-bf95-5d3d266a5c88" (UID: "f6c0842f-3f57-4e53-bf95-5d3d266a5c88"). InnerVolumeSpecName "kube-api-access-sgf8z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:18:20.791315 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.791276 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8c17988-6c74-4211-936a-f20696feb1dc-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:20.791315 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.791305 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgf8z\" (UniqueName: \"kubernetes.io/projected/f6c0842f-3f57-4e53-bf95-5d3d266a5c88-kube-api-access-sgf8z\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:20.791315 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.791315 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnlfz\" (UniqueName: \"kubernetes.io/projected/f8c17988-6c74-4211-936a-f20696feb1dc-kube-api-access-nnlfz\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:20.791315 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:20.791324 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6c0842f-3f57-4e53-bf95-5d3d266a5c88-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:21.235909 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:21.235875 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7fac8a7-0c10-4b94-91e8-cb81c569f9d6" path="/var/lib/kubelet/pods/b7fac8a7-0c10-4b94-91e8-cb81c569f9d6/volumes" Jul 30 23:18:21.442779 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:21.442747 2576 generic.go:356] "Generic (PLEG): container finished" podID="f8c17988-6c74-4211-936a-f20696feb1dc" containerID="bf70e1e73e191b8b47808977d23af135fe264b0a5245b47f99770dfc7e6ef873" exitCode=0 Jul 30 23:18:21.443269 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:21.442791 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" Jul 30 23:18:21.443269 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:21.442841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" event={"ID":"f8c17988-6c74-4211-936a-f20696feb1dc","Type":"ContainerDied","Data":"bf70e1e73e191b8b47808977d23af135fe264b0a5245b47f99770dfc7e6ef873"} Jul 30 23:18:21.443269 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:21.442909 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r" event={"ID":"f8c17988-6c74-4211-936a-f20696feb1dc","Type":"ContainerDied","Data":"1289f41b7490c49be7226064f57633186996d6e3a61be3728f97fecbc3dae033"} Jul 30 23:18:21.443269 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:21.442951 2576 scope.go:117] "RemoveContainer" containerID="bf70e1e73e191b8b47808977d23af135fe264b0a5245b47f99770dfc7e6ef873" Jul 30 23:18:21.444402 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:21.444378 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" Jul 30 23:18:21.444402 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:21.444379 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7" event={"ID":"f6c0842f-3f57-4e53-bf95-5d3d266a5c88","Type":"ContainerDied","Data":"d02ac6d6d98e4ef86582512b191c1cd6ccc32cb036615a0cf138ad252a2fb59c"} Jul 30 23:18:21.451853 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:21.451835 2576 scope.go:117] "RemoveContainer" containerID="bf70e1e73e191b8b47808977d23af135fe264b0a5245b47f99770dfc7e6ef873" Jul 30 23:18:21.452107 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:18:21.452090 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf70e1e73e191b8b47808977d23af135fe264b0a5245b47f99770dfc7e6ef873\": container with ID starting with bf70e1e73e191b8b47808977d23af135fe264b0a5245b47f99770dfc7e6ef873 not found: ID does not exist" containerID="bf70e1e73e191b8b47808977d23af135fe264b0a5245b47f99770dfc7e6ef873" Jul 30 23:18:21.452178 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:21.452113 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf70e1e73e191b8b47808977d23af135fe264b0a5245b47f99770dfc7e6ef873"} err="failed to get container status \"bf70e1e73e191b8b47808977d23af135fe264b0a5245b47f99770dfc7e6ef873\": rpc error: code = NotFound desc = could not find container \"bf70e1e73e191b8b47808977d23af135fe264b0a5245b47f99770dfc7e6ef873\": container with ID starting with bf70e1e73e191b8b47808977d23af135fe264b0a5245b47f99770dfc7e6ef873 not found: ID does not exist" Jul 30 23:18:21.452178 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:21.452129 2576 scope.go:117] "RemoveContainer" containerID="2434f3fba3e8f800afd4420b8738942c614f5afdb522cd9dda534c3453dd3238" Jul 30 23:18:21.462550 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:21.462530 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r"] Jul 30 23:18:21.466385 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:21.466367 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-68124529-6bdcdf6c96-2sk2r"] Jul 30 23:18:21.476161 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:21.476142 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7"] Jul 30 23:18:21.482177 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:21.482156 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-68124529-7b997dd698-2svp7"] Jul 30 23:18:21.699822 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:21.699789 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl"] Jul 30 23:18:21.700107 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:21.700071 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" podUID="2a14e746-70f3-49c2-b928-00213927266e" containerName="istio-proxy" containerID="cri-o://4d9a1f96924b3c28367f63fbc0cac87dac2d3ca04ae1875d7b502fcad4419b46" gracePeriod=30 Jul 30 23:18:22.512596 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.512565 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448"] Jul 30 23:18:22.513067 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.512940 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7fac8a7-0c10-4b94-91e8-cb81c569f9d6" containerName="revoke-keys" Jul 30 23:18:22.513067 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.512955 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7fac8a7-0c10-4b94-91e8-cb81c569f9d6" containerName="revoke-keys" Jul 30 23:18:22.513067 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.512974 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6c0842f-3f57-4e53-bf95-5d3d266a5c88" containerName="payload-processing" Jul 30 23:18:22.513067 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.512983 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6c0842f-3f57-4e53-bf95-5d3d266a5c88" containerName="payload-processing" Jul 30 23:18:22.513067 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.513009 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c17988-6c74-4211-936a-f20696feb1dc" containerName="payload-pre-processing" Jul 30 23:18:22.513067 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.513015 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c17988-6c74-4211-936a-f20696feb1dc" containerName="payload-pre-processing" Jul 30 23:18:22.513401 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.513081 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8c17988-6c74-4211-936a-f20696feb1dc" containerName="payload-pre-processing" Jul 30 23:18:22.513401 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.513090 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7fac8a7-0c10-4b94-91e8-cb81c569f9d6" containerName="revoke-keys" Jul 30 23:18:22.513401 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.513098 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6c0842f-3f57-4e53-bf95-5d3d266a5c88" containerName="payload-processing" Jul 30 23:18:22.513401 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.513104 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="91f43ffd-7d0e-4b91-a875-253e9b545726" containerName="istio-proxy" Jul 30 23:18:22.518213 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.518193 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.520736 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.520717 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-c7a3e722-openshift-default-dockercfg-d4v8t\"" Jul 30 23:18:22.528465 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.528442 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448"] Jul 30 23:18:22.605003 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.604965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-data\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.605195 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.605123 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-workload-certs\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.605270 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.605203 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-workload-socket\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.605352 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.605326 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-token\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.605414 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.605372 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istiod-ca-cert\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.605414 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.605401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-podinfo\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.605520 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.605456 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-credential-socket\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.605520 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.605486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-envoy\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.605520 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.605512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zvqf\" (UniqueName: \"kubernetes.io/projected/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-kube-api-access-4zvqf\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.706201 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.706167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-token\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.706201 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.706200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istiod-ca-cert\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.706425 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.706225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-podinfo\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.706425 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.706257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-credential-socket\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.706425 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.706344 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-envoy\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.706425 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.706362 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zvqf\" (UniqueName: \"kubernetes.io/projected/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-kube-api-access-4zvqf\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.706425 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.706415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-data\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.706751 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.706436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-workload-certs\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.706751 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.706471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-workload-socket\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.706895 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.706772 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-credential-socket\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.706895 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.706823 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-data\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.706895 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.706887 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-workload-socket\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.707125 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.706912 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-workload-certs\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.707125 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.707077 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istiod-ca-cert\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.708591 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.708571 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-envoy\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.708784 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.708769 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-podinfo\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.717153 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.717133 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-token\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.717153 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.717148 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zvqf\" (UniqueName: \"kubernetes.io/projected/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-kube-api-access-4zvqf\") pod \"e2e-derive-c7a3e722-openshift-default-868955c69b-fs448\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.829500 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.829415 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:22.968072 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.968047 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448"] Jul 30 23:18:22.969534 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:18:22.969511 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1e7c01_f9b4_477c_8e01_c79fb82f97ae.slice/crio-98ad4e1241b314a64f2f4e57d1070738e3a102434ec69b8a2dbfa05d8a676aa4 WatchSource:0}: Error finding container 98ad4e1241b314a64f2f4e57d1070738e3a102434ec69b8a2dbfa05d8a676aa4: Status 404 returned error can't find the container with id 98ad4e1241b314a64f2f4e57d1070738e3a102434ec69b8a2dbfa05d8a676aa4 Jul 30 23:18:22.971703 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.971666 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:18:22.971790 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.971733 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:18:22.971790 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:22.971766 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:18:23.236192 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:23.236157 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6c0842f-3f57-4e53-bf95-5d3d266a5c88" path="/var/lib/kubelet/pods/f6c0842f-3f57-4e53-bf95-5d3d266a5c88/volumes" Jul 30 23:18:23.236522 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:23.236508 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8c17988-6c74-4211-936a-f20696feb1dc" path="/var/lib/kubelet/pods/f8c17988-6c74-4211-936a-f20696feb1dc/volumes" Jul 30 23:18:23.418680 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:23.418649 2576 patch_prober.go:28] interesting pod/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 23:18:23.418831 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:23.418702 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" podUID="2a14e746-70f3-49c2-b928-00213927266e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 23:18:23.461570 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:23.461540 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" event={"ID":"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae","Type":"ContainerStarted","Data":"74a9edd754103fe3b8933035ad8f5ae513af6ef6bfb3f4f073b59bf3fbb082bf"} Jul 30 23:18:23.461729 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:23.461593 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" event={"ID":"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae","Type":"ContainerStarted","Data":"98ad4e1241b314a64f2f4e57d1070738e3a102434ec69b8a2dbfa05d8a676aa4"} Jul 30 23:18:23.481283 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:23.481238 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" podStartSLOduration=1.4812237719999999 podStartE2EDuration="1.481223772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:18:23.480386534 +0000 UTC m=+1830.684205771" watchObservedRunningTime="2026-07-30 23:18:23.481223772 +0000 UTC m=+1830.685043006" Jul 30 23:18:23.830479 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:23.830445 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:24.835272 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:24.835237 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:25.471921 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:25.471886 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:25.472969 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:25.472951 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:26.523514 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.523480 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn"] Jul 30 23:18:26.526979 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.526960 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" Jul 30 23:18:26.529275 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.529251 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-c7a3e722\"" Jul 30 23:18:26.536652 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.536631 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn"] Jul 30 23:18:26.579707 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.579675 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk"] Jul 30 23:18:26.582948 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.582932 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" Jul 30 23:18:26.585600 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.585579 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-c7a3e722-dockercfg-t82tr\"" Jul 30 23:18:26.593938 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.593915 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk"] Jul 30 23:18:26.645990 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.645945 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff57b2eb-16f4-402d-ac80-f0437987cade-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn\" (UID: \"ff57b2eb-16f4-402d-ac80-f0437987cade\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" Jul 30 23:18:26.646182 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.645999 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6013841e-6af3-4466-aac2-63b775a8637e-plugins-config-volume\") pod \"payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk\" (UID: \"6013841e-6af3-4466-aac2-63b775a8637e\") " pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" Jul 30 23:18:26.646182 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.646093 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh5j7\" (UniqueName: \"kubernetes.io/projected/ff57b2eb-16f4-402d-ac80-f0437987cade-kube-api-access-kh5j7\") pod \"payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn\" (UID: \"ff57b2eb-16f4-402d-ac80-f0437987cade\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" Jul 30 23:18:26.646182 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.646145 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksdrt\" (UniqueName: \"kubernetes.io/projected/6013841e-6af3-4466-aac2-63b775a8637e-kube-api-access-ksdrt\") pod \"payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk\" (UID: \"6013841e-6af3-4466-aac2-63b775a8637e\") " pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" Jul 30 23:18:26.746769 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.746736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6013841e-6af3-4466-aac2-63b775a8637e-plugins-config-volume\") pod \"payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk\" (UID: \"6013841e-6af3-4466-aac2-63b775a8637e\") " pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" Jul 30 23:18:26.746955 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.746776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh5j7\" (UniqueName: \"kubernetes.io/projected/ff57b2eb-16f4-402d-ac80-f0437987cade-kube-api-access-kh5j7\") pod \"payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn\" (UID: \"ff57b2eb-16f4-402d-ac80-f0437987cade\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" Jul 30 23:18:26.746955 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.746895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksdrt\" (UniqueName: \"kubernetes.io/projected/6013841e-6af3-4466-aac2-63b775a8637e-kube-api-access-ksdrt\") pod \"payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk\" (UID: \"6013841e-6af3-4466-aac2-63b775a8637e\") " pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" Jul 30 23:18:26.747088 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.747042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff57b2eb-16f4-402d-ac80-f0437987cade-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn\" (UID: \"ff57b2eb-16f4-402d-ac80-f0437987cade\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" Jul 30 23:18:26.747463 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.747440 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6013841e-6af3-4466-aac2-63b775a8637e-plugins-config-volume\") pod \"payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk\" (UID: \"6013841e-6af3-4466-aac2-63b775a8637e\") " pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" Jul 30 23:18:26.747656 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.747637 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff57b2eb-16f4-402d-ac80-f0437987cade-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn\" (UID: \"ff57b2eb-16f4-402d-ac80-f0437987cade\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" Jul 30 23:18:26.755183 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.755156 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh5j7\" (UniqueName: \"kubernetes.io/projected/ff57b2eb-16f4-402d-ac80-f0437987cade-kube-api-access-kh5j7\") pod \"payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn\" (UID: \"ff57b2eb-16f4-402d-ac80-f0437987cade\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" Jul 30 23:18:26.755260 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.755193 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksdrt\" (UniqueName: \"kubernetes.io/projected/6013841e-6af3-4466-aac2-63b775a8637e-kube-api-access-ksdrt\") pod \"payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk\" (UID: \"6013841e-6af3-4466-aac2-63b775a8637e\") " pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" Jul 30 23:18:26.838544 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.838514 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" Jul 30 23:18:26.894403 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.894331 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" Jul 30 23:18:26.957396 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:26.957370 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:18:27.049101 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.049070 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-istio-data\") pod \"2a14e746-70f3-49c2-b928-00213927266e\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " Jul 30 23:18:27.049275 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.049108 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq54f\" (UniqueName: \"kubernetes.io/projected/2a14e746-70f3-49c2-b928-00213927266e-kube-api-access-dq54f\") pod \"2a14e746-70f3-49c2-b928-00213927266e\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " Jul 30 23:18:27.049275 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.049156 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a14e746-70f3-49c2-b928-00213927266e-istiod-ca-cert\") pod \"2a14e746-70f3-49c2-b928-00213927266e\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " Jul 30 23:18:27.049275 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.049177 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a14e746-70f3-49c2-b928-00213927266e-istio-token\") pod \"2a14e746-70f3-49c2-b928-00213927266e\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " Jul 30 23:18:27.049275 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.049209 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-istio-envoy\") pod \"2a14e746-70f3-49c2-b928-00213927266e\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " Jul 30 23:18:27.049275 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.049258 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-credential-socket\") pod \"2a14e746-70f3-49c2-b928-00213927266e\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " Jul 30 23:18:27.049545 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.049340 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a14e746-70f3-49c2-b928-00213927266e-istio-podinfo\") pod \"2a14e746-70f3-49c2-b928-00213927266e\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " Jul 30 23:18:27.049545 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.049382 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-workload-certs\") pod \"2a14e746-70f3-49c2-b928-00213927266e\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " Jul 30 23:18:27.049545 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.049417 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-workload-socket\") pod \"2a14e746-70f3-49c2-b928-00213927266e\" (UID: \"2a14e746-70f3-49c2-b928-00213927266e\") " Jul 30 23:18:27.049545 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.049335 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-istio-data" (OuterVolumeSpecName: "istio-data") pod "2a14e746-70f3-49c2-b928-00213927266e" (UID: "2a14e746-70f3-49c2-b928-00213927266e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:18:27.049753 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.049560 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2a14e746-70f3-49c2-b928-00213927266e" (UID: "2a14e746-70f3-49c2-b928-00213927266e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:18:27.049753 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.049579 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a14e746-70f3-49c2-b928-00213927266e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2a14e746-70f3-49c2-b928-00213927266e" (UID: "2a14e746-70f3-49c2-b928-00213927266e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:18:27.049846 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.049760 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2a14e746-70f3-49c2-b928-00213927266e" (UID: "2a14e746-70f3-49c2-b928-00213927266e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:18:27.049846 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.049779 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:27.049846 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.049803 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:27.049846 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.049817 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a14e746-70f3-49c2-b928-00213927266e-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:27.050018 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.049937 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2a14e746-70f3-49c2-b928-00213927266e" (UID: "2a14e746-70f3-49c2-b928-00213927266e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:18:27.051406 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.051377 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2a14e746-70f3-49c2-b928-00213927266e" (UID: "2a14e746-70f3-49c2-b928-00213927266e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:18:27.051537 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.051449 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2a14e746-70f3-49c2-b928-00213927266e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2a14e746-70f3-49c2-b928-00213927266e" (UID: "2a14e746-70f3-49c2-b928-00213927266e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 23:18:27.051730 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.051705 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a14e746-70f3-49c2-b928-00213927266e-kube-api-access-dq54f" (OuterVolumeSpecName: "kube-api-access-dq54f") pod "2a14e746-70f3-49c2-b928-00213927266e" (UID: "2a14e746-70f3-49c2-b928-00213927266e"). InnerVolumeSpecName "kube-api-access-dq54f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:18:27.051816 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.051761 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a14e746-70f3-49c2-b928-00213927266e-istio-token" (OuterVolumeSpecName: "istio-token") pod "2a14e746-70f3-49c2-b928-00213927266e" (UID: "2a14e746-70f3-49c2-b928-00213927266e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:18:27.151083 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.151054 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a14e746-70f3-49c2-b928-00213927266e-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:27.151083 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.151080 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:27.151239 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.151092 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:27.151239 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.151103 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq54f\" (UniqueName: \"kubernetes.io/projected/2a14e746-70f3-49c2-b928-00213927266e-kube-api-access-dq54f\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:27.151239 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.151116 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a14e746-70f3-49c2-b928-00213927266e-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:27.151239 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.151127 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a14e746-70f3-49c2-b928-00213927266e-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:27.191842 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.191813 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn"] Jul 30 23:18:27.192513 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:18:27.192482 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff57b2eb_16f4_402d_ac80_f0437987cade.slice/crio-af02d566d6c6bb2c2d8bbc06cf676733fbdf7913f796b9ed7c4de6f8bb576da6 WatchSource:0}: Error finding container af02d566d6c6bb2c2d8bbc06cf676733fbdf7913f796b9ed7c4de6f8bb576da6: Status 404 returned error can't find the container with id af02d566d6c6bb2c2d8bbc06cf676733fbdf7913f796b9ed7c4de6f8bb576da6 Jul 30 23:18:27.249586 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.249560 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk"] Jul 30 23:18:27.250769 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:18:27.250745 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6013841e_6af3_4466_aac2_63b775a8637e.slice/crio-e6a53e3a1747dbe053e072086bc63f7289986685d44094ab71c51a2674b710c1 WatchSource:0}: Error finding container e6a53e3a1747dbe053e072086bc63f7289986685d44094ab71c51a2674b710c1: Status 404 returned error can't find the container with id e6a53e3a1747dbe053e072086bc63f7289986685d44094ab71c51a2674b710c1 Jul 30 23:18:27.483824 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.483729 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" event={"ID":"ff57b2eb-16f4-402d-ac80-f0437987cade","Type":"ContainerStarted","Data":"b3c004e3a08823b25471b9f93fe9830a684aaebed33f9976b9697f4ada397531"} Jul 30 23:18:27.483824 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.483798 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" Jul 30 23:18:27.483824 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.483820 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" event={"ID":"ff57b2eb-16f4-402d-ac80-f0437987cade","Type":"ContainerStarted","Data":"af02d566d6c6bb2c2d8bbc06cf676733fbdf7913f796b9ed7c4de6f8bb576da6"} Jul 30 23:18:27.485388 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.485359 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" event={"ID":"6013841e-6af3-4466-aac2-63b775a8637e","Type":"ContainerStarted","Data":"981c50e91a4d285d139051f530731a69f09ee054d8224a3dc259321d8d03aa13"} Jul 30 23:18:27.485521 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.485414 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" event={"ID":"6013841e-6af3-4466-aac2-63b775a8637e","Type":"ContainerStarted","Data":"e6a53e3a1747dbe053e072086bc63f7289986685d44094ab71c51a2674b710c1"} Jul 30 23:18:27.485521 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.485446 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" Jul 30 23:18:27.487102 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.487081 2576 generic.go:356] "Generic (PLEG): container finished" podID="2a14e746-70f3-49c2-b928-00213927266e" containerID="4d9a1f96924b3c28367f63fbc0cac87dac2d3ca04ae1875d7b502fcad4419b46" exitCode=0 Jul 30 23:18:27.487215 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.487120 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" Jul 30 23:18:27.487215 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.487153 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" event={"ID":"2a14e746-70f3-49c2-b928-00213927266e","Type":"ContainerDied","Data":"4d9a1f96924b3c28367f63fbc0cac87dac2d3ca04ae1875d7b502fcad4419b46"} Jul 30 23:18:27.487215 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.487198 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl" event={"ID":"2a14e746-70f3-49c2-b928-00213927266e","Type":"ContainerDied","Data":"67da748f04f07c7db0e7f3e91daf9bd526b853369257ff51057dc6681f7ab876"} Jul 30 23:18:27.487384 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.487219 2576 scope.go:117] "RemoveContainer" containerID="4d9a1f96924b3c28367f63fbc0cac87dac2d3ca04ae1875d7b502fcad4419b46" Jul 30 23:18:27.496414 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.496399 2576 scope.go:117] "RemoveContainer" containerID="22f6e59056436df70e866eb37555eed381d723f72afaf26d9ead2799c93db154" Jul 30 23:18:27.502952 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.502879 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" podStartSLOduration=1.502839964 podStartE2EDuration="1.502839964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:18:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:18:27.499761848 +0000 UTC m=+1834.703581085" watchObservedRunningTime="2026-07-30 23:18:27.502839964 +0000 UTC m=+1834.706659199" Jul 30 23:18:27.505831 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.505810 2576 scope.go:117] "RemoveContainer" containerID="4d9a1f96924b3c28367f63fbc0cac87dac2d3ca04ae1875d7b502fcad4419b46" Jul 30 23:18:27.506283 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:18:27.506251 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d9a1f96924b3c28367f63fbc0cac87dac2d3ca04ae1875d7b502fcad4419b46\": container with ID starting with 4d9a1f96924b3c28367f63fbc0cac87dac2d3ca04ae1875d7b502fcad4419b46 not found: ID does not exist" containerID="4d9a1f96924b3c28367f63fbc0cac87dac2d3ca04ae1875d7b502fcad4419b46" Jul 30 23:18:27.506392 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.506300 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d9a1f96924b3c28367f63fbc0cac87dac2d3ca04ae1875d7b502fcad4419b46"} err="failed to get container status \"4d9a1f96924b3c28367f63fbc0cac87dac2d3ca04ae1875d7b502fcad4419b46\": rpc error: code = NotFound desc = could not find container \"4d9a1f96924b3c28367f63fbc0cac87dac2d3ca04ae1875d7b502fcad4419b46\": container with ID starting with 4d9a1f96924b3c28367f63fbc0cac87dac2d3ca04ae1875d7b502fcad4419b46 not found: ID does not exist" Jul 30 23:18:27.506392 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.506323 2576 scope.go:117] "RemoveContainer" containerID="22f6e59056436df70e866eb37555eed381d723f72afaf26d9ead2799c93db154" Jul 30 23:18:27.506880 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:18:27.506727 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22f6e59056436df70e866eb37555eed381d723f72afaf26d9ead2799c93db154\": container with ID starting with 22f6e59056436df70e866eb37555eed381d723f72afaf26d9ead2799c93db154 not found: ID does not exist" containerID="22f6e59056436df70e866eb37555eed381d723f72afaf26d9ead2799c93db154" Jul 30 23:18:27.506880 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.506768 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22f6e59056436df70e866eb37555eed381d723f72afaf26d9ead2799c93db154"} err="failed to get container status \"22f6e59056436df70e866eb37555eed381d723f72afaf26d9ead2799c93db154\": rpc error: code = NotFound desc = could not find container \"22f6e59056436df70e866eb37555eed381d723f72afaf26d9ead2799c93db154\": container with ID starting with 22f6e59056436df70e866eb37555eed381d723f72afaf26d9ead2799c93db154 not found: ID does not exist" Jul 30 23:18:27.518651 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.518609 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" podStartSLOduration=1.518597094 podStartE2EDuration="1.518597094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:18:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:18:27.515737658 +0000 UTC m=+1834.719556892" watchObservedRunningTime="2026-07-30 23:18:27.518597094 +0000 UTC m=+1834.722416349" Jul 30 23:18:27.530705 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.530685 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl"] Jul 30 23:18:27.534968 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:27.534945 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-68124529-openshift-default-5674d5bfb6-c6gdl"] Jul 30 23:18:29.239619 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:29.239587 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a14e746-70f3-49c2-b928-00213927266e" path="/var/lib/kubelet/pods/2a14e746-70f3-49c2-b928-00213927266e/volumes" Jul 30 23:18:38.496439 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:38.496408 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" Jul 30 23:18:38.496945 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:38.496478 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" Jul 30 23:18:39.558275 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:39.558241 2576 generic.go:356] "Generic (PLEG): container finished" podID="ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" containerID="74a9edd754103fe3b8933035ad8f5ae513af6ef6bfb3f4f073b59bf3fbb082bf" exitCode=0 Jul 30 23:18:39.558710 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:39.558319 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" event={"ID":"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae","Type":"ContainerDied","Data":"74a9edd754103fe3b8933035ad8f5ae513af6ef6bfb3f4f073b59bf3fbb082bf"} Jul 30 23:18:39.558710 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:39.558693 2576 scope.go:117] "RemoveContainer" containerID="74a9edd754103fe3b8933035ad8f5ae513af6ef6bfb3f4f073b59bf3fbb082bf" Jul 30 23:18:39.559755 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:39.559727 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:18:39.559853 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:39.559833 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:18:39.559913 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:39.559897 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:18:40.472317 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:40.472281 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:40.574048 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:40.574002 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" event={"ID":"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae","Type":"ContainerStarted","Data":"53309351323cf68e6c2ad649f22bc43c2e01b7586dfb4fd144a0de4c42ce5de7"} Jul 30 23:18:40.830624 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:40.830536 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:40.831628 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:40.831605 2576 patch_prober.go:28] interesting pod/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 30 23:18:40.831687 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:40.831654 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" podUID="ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 30 23:18:41.829920 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:41.829887 2576 patch_prober.go:28] interesting pod/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 30 23:18:41.830318 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:41.829939 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" podUID="ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 30 23:18:42.830487 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:42.830449 2576 patch_prober.go:28] interesting pod/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 30 23:18:42.830981 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:42.830510 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" podUID="ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 30 23:18:43.830793 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:43.830751 2576 patch_prober.go:28] interesting pod/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 30 23:18:43.831195 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:43.830806 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" podUID="ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 30 23:18:44.830474 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:44.830438 2576 patch_prober.go:28] interesting pod/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Jul 30 23:18:44.830706 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:44.830512 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" podUID="ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Jul 30 23:18:45.833590 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:45.833560 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:45.834066 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:45.833975 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:45.834637 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:45.834621 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:18:49.770502 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:49.770466 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7a3e722-px89s"] Jul 30 23:18:49.771041 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:49.770990 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a14e746-70f3-49c2-b928-00213927266e" containerName="istio-proxy" Jul 30 23:18:49.771041 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:49.771009 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a14e746-70f3-49c2-b928-00213927266e" containerName="istio-proxy" Jul 30 23:18:49.771158 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:49.771122 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a14e746-70f3-49c2-b928-00213927266e" containerName="istio-proxy" Jul 30 23:18:49.774452 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:49.774431 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7a3e722-px89s" Jul 30 23:18:49.776875 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:49.776846 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52wcc\"" Jul 30 23:18:49.777050 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:49.777032 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 23:18:49.783352 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:49.783330 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7a3e722-px89s"] Jul 30 23:18:49.858984 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:49.858941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59e196d5-e2ad-48dc-b6f6-541c935e053c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c7a3e722-px89s\" (UID: \"59e196d5-e2ad-48dc-b6f6-541c935e053c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7a3e722-px89s" Jul 30 23:18:49.960001 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:49.959960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59e196d5-e2ad-48dc-b6f6-541c935e053c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c7a3e722-px89s\" (UID: \"59e196d5-e2ad-48dc-b6f6-541c935e053c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7a3e722-px89s" Jul 30 23:18:49.960642 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:49.960613 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59e196d5-e2ad-48dc-b6f6-541c935e053c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c7a3e722-px89s\" (UID: \"59e196d5-e2ad-48dc-b6f6-541c935e053c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7a3e722-px89s" Jul 30 23:18:50.085401 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:50.085315 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7a3e722-px89s" Jul 30 23:18:50.214591 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:50.214567 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7a3e722-px89s"] Jul 30 23:18:50.216436 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:18:50.216406 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e196d5_e2ad_48dc_b6f6_541c935e053c.slice/crio-9e60e5e6bee5f46250e416afe8db1159702bf49242f3a3479fa8957bcfb0bf23 WatchSource:0}: Error finding container 9e60e5e6bee5f46250e416afe8db1159702bf49242f3a3479fa8957bcfb0bf23: Status 404 returned error can't find the container with id 9e60e5e6bee5f46250e416afe8db1159702bf49242f3a3479fa8957bcfb0bf23 Jul 30 23:18:50.628538 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:50.628501 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7a3e722-px89s" event={"ID":"59e196d5-e2ad-48dc-b6f6-541c935e053c","Type":"ContainerStarted","Data":"ff1724f3dd0deba726cc02299f2a81d8392fbc35de6987e6c299d377904b6fe3"} Jul 30 23:18:50.628702 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:50.628553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7a3e722-px89s" event={"ID":"59e196d5-e2ad-48dc-b6f6-541c935e053c","Type":"ContainerStarted","Data":"9e60e5e6bee5f46250e416afe8db1159702bf49242f3a3479fa8957bcfb0bf23"} Jul 30 23:18:50.646912 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:50.646849 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7a3e722-px89s" podStartSLOduration=1.6468317460000002 podStartE2EDuration="1.646831746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:18:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:18:50.645482025 +0000 UTC m=+1857.849301258" watchObservedRunningTime="2026-07-30 23:18:50.646831746 +0000 UTC m=+1857.850650976" Jul 30 23:18:51.635622 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:51.635589 2576 generic.go:356] "Generic (PLEG): container finished" podID="59e196d5-e2ad-48dc-b6f6-541c935e053c" containerID="ff1724f3dd0deba726cc02299f2a81d8392fbc35de6987e6c299d377904b6fe3" exitCode=0 Jul 30 23:18:51.636088 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:51.635666 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7a3e722-px89s" event={"ID":"59e196d5-e2ad-48dc-b6f6-541c935e053c","Type":"ContainerDied","Data":"ff1724f3dd0deba726cc02299f2a81d8392fbc35de6987e6c299d377904b6fe3"} Jul 30 23:18:52.767642 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:52.767618 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7a3e722-px89s" Jul 30 23:18:52.884707 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:52.884672 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59e196d5-e2ad-48dc-b6f6-541c935e053c-maas-api-service-ca\") pod \"59e196d5-e2ad-48dc-b6f6-541c935e053c\" (UID: \"59e196d5-e2ad-48dc-b6f6-541c935e053c\") " Jul 30 23:18:52.885071 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:52.885048 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59e196d5-e2ad-48dc-b6f6-541c935e053c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "59e196d5-e2ad-48dc-b6f6-541c935e053c" (UID: "59e196d5-e2ad-48dc-b6f6-541c935e053c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:18:52.985770 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:52.985696 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59e196d5-e2ad-48dc-b6f6-541c935e053c-maas-api-service-ca\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:53.648036 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:53.648006 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7a3e722-px89s" Jul 30 23:18:53.648187 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:53.648010 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7a3e722-px89s" event={"ID":"59e196d5-e2ad-48dc-b6f6-541c935e053c","Type":"ContainerDied","Data":"9e60e5e6bee5f46250e416afe8db1159702bf49242f3a3479fa8957bcfb0bf23"} Jul 30 23:18:53.648187 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:53.648124 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e60e5e6bee5f46250e416afe8db1159702bf49242f3a3479fa8957bcfb0bf23" Jul 30 23:18:56.453234 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.453202 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk"] Jul 30 23:18:56.453617 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.453406 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" podUID="6013841e-6af3-4466-aac2-63b775a8637e" containerName="payload-processing" containerID="cri-o://981c50e91a4d285d139051f530731a69f09ee054d8224a3dc259321d8d03aa13" gracePeriod=30 Jul 30 23:18:56.484713 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.484683 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn"] Jul 30 23:18:56.484959 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.484927 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" podUID="ff57b2eb-16f4-402d-ac80-f0437987cade" containerName="payload-pre-processing" containerID="cri-o://b3c004e3a08823b25471b9f93fe9830a684aaebed33f9976b9697f4ada397531" gracePeriod=30 Jul 30 23:18:56.621960 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.621914 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7a3e722-px89s"] Jul 30 23:18:56.625105 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.625074 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7a3e722-px89s"] Jul 30 23:18:56.673376 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.672349 2576 generic.go:356] "Generic (PLEG): container finished" podID="6013841e-6af3-4466-aac2-63b775a8637e" containerID="981c50e91a4d285d139051f530731a69f09ee054d8224a3dc259321d8d03aa13" exitCode=0 Jul 30 23:18:56.673376 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.672400 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" event={"ID":"6013841e-6af3-4466-aac2-63b775a8637e","Type":"ContainerDied","Data":"981c50e91a4d285d139051f530731a69f09ee054d8224a3dc259321d8d03aa13"} Jul 30 23:18:56.676263 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.674973 2576 generic.go:356] "Generic (PLEG): container finished" podID="ff57b2eb-16f4-402d-ac80-f0437987cade" containerID="b3c004e3a08823b25471b9f93fe9830a684aaebed33f9976b9697f4ada397531" exitCode=0 Jul 30 23:18:56.676263 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.675027 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" event={"ID":"ff57b2eb-16f4-402d-ac80-f0437987cade","Type":"ContainerDied","Data":"b3c004e3a08823b25471b9f93fe9830a684aaebed33f9976b9697f4ada397531"} Jul 30 23:18:56.742208 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.742103 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" Jul 30 23:18:56.772428 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.772400 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448"] Jul 30 23:18:56.772639 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.772613 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" podUID="ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" containerName="istio-proxy" containerID="cri-o://53309351323cf68e6c2ad649f22bc43c2e01b7586dfb4fd144a0de4c42ce5de7" gracePeriod=30 Jul 30 23:18:56.797618 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.797590 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" Jul 30 23:18:56.923795 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.923763 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6013841e-6af3-4466-aac2-63b775a8637e-plugins-config-volume\") pod \"6013841e-6af3-4466-aac2-63b775a8637e\" (UID: \"6013841e-6af3-4466-aac2-63b775a8637e\") " Jul 30 23:18:56.923979 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.923828 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff57b2eb-16f4-402d-ac80-f0437987cade-plugins-config-volume\") pod \"ff57b2eb-16f4-402d-ac80-f0437987cade\" (UID: \"ff57b2eb-16f4-402d-ac80-f0437987cade\") " Jul 30 23:18:56.923979 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.923896 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksdrt\" (UniqueName: \"kubernetes.io/projected/6013841e-6af3-4466-aac2-63b775a8637e-kube-api-access-ksdrt\") pod \"6013841e-6af3-4466-aac2-63b775a8637e\" (UID: \"6013841e-6af3-4466-aac2-63b775a8637e\") " Jul 30 23:18:56.923979 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.923924 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh5j7\" (UniqueName: \"kubernetes.io/projected/ff57b2eb-16f4-402d-ac80-f0437987cade-kube-api-access-kh5j7\") pod \"ff57b2eb-16f4-402d-ac80-f0437987cade\" (UID: \"ff57b2eb-16f4-402d-ac80-f0437987cade\") " Jul 30 23:18:56.924183 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.924158 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6013841e-6af3-4466-aac2-63b775a8637e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6013841e-6af3-4466-aac2-63b775a8637e" (UID: "6013841e-6af3-4466-aac2-63b775a8637e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:18:56.924183 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.924159 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff57b2eb-16f4-402d-ac80-f0437987cade-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ff57b2eb-16f4-402d-ac80-f0437987cade" (UID: "ff57b2eb-16f4-402d-ac80-f0437987cade"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:18:56.924326 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.924247 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff57b2eb-16f4-402d-ac80-f0437987cade-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:56.924326 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.924264 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6013841e-6af3-4466-aac2-63b775a8637e-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:56.925854 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.925831 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6013841e-6af3-4466-aac2-63b775a8637e-kube-api-access-ksdrt" (OuterVolumeSpecName: "kube-api-access-ksdrt") pod "6013841e-6af3-4466-aac2-63b775a8637e" (UID: "6013841e-6af3-4466-aac2-63b775a8637e"). InnerVolumeSpecName "kube-api-access-ksdrt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:18:56.925952 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:56.925924 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff57b2eb-16f4-402d-ac80-f0437987cade-kube-api-access-kh5j7" (OuterVolumeSpecName: "kube-api-access-kh5j7") pod "ff57b2eb-16f4-402d-ac80-f0437987cade" (UID: "ff57b2eb-16f4-402d-ac80-f0437987cade"). InnerVolumeSpecName "kube-api-access-kh5j7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:18:57.025638 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:57.025548 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksdrt\" (UniqueName: \"kubernetes.io/projected/6013841e-6af3-4466-aac2-63b775a8637e-kube-api-access-ksdrt\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:57.025638 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:57.025582 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh5j7\" (UniqueName: \"kubernetes.io/projected/ff57b2eb-16f4-402d-ac80-f0437987cade-kube-api-access-kh5j7\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:18:57.236943 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:57.236904 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59e196d5-e2ad-48dc-b6f6-541c935e053c" path="/var/lib/kubelet/pods/59e196d5-e2ad-48dc-b6f6-541c935e053c/volumes" Jul 30 23:18:57.682723 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:57.682698 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" Jul 30 23:18:57.682723 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:57.682728 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn" event={"ID":"ff57b2eb-16f4-402d-ac80-f0437987cade","Type":"ContainerDied","Data":"af02d566d6c6bb2c2d8bbc06cf676733fbdf7913f796b9ed7c4de6f8bb576da6"} Jul 30 23:18:57.683276 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:57.682787 2576 scope.go:117] "RemoveContainer" containerID="b3c004e3a08823b25471b9f93fe9830a684aaebed33f9976b9697f4ada397531" Jul 30 23:18:57.684136 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:57.684075 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" event={"ID":"6013841e-6af3-4466-aac2-63b775a8637e","Type":"ContainerDied","Data":"e6a53e3a1747dbe053e072086bc63f7289986685d44094ab71c51a2674b710c1"} Jul 30 23:18:57.684136 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:57.684091 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk" Jul 30 23:18:57.691641 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:57.691623 2576 scope.go:117] "RemoveContainer" containerID="981c50e91a4d285d139051f530731a69f09ee054d8224a3dc259321d8d03aa13" Jul 30 23:18:57.703371 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:57.703346 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk"] Jul 30 23:18:57.711410 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:57.711389 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-c7a3e722-7bbf7467c8-v8ksk"] Jul 30 23:18:57.723586 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:57.723533 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn"] Jul 30 23:18:57.726962 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:57.726939 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c7a3e722-674974bc8d-p24nn"] Jul 30 23:18:59.235813 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:59.235777 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6013841e-6af3-4466-aac2-63b775a8637e" path="/var/lib/kubelet/pods/6013841e-6af3-4466-aac2-63b775a8637e/volumes" Jul 30 23:18:59.236207 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:18:59.236163 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff57b2eb-16f4-402d-ac80-f0437987cade" path="/var/lib/kubelet/pods/ff57b2eb-16f4-402d-ac80-f0437987cade/volumes" Jul 30 23:19:00.835939 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:00.835906 2576 patch_prober.go:28] interesting pod/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 23:19:00.836296 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:00.835960 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" podUID="ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 23:19:02.019472 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.019447 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:19:02.069726 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.069693 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-podinfo\") pod \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " Jul 30 23:19:02.069726 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.069731 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-workload-certs\") pod \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " Jul 30 23:19:02.069979 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.069767 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zvqf\" (UniqueName: \"kubernetes.io/projected/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-kube-api-access-4zvqf\") pod \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " Jul 30 23:19:02.069979 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.069787 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-workload-socket\") pod \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " Jul 30 23:19:02.069979 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.069802 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-credential-socket\") pod \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " Jul 30 23:19:02.069979 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.069829 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istiod-ca-cert\") pod \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " Jul 30 23:19:02.069979 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.069916 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-token\") pod \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " Jul 30 23:19:02.069979 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.069946 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-data\") pod \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " Jul 30 23:19:02.070284 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.070012 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-envoy\") pod \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\" (UID: \"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae\") " Jul 30 23:19:02.070284 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.070165 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" (UID: "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:19:02.070284 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.070171 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" (UID: "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:19:02.070446 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.070282 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" (UID: "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:19:02.070446 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.070327 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:19:02.070446 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.070411 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:19:02.070446 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.070359 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-data" (OuterVolumeSpecName: "istio-data") pod "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" (UID: "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:19:02.070446 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.070420 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" (UID: "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:19:02.072042 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.071983 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" (UID: "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 23:19:02.072127 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.072094 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" (UID: "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:19:02.072298 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.072282 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-token" (OuterVolumeSpecName: "istio-token") pod "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" (UID: "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:19:02.072439 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.072421 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-kube-api-access-4zvqf" (OuterVolumeSpecName: "kube-api-access-4zvqf") pod "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" (UID: "ba1e7c01-f9b4-477c-8e01-c79fb82f97ae"). InnerVolumeSpecName "kube-api-access-4zvqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:19:02.171007 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.170973 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:19:02.171007 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.170999 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zvqf\" (UniqueName: \"kubernetes.io/projected/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-kube-api-access-4zvqf\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:19:02.171007 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.171008 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:19:02.171007 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.171017 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:19:02.171263 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.171024 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:19:02.171263 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.171036 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:19:02.171263 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.171044 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:19:02.713439 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.713399 2576 generic.go:356] "Generic (PLEG): container finished" podID="ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" containerID="53309351323cf68e6c2ad649f22bc43c2e01b7586dfb4fd144a0de4c42ce5de7" exitCode=0 Jul 30 23:19:02.713590 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.713454 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" Jul 30 23:19:02.713590 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.713488 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" event={"ID":"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae","Type":"ContainerDied","Data":"53309351323cf68e6c2ad649f22bc43c2e01b7586dfb4fd144a0de4c42ce5de7"} Jul 30 23:19:02.713590 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.713554 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448" event={"ID":"ba1e7c01-f9b4-477c-8e01-c79fb82f97ae","Type":"ContainerDied","Data":"98ad4e1241b314a64f2f4e57d1070738e3a102434ec69b8a2dbfa05d8a676aa4"} Jul 30 23:19:02.713590 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.713582 2576 scope.go:117] "RemoveContainer" containerID="53309351323cf68e6c2ad649f22bc43c2e01b7586dfb4fd144a0de4c42ce5de7" Jul 30 23:19:02.722793 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.722773 2576 scope.go:117] "RemoveContainer" containerID="74a9edd754103fe3b8933035ad8f5ae513af6ef6bfb3f4f073b59bf3fbb082bf" Jul 30 23:19:02.730716 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.730696 2576 scope.go:117] "RemoveContainer" containerID="53309351323cf68e6c2ad649f22bc43c2e01b7586dfb4fd144a0de4c42ce5de7" Jul 30 23:19:02.730975 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:19:02.730955 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53309351323cf68e6c2ad649f22bc43c2e01b7586dfb4fd144a0de4c42ce5de7\": container with ID starting with 53309351323cf68e6c2ad649f22bc43c2e01b7586dfb4fd144a0de4c42ce5de7 not found: ID does not exist" containerID="53309351323cf68e6c2ad649f22bc43c2e01b7586dfb4fd144a0de4c42ce5de7" Jul 30 23:19:02.731023 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.730983 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53309351323cf68e6c2ad649f22bc43c2e01b7586dfb4fd144a0de4c42ce5de7"} err="failed to get container status \"53309351323cf68e6c2ad649f22bc43c2e01b7586dfb4fd144a0de4c42ce5de7\": rpc error: code = NotFound desc = could not find container \"53309351323cf68e6c2ad649f22bc43c2e01b7586dfb4fd144a0de4c42ce5de7\": container with ID starting with 53309351323cf68e6c2ad649f22bc43c2e01b7586dfb4fd144a0de4c42ce5de7 not found: ID does not exist" Jul 30 23:19:02.731023 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.731008 2576 scope.go:117] "RemoveContainer" containerID="74a9edd754103fe3b8933035ad8f5ae513af6ef6bfb3f4f073b59bf3fbb082bf" Jul 30 23:19:02.731232 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:19:02.731214 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74a9edd754103fe3b8933035ad8f5ae513af6ef6bfb3f4f073b59bf3fbb082bf\": container with ID starting with 74a9edd754103fe3b8933035ad8f5ae513af6ef6bfb3f4f073b59bf3fbb082bf not found: ID does not exist" containerID="74a9edd754103fe3b8933035ad8f5ae513af6ef6bfb3f4f073b59bf3fbb082bf" Jul 30 23:19:02.731277 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.731240 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74a9edd754103fe3b8933035ad8f5ae513af6ef6bfb3f4f073b59bf3fbb082bf"} err="failed to get container status \"74a9edd754103fe3b8933035ad8f5ae513af6ef6bfb3f4f073b59bf3fbb082bf\": rpc error: code = NotFound desc = could not find container \"74a9edd754103fe3b8933035ad8f5ae513af6ef6bfb3f4f073b59bf3fbb082bf\": container with ID starting with 74a9edd754103fe3b8933035ad8f5ae513af6ef6bfb3f4f073b59bf3fbb082bf not found: ID does not exist" Jul 30 23:19:02.734573 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.734551 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448"] Jul 30 23:19:02.738128 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:02.738107 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-c7a3e722-openshift-default-868955c69b-fs448"] Jul 30 23:19:03.236364 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:19:03.236330 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" path="/var/lib/kubelet/pods/ba1e7c01-f9b4-477c-8e01-c79fb82f97ae/volumes" Jul 30 23:20:54.601693 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.601652 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8"] Jul 30 23:20:54.602311 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.602143 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6013841e-6af3-4466-aac2-63b775a8637e" containerName="payload-processing" Jul 30 23:20:54.602311 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.602162 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6013841e-6af3-4466-aac2-63b775a8637e" containerName="payload-processing" Jul 30 23:20:54.602311 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.602183 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" containerName="istio-proxy" Jul 30 23:20:54.602311 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.602192 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" containerName="istio-proxy" Jul 30 23:20:54.602311 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.602203 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59e196d5-e2ad-48dc-b6f6-541c935e053c" containerName="revoke-keys" Jul 30 23:20:54.602311 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.602212 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="59e196d5-e2ad-48dc-b6f6-541c935e053c" containerName="revoke-keys" Jul 30 23:20:54.602311 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.602224 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" containerName="istio-proxy" Jul 30 23:20:54.602311 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.602233 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" containerName="istio-proxy" Jul 30 23:20:54.602311 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.602245 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff57b2eb-16f4-402d-ac80-f0437987cade" containerName="payload-pre-processing" Jul 30 23:20:54.602311 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.602254 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff57b2eb-16f4-402d-ac80-f0437987cade" containerName="payload-pre-processing" Jul 30 23:20:54.602311 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.602263 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a14e746-70f3-49c2-b928-00213927266e" containerName="istio-proxy" Jul 30 23:20:54.602311 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.602271 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a14e746-70f3-49c2-b928-00213927266e" containerName="istio-proxy" Jul 30 23:20:54.602931 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.602362 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" containerName="istio-proxy" Jul 30 23:20:54.602931 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.602376 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="59e196d5-e2ad-48dc-b6f6-541c935e053c" containerName="revoke-keys" Jul 30 23:20:54.602931 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.602387 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6013841e-6af3-4466-aac2-63b775a8637e" containerName="payload-processing" Jul 30 23:20:54.602931 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.602396 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a14e746-70f3-49c2-b928-00213927266e" containerName="istio-proxy" Jul 30 23:20:54.602931 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.602404 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff57b2eb-16f4-402d-ac80-f0437987cade" containerName="payload-pre-processing" Jul 30 23:20:54.605562 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.605541 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.607984 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.607966 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7cec9427-openshift-default-dockercfg-j7vw6\"" Jul 30 23:20:54.623662 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.623606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-data\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.623774 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.623678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-credential-socket\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.623774 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.623707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjt9j\" (UniqueName: \"kubernetes.io/projected/e787d02d-eeec-4a3c-a95a-929b4d5084b3-kube-api-access-tjt9j\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.623774 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.623739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-podinfo\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.623956 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.623778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-envoy\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.623956 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.623813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-workload-certs\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.623956 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.623892 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-token\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.623956 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.623929 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istiod-ca-cert\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.624149 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.624038 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-workload-socket\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.626878 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.626834 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8"] Jul 30 23:20:54.725392 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.725356 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-data\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.725577 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.725399 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-credential-socket\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.725577 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.725423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjt9j\" (UniqueName: \"kubernetes.io/projected/e787d02d-eeec-4a3c-a95a-929b4d5084b3-kube-api-access-tjt9j\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.725577 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.725441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-podinfo\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.725577 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.725464 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-envoy\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.725577 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.725485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-workload-certs\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.725577 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.725500 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-token\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.725948 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.725640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istiod-ca-cert\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.725948 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.725723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-workload-socket\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.725948 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.725848 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-credential-socket\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.725948 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.725908 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-workload-certs\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.726113 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.725958 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-data\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.726198 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.726178 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-workload-socket\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.726441 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.726423 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istiod-ca-cert\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.727803 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.727781 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-envoy\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.727909 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.727829 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-podinfo\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.733847 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.733824 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-token\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.733999 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.733981 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjt9j\" (UniqueName: \"kubernetes.io/projected/e787d02d-eeec-4a3c-a95a-929b4d5084b3-kube-api-access-tjt9j\") pod \"e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:54.916125 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:54.916090 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:55.050718 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:55.050693 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8"] Jul 30 23:20:55.052383 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:20:55.052358 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode787d02d_eeec_4a3c_a95a_929b4d5084b3.slice/crio-2dff98af8208f74ccd5f4d0415dcafe554b6c675b5d4e99ad1f6c0b85b30d3da WatchSource:0}: Error finding container 2dff98af8208f74ccd5f4d0415dcafe554b6c675b5d4e99ad1f6c0b85b30d3da: Status 404 returned error can't find the container with id 2dff98af8208f74ccd5f4d0415dcafe554b6c675b5d4e99ad1f6c0b85b30d3da Jul 30 23:20:55.054449 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:55.054405 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:20:55.054520 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:55.054498 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:20:55.054564 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:55.054541 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:20:55.310350 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:55.310263 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" event={"ID":"e787d02d-eeec-4a3c-a95a-929b4d5084b3","Type":"ContainerStarted","Data":"6bd61a61c85a7259a99ffb295e49a04a5ef098069f576dd2f598fb34573e70f5"} Jul 30 23:20:55.310350 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:55.310314 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" event={"ID":"e787d02d-eeec-4a3c-a95a-929b4d5084b3","Type":"ContainerStarted","Data":"2dff98af8208f74ccd5f4d0415dcafe554b6c675b5d4e99ad1f6c0b85b30d3da"} Jul 30 23:20:55.333746 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:55.333697 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" podStartSLOduration=1.333682487 podStartE2EDuration="1.333682487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:20:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:20:55.3313901 +0000 UTC m=+1982.535209345" watchObservedRunningTime="2026-07-30 23:20:55.333682487 +0000 UTC m=+1982.537501720" Jul 30 23:20:55.916446 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:55.916412 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:56.921700 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:56.921666 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:57.325753 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:57.325680 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:57.326717 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:57.326700 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:20:59.346303 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.346269 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4"] Jul 30 23:20:59.346765 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.346747 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1e7c01-f9b4-477c-8e01-c79fb82f97ae" containerName="istio-proxy" Jul 30 23:20:59.349768 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.349753 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" Jul 30 23:20:59.352724 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.352704 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-7cec9427\"" Jul 30 23:20:59.352810 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.352704 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-7cec9427-dockercfg-2ckdt\"" Jul 30 23:20:59.360052 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.360030 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4"] Jul 30 23:20:59.365037 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.364984 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c3482b6-82d9-4a7c-ac25-895a5802d28d-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4\" (UID: \"2c3482b6-82d9-4a7c-ac25-895a5802d28d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" Jul 30 23:20:59.365360 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.365338 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9srl7\" (UniqueName: \"kubernetes.io/projected/2c3482b6-82d9-4a7c-ac25-895a5802d28d-kube-api-access-9srl7\") pod \"payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4\" (UID: \"2c3482b6-82d9-4a7c-ac25-895a5802d28d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" Jul 30 23:20:59.383852 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.383828 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9"] Jul 30 23:20:59.387218 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.387201 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" Jul 30 23:20:59.398575 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.398554 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9"] Jul 30 23:20:59.466289 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.466252 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dhd7\" (UniqueName: \"kubernetes.io/projected/543f73d4-f90d-4eef-a919-7002ac6592f5-kube-api-access-9dhd7\") pod \"payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9\" (UID: \"543f73d4-f90d-4eef-a919-7002ac6592f5\") " pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" Jul 30 23:20:59.466462 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.466307 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c3482b6-82d9-4a7c-ac25-895a5802d28d-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4\" (UID: \"2c3482b6-82d9-4a7c-ac25-895a5802d28d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" Jul 30 23:20:59.466462 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.466377 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9srl7\" (UniqueName: \"kubernetes.io/projected/2c3482b6-82d9-4a7c-ac25-895a5802d28d-kube-api-access-9srl7\") pod \"payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4\" (UID: \"2c3482b6-82d9-4a7c-ac25-895a5802d28d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" Jul 30 23:20:59.466462 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.466434 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/543f73d4-f90d-4eef-a919-7002ac6592f5-plugins-config-volume\") pod \"payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9\" (UID: \"543f73d4-f90d-4eef-a919-7002ac6592f5\") " pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" Jul 30 23:20:59.467078 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.467059 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c3482b6-82d9-4a7c-ac25-895a5802d28d-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4\" (UID: \"2c3482b6-82d9-4a7c-ac25-895a5802d28d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" Jul 30 23:20:59.475947 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.475920 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9srl7\" (UniqueName: \"kubernetes.io/projected/2c3482b6-82d9-4a7c-ac25-895a5802d28d-kube-api-access-9srl7\") pod \"payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4\" (UID: \"2c3482b6-82d9-4a7c-ac25-895a5802d28d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" Jul 30 23:20:59.567384 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.567346 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/543f73d4-f90d-4eef-a919-7002ac6592f5-plugins-config-volume\") pod \"payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9\" (UID: \"543f73d4-f90d-4eef-a919-7002ac6592f5\") " pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" Jul 30 23:20:59.567547 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.567400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dhd7\" (UniqueName: \"kubernetes.io/projected/543f73d4-f90d-4eef-a919-7002ac6592f5-kube-api-access-9dhd7\") pod \"payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9\" (UID: \"543f73d4-f90d-4eef-a919-7002ac6592f5\") " pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" Jul 30 23:20:59.568052 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.568032 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/543f73d4-f90d-4eef-a919-7002ac6592f5-plugins-config-volume\") pod \"payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9\" (UID: \"543f73d4-f90d-4eef-a919-7002ac6592f5\") " pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" Jul 30 23:20:59.576665 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.576634 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dhd7\" (UniqueName: \"kubernetes.io/projected/543f73d4-f90d-4eef-a919-7002ac6592f5-kube-api-access-9dhd7\") pod \"payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9\" (UID: \"543f73d4-f90d-4eef-a919-7002ac6592f5\") " pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" Jul 30 23:20:59.661426 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.661394 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" Jul 30 23:20:59.697754 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.697722 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" Jul 30 23:20:59.811415 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.811378 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4"] Jul 30 23:20:59.812922 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:20:59.812885 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3482b6_82d9_4a7c_ac25_895a5802d28d.slice/crio-1b2afa902dbfdb68e2a349673d7c7a5aae039d3e15953d6b5bf014f7ee8b1b0d WatchSource:0}: Error finding container 1b2afa902dbfdb68e2a349673d7c7a5aae039d3e15953d6b5bf014f7ee8b1b0d: Status 404 returned error can't find the container with id 1b2afa902dbfdb68e2a349673d7c7a5aae039d3e15953d6b5bf014f7ee8b1b0d Jul 30 23:20:59.839168 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:20:59.839140 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9"] Jul 30 23:20:59.846073 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:20:59.846033 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543f73d4_f90d_4eef_a919_7002ac6592f5.slice/crio-3c85a5ac5b642c175ca267fe8b2de59c07cb3a5f2bb41268092c6f6b8569664e WatchSource:0}: Error finding container 3c85a5ac5b642c175ca267fe8b2de59c07cb3a5f2bb41268092c6f6b8569664e: Status 404 returned error can't find the container with id 3c85a5ac5b642c175ca267fe8b2de59c07cb3a5f2bb41268092c6f6b8569664e Jul 30 23:21:00.344305 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:00.344268 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" event={"ID":"543f73d4-f90d-4eef-a919-7002ac6592f5","Type":"ContainerStarted","Data":"7e0fcad14872c61df9e6883df549596fc8cd19421db2cfe35e1a3ef4a7aaa1c1"} Jul 30 23:21:00.344507 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:00.344330 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" event={"ID":"543f73d4-f90d-4eef-a919-7002ac6592f5","Type":"ContainerStarted","Data":"3c85a5ac5b642c175ca267fe8b2de59c07cb3a5f2bb41268092c6f6b8569664e"} Jul 30 23:21:00.344507 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:00.344381 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" Jul 30 23:21:00.346080 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:00.346058 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" event={"ID":"2c3482b6-82d9-4a7c-ac25-895a5802d28d","Type":"ContainerStarted","Data":"4d3e419b0108444aae9b88d5a525a3af389ed77423726e17e2c57dc728639431"} Jul 30 23:21:00.346243 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:00.346092 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" event={"ID":"2c3482b6-82d9-4a7c-ac25-895a5802d28d","Type":"ContainerStarted","Data":"1b2afa902dbfdb68e2a349673d7c7a5aae039d3e15953d6b5bf014f7ee8b1b0d"} Jul 30 23:21:00.346243 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:00.346188 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" Jul 30 23:21:00.360338 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:00.360294 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" podStartSLOduration=1.360281506 podStartE2EDuration="1.360281506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:20:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:21:00.358693208 +0000 UTC m=+1987.562512466" watchObservedRunningTime="2026-07-30 23:21:00.360281506 +0000 UTC m=+1987.564100792" Jul 30 23:21:00.380933 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:00.380888 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" podStartSLOduration=1.380872646 podStartE2EDuration="1.380872646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:20:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:21:00.379292739 +0000 UTC m=+1987.583111997" watchObservedRunningTime="2026-07-30 23:21:00.380872646 +0000 UTC m=+1987.584691878" Jul 30 23:21:11.355482 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:11.355400 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" Jul 30 23:21:11.355482 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:11.355470 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" Jul 30 23:21:11.416233 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:11.416206 2576 generic.go:356] "Generic (PLEG): container finished" podID="e787d02d-eeec-4a3c-a95a-929b4d5084b3" containerID="6bd61a61c85a7259a99ffb295e49a04a5ef098069f576dd2f598fb34573e70f5" exitCode=0 Jul 30 23:21:11.416401 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:11.416295 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" event={"ID":"e787d02d-eeec-4a3c-a95a-929b4d5084b3","Type":"ContainerDied","Data":"6bd61a61c85a7259a99ffb295e49a04a5ef098069f576dd2f598fb34573e70f5"} Jul 30 23:21:11.416687 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:11.416665 2576 scope.go:117] "RemoveContainer" containerID="6bd61a61c85a7259a99ffb295e49a04a5ef098069f576dd2f598fb34573e70f5" Jul 30 23:21:11.417811 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:11.417782 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:21:11.417900 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:11.417883 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:21:11.417946 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:11.417936 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:21:12.326038 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:12.326006 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:21:12.430472 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:12.430436 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" event={"ID":"e787d02d-eeec-4a3c-a95a-929b4d5084b3","Type":"ContainerStarted","Data":"5bed726e266a17f3a1fa724e0d5b44c7066caef686cb10d1408f6b780e3c54aa"} Jul 30 23:21:12.917092 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:12.917054 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:21:12.918334 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:12.918309 2576 patch_prober.go:28] interesting pod/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 30 23:21:12.918452 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:12.918356 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" podUID="e787d02d-eeec-4a3c-a95a-929b4d5084b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 30 23:21:13.917449 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:13.917418 2576 patch_prober.go:28] interesting pod/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 30 23:21:13.917853 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:13.917470 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" podUID="e787d02d-eeec-4a3c-a95a-929b4d5084b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 30 23:21:14.916903 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:14.916835 2576 patch_prober.go:28] interesting pod/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 30 23:21:14.917087 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:14.916926 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" podUID="e787d02d-eeec-4a3c-a95a-929b4d5084b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 30 23:21:15.916691 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:15.916655 2576 patch_prober.go:28] interesting pod/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 30 23:21:15.917117 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:15.916715 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" podUID="e787d02d-eeec-4a3c-a95a-929b4d5084b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 30 23:21:16.917226 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:16.917191 2576 patch_prober.go:28] interesting pod/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 30 23:21:16.917634 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:16.917245 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" podUID="e787d02d-eeec-4a3c-a95a-929b4d5084b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 30 23:21:17.920578 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:17.920545 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:21:17.921034 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:17.920965 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:21:17.921493 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:17.921477 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:21:29.800490 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:29.800447 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cec9427-sx45b"] Jul 30 23:21:29.804108 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:29.804085 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cec9427-sx45b" Jul 30 23:21:29.806627 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:29.806607 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 23:21:29.806727 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:29.806702 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52wcc\"" Jul 30 23:21:29.811532 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:29.811505 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cec9427-sx45b"] Jul 30 23:21:29.946084 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:29.946037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4786004-0a14-4a45-8a1e-75394b1b81a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7cec9427-sx45b\" (UID: \"f4786004-0a14-4a45-8a1e-75394b1b81a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cec9427-sx45b" Jul 30 23:21:30.047476 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:30.047421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4786004-0a14-4a45-8a1e-75394b1b81a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7cec9427-sx45b\" (UID: \"f4786004-0a14-4a45-8a1e-75394b1b81a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cec9427-sx45b" Jul 30 23:21:30.048090 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:30.048070 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4786004-0a14-4a45-8a1e-75394b1b81a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7cec9427-sx45b\" (UID: \"f4786004-0a14-4a45-8a1e-75394b1b81a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cec9427-sx45b" Jul 30 23:21:30.116203 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:30.116130 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cec9427-sx45b" Jul 30 23:21:30.246081 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:30.246055 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cec9427-sx45b"] Jul 30 23:21:30.247567 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:21:30.247540 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4786004_0a14_4a45_8a1e_75394b1b81a7.slice/crio-bf7b6fa52a1bab761d37b9154ad07d1225d3f3a23291815814c005d8742ed9b7 WatchSource:0}: Error finding container bf7b6fa52a1bab761d37b9154ad07d1225d3f3a23291815814c005d8742ed9b7: Status 404 returned error can't find the container with id bf7b6fa52a1bab761d37b9154ad07d1225d3f3a23291815814c005d8742ed9b7 Jul 30 23:21:30.536818 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:30.536781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cec9427-sx45b" event={"ID":"f4786004-0a14-4a45-8a1e-75394b1b81a7","Type":"ContainerStarted","Data":"bec2ab221dfff89ee934c397133d252b2ad6e09308d3c8da098d13d4c7ecea7c"} Jul 30 23:21:30.537032 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:30.536837 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cec9427-sx45b" event={"ID":"f4786004-0a14-4a45-8a1e-75394b1b81a7","Type":"ContainerStarted","Data":"bf7b6fa52a1bab761d37b9154ad07d1225d3f3a23291815814c005d8742ed9b7"} Jul 30 23:21:30.552709 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:30.552666 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cec9427-sx45b" podStartSLOduration=1.552650554 podStartE2EDuration="1.552650554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:21:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:21:30.550188119 +0000 UTC m=+2017.754007354" watchObservedRunningTime="2026-07-30 23:21:30.552650554 +0000 UTC m=+2017.756469787" Jul 30 23:21:31.548836 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:31.548798 2576 generic.go:356] "Generic (PLEG): container finished" podID="f4786004-0a14-4a45-8a1e-75394b1b81a7" containerID="bec2ab221dfff89ee934c397133d252b2ad6e09308d3c8da098d13d4c7ecea7c" exitCode=0 Jul 30 23:21:31.549218 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:31.548894 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cec9427-sx45b" event={"ID":"f4786004-0a14-4a45-8a1e-75394b1b81a7","Type":"ContainerDied","Data":"bec2ab221dfff89ee934c397133d252b2ad6e09308d3c8da098d13d4c7ecea7c"} Jul 30 23:21:32.681800 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:32.681774 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cec9427-sx45b" Jul 30 23:21:32.769444 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:32.769407 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4786004-0a14-4a45-8a1e-75394b1b81a7-maas-api-service-ca\") pod \"f4786004-0a14-4a45-8a1e-75394b1b81a7\" (UID: \"f4786004-0a14-4a45-8a1e-75394b1b81a7\") " Jul 30 23:21:32.769739 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:32.769714 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4786004-0a14-4a45-8a1e-75394b1b81a7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f4786004-0a14-4a45-8a1e-75394b1b81a7" (UID: "f4786004-0a14-4a45-8a1e-75394b1b81a7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:21:32.870472 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:32.870380 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4786004-0a14-4a45-8a1e-75394b1b81a7-maas-api-service-ca\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:21:33.561321 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:33.561226 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cec9427-sx45b" Jul 30 23:21:33.561321 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:33.561250 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cec9427-sx45b" event={"ID":"f4786004-0a14-4a45-8a1e-75394b1b81a7","Type":"ContainerDied","Data":"bf7b6fa52a1bab761d37b9154ad07d1225d3f3a23291815814c005d8742ed9b7"} Jul 30 23:21:33.561321 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:33.561295 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf7b6fa52a1bab761d37b9154ad07d1225d3f3a23291815814c005d8742ed9b7" Jul 30 23:21:40.514626 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:40.514589 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9"] Jul 30 23:21:40.515139 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:40.514796 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" podUID="543f73d4-f90d-4eef-a919-7002ac6592f5" containerName="payload-processing" containerID="cri-o://7e0fcad14872c61df9e6883df549596fc8cd19421db2cfe35e1a3ef4a7aaa1c1" gracePeriod=30 Jul 30 23:21:40.523126 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:40.523102 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4"] Jul 30 23:21:40.523358 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:40.523316 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" podUID="2c3482b6-82d9-4a7c-ac25-895a5802d28d" containerName="payload-pre-processing" containerID="cri-o://4d3e419b0108444aae9b88d5a525a3af389ed77423726e17e2c57dc728639431" gracePeriod=30 Jul 30 23:21:40.671674 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:40.671630 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cec9427-sx45b"] Jul 30 23:21:40.673836 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:40.673773 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7cec9427-sx45b"] Jul 30 23:21:40.799632 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:40.799607 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" Jul 30 23:21:40.803721 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:40.803703 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" Jul 30 23:21:40.937242 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:40.937216 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dhd7\" (UniqueName: \"kubernetes.io/projected/543f73d4-f90d-4eef-a919-7002ac6592f5-kube-api-access-9dhd7\") pod \"543f73d4-f90d-4eef-a919-7002ac6592f5\" (UID: \"543f73d4-f90d-4eef-a919-7002ac6592f5\") " Jul 30 23:21:40.937401 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:40.937254 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/543f73d4-f90d-4eef-a919-7002ac6592f5-plugins-config-volume\") pod \"543f73d4-f90d-4eef-a919-7002ac6592f5\" (UID: \"543f73d4-f90d-4eef-a919-7002ac6592f5\") " Jul 30 23:21:40.937401 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:40.937285 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c3482b6-82d9-4a7c-ac25-895a5802d28d-plugins-config-volume\") pod \"2c3482b6-82d9-4a7c-ac25-895a5802d28d\" (UID: \"2c3482b6-82d9-4a7c-ac25-895a5802d28d\") " Jul 30 23:21:40.937401 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:40.937325 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9srl7\" (UniqueName: \"kubernetes.io/projected/2c3482b6-82d9-4a7c-ac25-895a5802d28d-kube-api-access-9srl7\") pod \"2c3482b6-82d9-4a7c-ac25-895a5802d28d\" (UID: \"2c3482b6-82d9-4a7c-ac25-895a5802d28d\") " Jul 30 23:21:40.937749 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:40.937722 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c3482b6-82d9-4a7c-ac25-895a5802d28d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2c3482b6-82d9-4a7c-ac25-895a5802d28d" (UID: "2c3482b6-82d9-4a7c-ac25-895a5802d28d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:21:40.937749 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:40.937751 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/543f73d4-f90d-4eef-a919-7002ac6592f5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "543f73d4-f90d-4eef-a919-7002ac6592f5" (UID: "543f73d4-f90d-4eef-a919-7002ac6592f5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:21:40.939397 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:40.939377 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/543f73d4-f90d-4eef-a919-7002ac6592f5-kube-api-access-9dhd7" (OuterVolumeSpecName: "kube-api-access-9dhd7") pod "543f73d4-f90d-4eef-a919-7002ac6592f5" (UID: "543f73d4-f90d-4eef-a919-7002ac6592f5"). InnerVolumeSpecName "kube-api-access-9dhd7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:21:40.939476 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:40.939431 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c3482b6-82d9-4a7c-ac25-895a5802d28d-kube-api-access-9srl7" (OuterVolumeSpecName: "kube-api-access-9srl7") pod "2c3482b6-82d9-4a7c-ac25-895a5802d28d" (UID: "2c3482b6-82d9-4a7c-ac25-895a5802d28d"). InnerVolumeSpecName "kube-api-access-9srl7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:21:41.038748 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.038675 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dhd7\" (UniqueName: \"kubernetes.io/projected/543f73d4-f90d-4eef-a919-7002ac6592f5-kube-api-access-9dhd7\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:21:41.038748 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.038701 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/543f73d4-f90d-4eef-a919-7002ac6592f5-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:21:41.038748 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.038723 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c3482b6-82d9-4a7c-ac25-895a5802d28d-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:21:41.038748 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.038734 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9srl7\" (UniqueName: \"kubernetes.io/projected/2c3482b6-82d9-4a7c-ac25-895a5802d28d-kube-api-access-9srl7\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:21:41.237511 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.237477 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4786004-0a14-4a45-8a1e-75394b1b81a7" path="/var/lib/kubelet/pods/f4786004-0a14-4a45-8a1e-75394b1b81a7/volumes" Jul 30 23:21:41.609699 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.609668 2576 generic.go:356] "Generic (PLEG): container finished" podID="543f73d4-f90d-4eef-a919-7002ac6592f5" containerID="7e0fcad14872c61df9e6883df549596fc8cd19421db2cfe35e1a3ef4a7aaa1c1" exitCode=0 Jul 30 23:21:41.610105 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.609714 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" Jul 30 23:21:41.610105 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.609711 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" event={"ID":"543f73d4-f90d-4eef-a919-7002ac6592f5","Type":"ContainerDied","Data":"7e0fcad14872c61df9e6883df549596fc8cd19421db2cfe35e1a3ef4a7aaa1c1"} Jul 30 23:21:41.610105 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.609775 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9" event={"ID":"543f73d4-f90d-4eef-a919-7002ac6592f5","Type":"ContainerDied","Data":"3c85a5ac5b642c175ca267fe8b2de59c07cb3a5f2bb41268092c6f6b8569664e"} Jul 30 23:21:41.610105 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.609808 2576 scope.go:117] "RemoveContainer" containerID="7e0fcad14872c61df9e6883df549596fc8cd19421db2cfe35e1a3ef4a7aaa1c1" Jul 30 23:21:41.611210 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.611180 2576 generic.go:356] "Generic (PLEG): container finished" podID="2c3482b6-82d9-4a7c-ac25-895a5802d28d" containerID="4d3e419b0108444aae9b88d5a525a3af389ed77423726e17e2c57dc728639431" exitCode=0 Jul 30 23:21:41.611304 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.611223 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" Jul 30 23:21:41.611304 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.611225 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" event={"ID":"2c3482b6-82d9-4a7c-ac25-895a5802d28d","Type":"ContainerDied","Data":"4d3e419b0108444aae9b88d5a525a3af389ed77423726e17e2c57dc728639431"} Jul 30 23:21:41.611304 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.611280 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4" event={"ID":"2c3482b6-82d9-4a7c-ac25-895a5802d28d","Type":"ContainerDied","Data":"1b2afa902dbfdb68e2a349673d7c7a5aae039d3e15953d6b5bf014f7ee8b1b0d"} Jul 30 23:21:41.618662 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.618644 2576 scope.go:117] "RemoveContainer" containerID="7e0fcad14872c61df9e6883df549596fc8cd19421db2cfe35e1a3ef4a7aaa1c1" Jul 30 23:21:41.618952 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:21:41.618916 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e0fcad14872c61df9e6883df549596fc8cd19421db2cfe35e1a3ef4a7aaa1c1\": container with ID starting with 7e0fcad14872c61df9e6883df549596fc8cd19421db2cfe35e1a3ef4a7aaa1c1 not found: ID does not exist" containerID="7e0fcad14872c61df9e6883df549596fc8cd19421db2cfe35e1a3ef4a7aaa1c1" Jul 30 23:21:41.619057 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.618951 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e0fcad14872c61df9e6883df549596fc8cd19421db2cfe35e1a3ef4a7aaa1c1"} err="failed to get container status \"7e0fcad14872c61df9e6883df549596fc8cd19421db2cfe35e1a3ef4a7aaa1c1\": rpc error: code = NotFound desc = could not find container \"7e0fcad14872c61df9e6883df549596fc8cd19421db2cfe35e1a3ef4a7aaa1c1\": container with ID starting with 7e0fcad14872c61df9e6883df549596fc8cd19421db2cfe35e1a3ef4a7aaa1c1 not found: ID does not exist" Jul 30 23:21:41.619057 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.618975 2576 scope.go:117] "RemoveContainer" containerID="4d3e419b0108444aae9b88d5a525a3af389ed77423726e17e2c57dc728639431" Jul 30 23:21:41.626815 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.626800 2576 scope.go:117] "RemoveContainer" containerID="4d3e419b0108444aae9b88d5a525a3af389ed77423726e17e2c57dc728639431" Jul 30 23:21:41.627102 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:21:41.627084 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d3e419b0108444aae9b88d5a525a3af389ed77423726e17e2c57dc728639431\": container with ID starting with 4d3e419b0108444aae9b88d5a525a3af389ed77423726e17e2c57dc728639431 not found: ID does not exist" containerID="4d3e419b0108444aae9b88d5a525a3af389ed77423726e17e2c57dc728639431" Jul 30 23:21:41.627170 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.627110 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d3e419b0108444aae9b88d5a525a3af389ed77423726e17e2c57dc728639431"} err="failed to get container status \"4d3e419b0108444aae9b88d5a525a3af389ed77423726e17e2c57dc728639431\": rpc error: code = NotFound desc = could not find container \"4d3e419b0108444aae9b88d5a525a3af389ed77423726e17e2c57dc728639431\": container with ID starting with 4d3e419b0108444aae9b88d5a525a3af389ed77423726e17e2c57dc728639431 not found: ID does not exist" Jul 30 23:21:41.629005 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.628987 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9"] Jul 30 23:21:41.632682 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.632656 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7cec9427-85987c67b6-vwtf9"] Jul 30 23:21:41.641845 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.641820 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4"] Jul 30 23:21:41.645201 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:41.645184 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7cec9427-78848bf968-qkbl4"] Jul 30 23:21:43.237522 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:43.237487 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c3482b6-82d9-4a7c-ac25-895a5802d28d" path="/var/lib/kubelet/pods/2c3482b6-82d9-4a7c-ac25-895a5802d28d/volumes" Jul 30 23:21:43.238051 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:43.238028 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="543f73d4-f90d-4eef-a919-7002ac6592f5" path="/var/lib/kubelet/pods/543f73d4-f90d-4eef-a919-7002ac6592f5/volumes" Jul 30 23:21:46.974549 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:46.974510 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8"] Jul 30 23:21:46.974981 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:46.974744 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" podUID="e787d02d-eeec-4a3c-a95a-929b4d5084b3" containerName="istio-proxy" containerID="cri-o://5bed726e266a17f3a1fa724e0d5b44c7066caef686cb10d1408f6b780e3c54aa" gracePeriod=30 Jul 30 23:21:47.923352 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:47.923313 2576 patch_prober.go:28] interesting pod/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 23:21:47.923529 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:47.923379 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" podUID="e787d02d-eeec-4a3c-a95a-929b4d5084b3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 23:21:52.222643 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.222610 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:21:52.230495 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.230474 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-podinfo\") pod \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " Jul 30 23:21:52.230637 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.230529 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-envoy\") pod \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " Jul 30 23:21:52.230716 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.230696 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-data\") pod \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " Jul 30 23:21:52.230779 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.230764 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istiod-ca-cert\") pod \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " Jul 30 23:21:52.230838 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.230810 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-credential-socket\") pod \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " Jul 30 23:21:52.231010 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.230984 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-data" (OuterVolumeSpecName: "istio-data") pod "e787d02d-eeec-4a3c-a95a-929b4d5084b3" (UID: "e787d02d-eeec-4a3c-a95a-929b4d5084b3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:21:52.231087 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.230998 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjt9j\" (UniqueName: \"kubernetes.io/projected/e787d02d-eeec-4a3c-a95a-929b4d5084b3-kube-api-access-tjt9j\") pod \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " Jul 30 23:21:52.231087 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.231037 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e787d02d-eeec-4a3c-a95a-929b4d5084b3" (UID: "e787d02d-eeec-4a3c-a95a-929b4d5084b3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:21:52.231087 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.231065 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-workload-certs\") pod \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " Jul 30 23:21:52.231222 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.231091 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e787d02d-eeec-4a3c-a95a-929b4d5084b3" (UID: "e787d02d-eeec-4a3c-a95a-929b4d5084b3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:21:52.231222 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.231101 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-token\") pod \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " Jul 30 23:21:52.231222 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.231131 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-workload-socket\") pod \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\" (UID: \"e787d02d-eeec-4a3c-a95a-929b4d5084b3\") " Jul 30 23:21:52.231376 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.231245 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e787d02d-eeec-4a3c-a95a-929b4d5084b3" (UID: "e787d02d-eeec-4a3c-a95a-929b4d5084b3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:21:52.231433 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.231402 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e787d02d-eeec-4a3c-a95a-929b4d5084b3" (UID: "e787d02d-eeec-4a3c-a95a-929b4d5084b3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:21:52.231490 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.231445 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:21:52.231490 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.231461 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:21:52.231490 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.231470 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:21:52.231490 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.231481 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:21:52.232752 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.232730 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e787d02d-eeec-4a3c-a95a-929b4d5084b3" (UID: "e787d02d-eeec-4a3c-a95a-929b4d5084b3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 23:21:52.233039 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.233014 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e787d02d-eeec-4a3c-a95a-929b4d5084b3-kube-api-access-tjt9j" (OuterVolumeSpecName: "kube-api-access-tjt9j") pod "e787d02d-eeec-4a3c-a95a-929b4d5084b3" (UID: "e787d02d-eeec-4a3c-a95a-929b4d5084b3"). InnerVolumeSpecName "kube-api-access-tjt9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:21:52.233142 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.233087 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e787d02d-eeec-4a3c-a95a-929b4d5084b3" (UID: "e787d02d-eeec-4a3c-a95a-929b4d5084b3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:21:52.233267 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.233250 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-token" (OuterVolumeSpecName: "istio-token") pod "e787d02d-eeec-4a3c-a95a-929b4d5084b3" (UID: "e787d02d-eeec-4a3c-a95a-929b4d5084b3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:21:52.332141 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.332055 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:21:52.332141 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.332086 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:21:52.332141 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.332094 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:21:52.332141 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.332102 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e787d02d-eeec-4a3c-a95a-929b4d5084b3-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:21:52.332141 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.332111 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjt9j\" (UniqueName: \"kubernetes.io/projected/e787d02d-eeec-4a3c-a95a-929b4d5084b3-kube-api-access-tjt9j\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:21:52.679266 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.679236 2576 generic.go:356] "Generic (PLEG): container finished" podID="e787d02d-eeec-4a3c-a95a-929b4d5084b3" containerID="5bed726e266a17f3a1fa724e0d5b44c7066caef686cb10d1408f6b780e3c54aa" exitCode=0 Jul 30 23:21:52.679446 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.679285 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" Jul 30 23:21:52.679446 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.679324 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" event={"ID":"e787d02d-eeec-4a3c-a95a-929b4d5084b3","Type":"ContainerDied","Data":"5bed726e266a17f3a1fa724e0d5b44c7066caef686cb10d1408f6b780e3c54aa"} Jul 30 23:21:52.679446 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.679379 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8" event={"ID":"e787d02d-eeec-4a3c-a95a-929b4d5084b3","Type":"ContainerDied","Data":"2dff98af8208f74ccd5f4d0415dcafe554b6c675b5d4e99ad1f6c0b85b30d3da"} Jul 30 23:21:52.679446 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.679405 2576 scope.go:117] "RemoveContainer" containerID="5bed726e266a17f3a1fa724e0d5b44c7066caef686cb10d1408f6b780e3c54aa" Jul 30 23:21:52.691949 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.691927 2576 scope.go:117] "RemoveContainer" containerID="6bd61a61c85a7259a99ffb295e49a04a5ef098069f576dd2f598fb34573e70f5" Jul 30 23:21:52.699769 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.699749 2576 scope.go:117] "RemoveContainer" containerID="5bed726e266a17f3a1fa724e0d5b44c7066caef686cb10d1408f6b780e3c54aa" Jul 30 23:21:52.700031 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:21:52.700013 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bed726e266a17f3a1fa724e0d5b44c7066caef686cb10d1408f6b780e3c54aa\": container with ID starting with 5bed726e266a17f3a1fa724e0d5b44c7066caef686cb10d1408f6b780e3c54aa not found: ID does not exist" containerID="5bed726e266a17f3a1fa724e0d5b44c7066caef686cb10d1408f6b780e3c54aa" Jul 30 23:21:52.700083 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.700040 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bed726e266a17f3a1fa724e0d5b44c7066caef686cb10d1408f6b780e3c54aa"} err="failed to get container status \"5bed726e266a17f3a1fa724e0d5b44c7066caef686cb10d1408f6b780e3c54aa\": rpc error: code = NotFound desc = could not find container \"5bed726e266a17f3a1fa724e0d5b44c7066caef686cb10d1408f6b780e3c54aa\": container with ID starting with 5bed726e266a17f3a1fa724e0d5b44c7066caef686cb10d1408f6b780e3c54aa not found: ID does not exist" Jul 30 23:21:52.700083 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.700057 2576 scope.go:117] "RemoveContainer" containerID="6bd61a61c85a7259a99ffb295e49a04a5ef098069f576dd2f598fb34573e70f5" Jul 30 23:21:52.700280 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:21:52.700264 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bd61a61c85a7259a99ffb295e49a04a5ef098069f576dd2f598fb34573e70f5\": container with ID starting with 6bd61a61c85a7259a99ffb295e49a04a5ef098069f576dd2f598fb34573e70f5 not found: ID does not exist" containerID="6bd61a61c85a7259a99ffb295e49a04a5ef098069f576dd2f598fb34573e70f5" Jul 30 23:21:52.700326 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.700287 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bd61a61c85a7259a99ffb295e49a04a5ef098069f576dd2f598fb34573e70f5"} err="failed to get container status \"6bd61a61c85a7259a99ffb295e49a04a5ef098069f576dd2f598fb34573e70f5\": rpc error: code = NotFound desc = could not find container \"6bd61a61c85a7259a99ffb295e49a04a5ef098069f576dd2f598fb34573e70f5\": container with ID starting with 6bd61a61c85a7259a99ffb295e49a04a5ef098069f576dd2f598fb34573e70f5 not found: ID does not exist" Jul 30 23:21:52.703332 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.703308 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8"] Jul 30 23:21:52.707339 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:52.707319 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7cec9427-openshift-default-6999dbd85b-gg4p8"] Jul 30 23:21:53.236194 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:21:53.236157 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e787d02d-eeec-4a3c-a95a-929b4d5084b3" path="/var/lib/kubelet/pods/e787d02d-eeec-4a3c-a95a-929b4d5084b3/volumes" Jul 30 23:22:53.330481 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:22:53.330450 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:22:53.336278 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:22:53.336257 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:23:54.574904 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:23:54.574854 2576 scope.go:117] "RemoveContainer" containerID="f085b9bf7ec5f7163761468c2493bbdb45c61e76c1fe357820220a9a10b60ef3" Jul 30 23:23:54.583266 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:23:54.583246 2576 scope.go:117] "RemoveContainer" containerID="fdeb8249f80d7711b825318e492453ea73b06c6d51299cf46fbf7f0038b48130" Jul 30 23:24:02.452266 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.452223 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8"] Jul 30 23:24:02.452794 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.452537 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4786004-0a14-4a45-8a1e-75394b1b81a7" containerName="revoke-keys" Jul 30 23:24:02.452794 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.452549 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4786004-0a14-4a45-8a1e-75394b1b81a7" containerName="revoke-keys" Jul 30 23:24:02.452794 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.452560 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e787d02d-eeec-4a3c-a95a-929b4d5084b3" containerName="istio-proxy" Jul 30 23:24:02.452794 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.452566 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e787d02d-eeec-4a3c-a95a-929b4d5084b3" containerName="istio-proxy" Jul 30 23:24:02.452794 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.452572 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="543f73d4-f90d-4eef-a919-7002ac6592f5" containerName="payload-processing" Jul 30 23:24:02.452794 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.452578 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="543f73d4-f90d-4eef-a919-7002ac6592f5" containerName="payload-processing" Jul 30 23:24:02.452794 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.452588 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c3482b6-82d9-4a7c-ac25-895a5802d28d" containerName="payload-pre-processing" Jul 30 23:24:02.452794 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.452593 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c3482b6-82d9-4a7c-ac25-895a5802d28d" containerName="payload-pre-processing" Jul 30 23:24:02.452794 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.452600 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e787d02d-eeec-4a3c-a95a-929b4d5084b3" containerName="istio-proxy" Jul 30 23:24:02.452794 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.452605 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e787d02d-eeec-4a3c-a95a-929b4d5084b3" containerName="istio-proxy" Jul 30 23:24:02.452794 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.452670 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="543f73d4-f90d-4eef-a919-7002ac6592f5" containerName="payload-processing" Jul 30 23:24:02.452794 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.452678 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e787d02d-eeec-4a3c-a95a-929b4d5084b3" containerName="istio-proxy" Jul 30 23:24:02.452794 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.452686 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c3482b6-82d9-4a7c-ac25-895a5802d28d" containerName="payload-pre-processing" Jul 30 23:24:02.452794 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.452691 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4786004-0a14-4a45-8a1e-75394b1b81a7" containerName="revoke-keys" Jul 30 23:24:02.455599 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.455575 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.458253 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.458234 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d04222a5-openshift-default-dockercfg-d7wwk\"" Jul 30 23:24:02.467717 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.467693 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8"] Jul 30 23:24:02.550270 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.550231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istiod-ca-cert\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.550465 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.550282 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-token\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.550465 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.550374 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-podinfo\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.550465 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.550409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-data\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.550620 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.550494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-envoy\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.550620 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.550524 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzvt9\" (UniqueName: \"kubernetes.io/projected/08de82b0-1476-4cd2-b802-e8a347c3e1ed-kube-api-access-qzvt9\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.550620 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.550593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-credential-socket\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.550741 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.550627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-workload-socket\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.550741 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.550654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-workload-certs\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.651998 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.651956 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-envoy\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.651998 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.651996 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzvt9\" (UniqueName: \"kubernetes.io/projected/08de82b0-1476-4cd2-b802-e8a347c3e1ed-kube-api-access-qzvt9\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.652251 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.652036 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-credential-socket\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.652251 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.652067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-workload-socket\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.652251 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.652103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-workload-certs\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.652251 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.652236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istiod-ca-cert\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.652481 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.652302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-token\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.652481 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.652375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-podinfo\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.652592 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.652481 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-credential-socket\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.652592 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.652522 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-workload-certs\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.652592 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.652589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-data\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.652781 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.652630 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-workload-socket\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.652958 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.652936 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-data\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.653024 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.652963 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istiod-ca-cert\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.654371 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.654354 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-envoy\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.654684 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.654668 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-podinfo\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.660368 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.660347 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-token\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.660517 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.660500 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzvt9\" (UniqueName: \"kubernetes.io/projected/08de82b0-1476-4cd2-b802-e8a347c3e1ed-kube-api-access-qzvt9\") pod \"e2e-mt-d04222a5-openshift-default-655b664488-jnrr8\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.766926 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.766815 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:02.902176 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.902150 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8"] Jul 30 23:24:02.903906 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:24:02.903877 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08de82b0_1476_4cd2_b802_e8a347c3e1ed.slice/crio-bf70fc7958e75b6823b2dd9d923b660d2de14673e9c6c94e50091e67cd3eca16 WatchSource:0}: Error finding container bf70fc7958e75b6823b2dd9d923b660d2de14673e9c6c94e50091e67cd3eca16: Status 404 returned error can't find the container with id bf70fc7958e75b6823b2dd9d923b660d2de14673e9c6c94e50091e67cd3eca16 Jul 30 23:24:02.906485 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.906456 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:24:02.906573 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.906518 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:24:02.906573 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:02.906549 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:24:03.349823 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:03.349790 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" event={"ID":"08de82b0-1476-4cd2-b802-e8a347c3e1ed","Type":"ContainerStarted","Data":"8623aea3bd3616d0f71385b7a0552378bd645ef35a11b8ff144ee908a9489ed5"} Jul 30 23:24:03.350011 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:03.349839 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" event={"ID":"08de82b0-1476-4cd2-b802-e8a347c3e1ed","Type":"ContainerStarted","Data":"bf70fc7958e75b6823b2dd9d923b660d2de14673e9c6c94e50091e67cd3eca16"} Jul 30 23:24:03.368738 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:03.368689 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" podStartSLOduration=1.3686739239999999 podStartE2EDuration="1.368673924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:24:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:24:03.367375439 +0000 UTC m=+2170.571194674" watchObservedRunningTime="2026-07-30 23:24:03.368673924 +0000 UTC m=+2170.572493158" Jul 30 23:24:03.766931 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:03.766901 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:03.772167 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:03.772145 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:04.355588 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:04.355553 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:04.356567 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:04.356546 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:07.335084 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.335049 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87"] Jul 30 23:24:07.335452 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.335437 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e787d02d-eeec-4a3c-a95a-929b4d5084b3" containerName="istio-proxy" Jul 30 23:24:07.338514 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.338496 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" Jul 30 23:24:07.341631 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.341608 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-d04222a5\"" Jul 30 23:24:07.348761 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.348737 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87"] Jul 30 23:24:07.396067 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.396033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpd2v\" (UniqueName: \"kubernetes.io/projected/e952258d-eaa9-4020-8b84-c3a0dc4a0d2f-kube-api-access-gpd2v\") pod \"payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87\" (UID: \"e952258d-eaa9-4020-8b84-c3a0dc4a0d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" Jul 30 23:24:07.396210 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.396160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e952258d-eaa9-4020-8b84-c3a0dc4a0d2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87\" (UID: \"e952258d-eaa9-4020-8b84-c3a0dc4a0d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" Jul 30 23:24:07.456913 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.456879 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl"] Jul 30 23:24:07.461218 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.461189 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" Jul 30 23:24:07.463907 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.463885 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-d04222a5-dockercfg-bbrbz\"" Jul 30 23:24:07.471593 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.471566 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl"] Jul 30 23:24:07.497169 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.497123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpd2v\" (UniqueName: \"kubernetes.io/projected/e952258d-eaa9-4020-8b84-c3a0dc4a0d2f-kube-api-access-gpd2v\") pod \"payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87\" (UID: \"e952258d-eaa9-4020-8b84-c3a0dc4a0d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" Jul 30 23:24:07.497360 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.497295 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e952258d-eaa9-4020-8b84-c3a0dc4a0d2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87\" (UID: \"e952258d-eaa9-4020-8b84-c3a0dc4a0d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" Jul 30 23:24:07.498022 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.497998 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e952258d-eaa9-4020-8b84-c3a0dc4a0d2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87\" (UID: \"e952258d-eaa9-4020-8b84-c3a0dc4a0d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" Jul 30 23:24:07.506708 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.506675 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpd2v\" (UniqueName: \"kubernetes.io/projected/e952258d-eaa9-4020-8b84-c3a0dc4a0d2f-kube-api-access-gpd2v\") pod \"payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87\" (UID: \"e952258d-eaa9-4020-8b84-c3a0dc4a0d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" Jul 30 23:24:07.597813 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.597728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pnt4\" (UniqueName: \"kubernetes.io/projected/ac7da1dd-e19d-4eb6-93b5-6828ed8a7972-kube-api-access-8pnt4\") pod \"payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl\" (UID: \"ac7da1dd-e19d-4eb6-93b5-6828ed8a7972\") " pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" Jul 30 23:24:07.597813 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.597781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac7da1dd-e19d-4eb6-93b5-6828ed8a7972-plugins-config-volume\") pod \"payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl\" (UID: \"ac7da1dd-e19d-4eb6-93b5-6828ed8a7972\") " pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" Jul 30 23:24:07.650444 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.650408 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" Jul 30 23:24:07.698930 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.698881 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pnt4\" (UniqueName: \"kubernetes.io/projected/ac7da1dd-e19d-4eb6-93b5-6828ed8a7972-kube-api-access-8pnt4\") pod \"payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl\" (UID: \"ac7da1dd-e19d-4eb6-93b5-6828ed8a7972\") " pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" Jul 30 23:24:07.699031 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.698959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac7da1dd-e19d-4eb6-93b5-6828ed8a7972-plugins-config-volume\") pod \"payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl\" (UID: \"ac7da1dd-e19d-4eb6-93b5-6828ed8a7972\") " pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" Jul 30 23:24:07.700198 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.700172 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac7da1dd-e19d-4eb6-93b5-6828ed8a7972-plugins-config-volume\") pod \"payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl\" (UID: \"ac7da1dd-e19d-4eb6-93b5-6828ed8a7972\") " pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" Jul 30 23:24:07.707731 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.707704 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pnt4\" (UniqueName: \"kubernetes.io/projected/ac7da1dd-e19d-4eb6-93b5-6828ed8a7972-kube-api-access-8pnt4\") pod \"payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl\" (UID: \"ac7da1dd-e19d-4eb6-93b5-6828ed8a7972\") " pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" Jul 30 23:24:07.773053 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.773017 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" Jul 30 23:24:07.781785 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.781762 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87"] Jul 30 23:24:07.785873 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:24:07.785835 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode952258d_eaa9_4020_8b84_c3a0dc4a0d2f.slice/crio-acbf53a63477ce6969b12ef3ececae7d1c5d154179ccbf37d34b9f09ceda8a3d WatchSource:0}: Error finding container acbf53a63477ce6969b12ef3ececae7d1c5d154179ccbf37d34b9f09ceda8a3d: Status 404 returned error can't find the container with id acbf53a63477ce6969b12ef3ececae7d1c5d154179ccbf37d34b9f09ceda8a3d Jul 30 23:24:07.916518 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:07.916490 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl"] Jul 30 23:24:07.918283 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:24:07.918253 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7da1dd_e19d_4eb6_93b5_6828ed8a7972.slice/crio-aaf529c648f0d0f012d435411ab02f829f4b537f3a3f4f10224a066ed47d168a WatchSource:0}: Error finding container aaf529c648f0d0f012d435411ab02f829f4b537f3a3f4f10224a066ed47d168a: Status 404 returned error can't find the container with id aaf529c648f0d0f012d435411ab02f829f4b537f3a3f4f10224a066ed47d168a Jul 30 23:24:08.379794 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:08.379754 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" event={"ID":"ac7da1dd-e19d-4eb6-93b5-6828ed8a7972","Type":"ContainerStarted","Data":"357da8c9a663c73973c582914305c223d285cd69e85d85f24814fb9c61c5d5cc"} Jul 30 23:24:08.380289 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:08.379818 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" event={"ID":"ac7da1dd-e19d-4eb6-93b5-6828ed8a7972","Type":"ContainerStarted","Data":"aaf529c648f0d0f012d435411ab02f829f4b537f3a3f4f10224a066ed47d168a"} Jul 30 23:24:08.380289 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:08.379848 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" Jul 30 23:24:08.381431 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:08.381408 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" event={"ID":"e952258d-eaa9-4020-8b84-c3a0dc4a0d2f","Type":"ContainerStarted","Data":"6c6cd1807de236d843a3fc0430790f3de284f86d37237cbe5246d6aa8d6fe0ee"} Jul 30 23:24:08.381532 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:08.381450 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" Jul 30 23:24:08.381532 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:08.381466 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" event={"ID":"e952258d-eaa9-4020-8b84-c3a0dc4a0d2f","Type":"ContainerStarted","Data":"acbf53a63477ce6969b12ef3ececae7d1c5d154179ccbf37d34b9f09ceda8a3d"} Jul 30 23:24:08.401100 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:08.401046 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" podStartSLOduration=1.401026596 podStartE2EDuration="1.401026596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:24:08.398761472 +0000 UTC m=+2175.602580706" watchObservedRunningTime="2026-07-30 23:24:08.401026596 +0000 UTC m=+2175.604845831" Jul 30 23:24:08.417906 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:08.417843 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" podStartSLOduration=1.41782919 podStartE2EDuration="1.41782919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:24:08.415921855 +0000 UTC m=+2175.619741090" watchObservedRunningTime="2026-07-30 23:24:08.41782919 +0000 UTC m=+2175.621648424" Jul 30 23:24:19.391247 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:19.391212 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" Jul 30 23:24:19.391983 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:19.391956 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" Jul 30 23:24:20.397039 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:20.396994 2576 patch_prober.go:28] interesting pod/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 30 23:24:20.397437 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:20.397076 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" podUID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 30 23:24:21.456960 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:21.456928 2576 generic.go:356] "Generic (PLEG): container finished" podID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" containerID="8623aea3bd3616d0f71385b7a0552378bd645ef35a11b8ff144ee908a9489ed5" exitCode=0 Jul 30 23:24:21.457407 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:21.457003 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" event={"ID":"08de82b0-1476-4cd2-b802-e8a347c3e1ed","Type":"ContainerDied","Data":"8623aea3bd3616d0f71385b7a0552378bd645ef35a11b8ff144ee908a9489ed5"} Jul 30 23:24:21.457462 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:21.457436 2576 scope.go:117] "RemoveContainer" containerID="8623aea3bd3616d0f71385b7a0552378bd645ef35a11b8ff144ee908a9489ed5" Jul 30 23:24:21.458428 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:21.458400 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:24:21.458549 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:21.458488 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:24:21.458549 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:21.458538 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:24:22.468689 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:22.468643 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" event={"ID":"08de82b0-1476-4cd2-b802-e8a347c3e1ed","Type":"ContainerStarted","Data":"41f7f387b2db49a421855f3a0b3973db9f5dc5e518831eeb781f1c98b81d0e3f"} Jul 30 23:24:22.767567 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:22.767475 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:22.767724 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:22.767703 2576 patch_prober.go:28] interesting pod/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 30 23:24:22.767801 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:22.767776 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" podUID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 30 23:24:23.767182 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:23.767142 2576 patch_prober.go:28] interesting pod/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 30 23:24:23.767618 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:23.767194 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" podUID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 30 23:24:24.767845 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:24.767806 2576 patch_prober.go:28] interesting pod/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 30 23:24:24.768274 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:24.767903 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" podUID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 30 23:24:25.768090 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:25.768045 2576 patch_prober.go:28] interesting pod/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 30 23:24:25.768486 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:25.768119 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" podUID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 30 23:24:26.767548 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:26.767506 2576 patch_prober.go:28] interesting pod/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 30 23:24:26.767822 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:26.767575 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" podUID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 30 23:24:27.767662 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:27.767625 2576 patch_prober.go:28] interesting pod/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 30 23:24:27.768095 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:27.767678 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" podUID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 30 23:24:28.771059 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:28.771025 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:28.771446 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:28.771291 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:28.772102 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:28.772087 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:24:54.606038 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:54.606001 2576 scope.go:117] "RemoveContainer" containerID="62c6862a2cc91c025000ffec0ed1ed391292abd4ddfaca7db4b2e734015a2b6c" Jul 30 23:24:54.614408 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:24:54.614387 2576 scope.go:117] "RemoveContainer" containerID="ff1724f3dd0deba726cc02299f2a81d8392fbc35de6987e6c299d377904b6fe3" Jul 30 23:25:04.991103 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:04.991069 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm"] Jul 30 23:25:04.994484 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:04.994468 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm" Jul 30 23:25:04.999469 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:04.999448 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 23:25:04.999469 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:04.999463 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52wcc\"" Jul 30 23:25:05.007773 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:05.007745 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm"] Jul 30 23:25:05.126980 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:05.126943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d73c16e8-e273-4208-97ab-6d05913126a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm\" (UID: \"d73c16e8-e273-4208-97ab-6d05913126a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm" Jul 30 23:25:05.228288 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:05.228235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d73c16e8-e273-4208-97ab-6d05913126a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm\" (UID: \"d73c16e8-e273-4208-97ab-6d05913126a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm" Jul 30 23:25:05.228895 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:05.228845 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d73c16e8-e273-4208-97ab-6d05913126a6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm\" (UID: \"d73c16e8-e273-4208-97ab-6d05913126a6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm" Jul 30 23:25:05.304689 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:05.304612 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm" Jul 30 23:25:05.436889 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:05.436847 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm"] Jul 30 23:25:05.438540 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:25:05.438510 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd73c16e8_e273_4208_97ab_6d05913126a6.slice/crio-1ed6ae1ecadc26ac963d215561252669ba1f027a0e1f63c8e16c235627870035 WatchSource:0}: Error finding container 1ed6ae1ecadc26ac963d215561252669ba1f027a0e1f63c8e16c235627870035: Status 404 returned error can't find the container with id 1ed6ae1ecadc26ac963d215561252669ba1f027a0e1f63c8e16c235627870035 Jul 30 23:25:05.694370 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:05.694339 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm" event={"ID":"d73c16e8-e273-4208-97ab-6d05913126a6","Type":"ContainerStarted","Data":"1ed6ae1ecadc26ac963d215561252669ba1f027a0e1f63c8e16c235627870035"} Jul 30 23:25:06.701379 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:06.701343 2576 generic.go:356] "Generic (PLEG): container finished" podID="d73c16e8-e273-4208-97ab-6d05913126a6" containerID="1809ef7bc44ef2a231a485bb70baed2d5de9569dd0d2b7a6a08ccfacb8d7c17f" exitCode=0 Jul 30 23:25:06.701789 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:06.701396 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm" event={"ID":"d73c16e8-e273-4208-97ab-6d05913126a6","Type":"ContainerDied","Data":"1809ef7bc44ef2a231a485bb70baed2d5de9569dd0d2b7a6a08ccfacb8d7c17f"} Jul 30 23:25:07.837186 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:07.837163 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm" Jul 30 23:25:07.952222 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:07.952188 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d73c16e8-e273-4208-97ab-6d05913126a6-maas-api-service-ca\") pod \"d73c16e8-e273-4208-97ab-6d05913126a6\" (UID: \"d73c16e8-e273-4208-97ab-6d05913126a6\") " Jul 30 23:25:07.952578 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:07.952556 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d73c16e8-e273-4208-97ab-6d05913126a6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d73c16e8-e273-4208-97ab-6d05913126a6" (UID: "d73c16e8-e273-4208-97ab-6d05913126a6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:25:08.053126 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:08.053033 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d73c16e8-e273-4208-97ab-6d05913126a6-maas-api-service-ca\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:25:08.713803 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:08.713772 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm" Jul 30 23:25:08.714026 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:08.713813 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm" event={"ID":"d73c16e8-e273-4208-97ab-6d05913126a6","Type":"ContainerDied","Data":"1ed6ae1ecadc26ac963d215561252669ba1f027a0e1f63c8e16c235627870035"} Jul 30 23:25:08.714026 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:08.713908 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ed6ae1ecadc26ac963d215561252669ba1f027a0e1f63c8e16c235627870035" Jul 30 23:25:20.536610 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.527705 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl"] Jul 30 23:25:20.536610 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.528061 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" podUID="ac7da1dd-e19d-4eb6-93b5-6828ed8a7972" containerName="payload-processing" containerID="cri-o://357da8c9a663c73973c582914305c223d285cd69e85d85f24814fb9c61c5d5cc" gracePeriod=30 Jul 30 23:25:20.538310 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.537799 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87"] Jul 30 23:25:20.540415 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.539967 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" podUID="e952258d-eaa9-4020-8b84-c3a0dc4a0d2f" containerName="payload-pre-processing" containerID="cri-o://6c6cd1807de236d843a3fc0430790f3de284f86d37237cbe5246d6aa8d6fe0ee" gracePeriod=30 Jul 30 23:25:20.675020 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.674986 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm"] Jul 30 23:25:20.679498 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.679473 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d04222a5-8gjmm"] Jul 30 23:25:20.778167 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.778135 2576 generic.go:356] "Generic (PLEG): container finished" podID="e952258d-eaa9-4020-8b84-c3a0dc4a0d2f" containerID="6c6cd1807de236d843a3fc0430790f3de284f86d37237cbe5246d6aa8d6fe0ee" exitCode=0 Jul 30 23:25:20.778350 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.778222 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" event={"ID":"e952258d-eaa9-4020-8b84-c3a0dc4a0d2f","Type":"ContainerDied","Data":"6c6cd1807de236d843a3fc0430790f3de284f86d37237cbe5246d6aa8d6fe0ee"} Jul 30 23:25:20.779941 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.779918 2576 generic.go:356] "Generic (PLEG): container finished" podID="ac7da1dd-e19d-4eb6-93b5-6828ed8a7972" containerID="357da8c9a663c73973c582914305c223d285cd69e85d85f24814fb9c61c5d5cc" exitCode=0 Jul 30 23:25:20.780056 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.779951 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" event={"ID":"ac7da1dd-e19d-4eb6-93b5-6828ed8a7972","Type":"ContainerDied","Data":"357da8c9a663c73973c582914305c223d285cd69e85d85f24814fb9c61c5d5cc"} Jul 30 23:25:20.816463 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.816441 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" Jul 30 23:25:20.819477 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.819459 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" Jul 30 23:25:20.862013 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.861977 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpd2v\" (UniqueName: \"kubernetes.io/projected/e952258d-eaa9-4020-8b84-c3a0dc4a0d2f-kube-api-access-gpd2v\") pod \"e952258d-eaa9-4020-8b84-c3a0dc4a0d2f\" (UID: \"e952258d-eaa9-4020-8b84-c3a0dc4a0d2f\") " Jul 30 23:25:20.862174 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.862022 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e952258d-eaa9-4020-8b84-c3a0dc4a0d2f-plugins-config-volume\") pod \"e952258d-eaa9-4020-8b84-c3a0dc4a0d2f\" (UID: \"e952258d-eaa9-4020-8b84-c3a0dc4a0d2f\") " Jul 30 23:25:20.862174 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.862040 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac7da1dd-e19d-4eb6-93b5-6828ed8a7972-plugins-config-volume\") pod \"ac7da1dd-e19d-4eb6-93b5-6828ed8a7972\" (UID: \"ac7da1dd-e19d-4eb6-93b5-6828ed8a7972\") " Jul 30 23:25:20.862174 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.862084 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pnt4\" (UniqueName: \"kubernetes.io/projected/ac7da1dd-e19d-4eb6-93b5-6828ed8a7972-kube-api-access-8pnt4\") pod \"ac7da1dd-e19d-4eb6-93b5-6828ed8a7972\" (UID: \"ac7da1dd-e19d-4eb6-93b5-6828ed8a7972\") " Jul 30 23:25:20.862444 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.862416 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e952258d-eaa9-4020-8b84-c3a0dc4a0d2f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e952258d-eaa9-4020-8b84-c3a0dc4a0d2f" (UID: "e952258d-eaa9-4020-8b84-c3a0dc4a0d2f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:25:20.862513 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.862421 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac7da1dd-e19d-4eb6-93b5-6828ed8a7972-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ac7da1dd-e19d-4eb6-93b5-6828ed8a7972" (UID: "ac7da1dd-e19d-4eb6-93b5-6828ed8a7972"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:25:20.864104 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.864079 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e952258d-eaa9-4020-8b84-c3a0dc4a0d2f-kube-api-access-gpd2v" (OuterVolumeSpecName: "kube-api-access-gpd2v") pod "e952258d-eaa9-4020-8b84-c3a0dc4a0d2f" (UID: "e952258d-eaa9-4020-8b84-c3a0dc4a0d2f"). InnerVolumeSpecName "kube-api-access-gpd2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:25:20.864104 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.864090 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac7da1dd-e19d-4eb6-93b5-6828ed8a7972-kube-api-access-8pnt4" (OuterVolumeSpecName: "kube-api-access-8pnt4") pod "ac7da1dd-e19d-4eb6-93b5-6828ed8a7972" (UID: "ac7da1dd-e19d-4eb6-93b5-6828ed8a7972"). InnerVolumeSpecName "kube-api-access-8pnt4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:25:20.962942 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.962907 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpd2v\" (UniqueName: \"kubernetes.io/projected/e952258d-eaa9-4020-8b84-c3a0dc4a0d2f-kube-api-access-gpd2v\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:25:20.962942 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.962933 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e952258d-eaa9-4020-8b84-c3a0dc4a0d2f-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:25:20.962942 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.962945 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac7da1dd-e19d-4eb6-93b5-6828ed8a7972-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:25:20.963161 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:20.962955 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pnt4\" (UniqueName: \"kubernetes.io/projected/ac7da1dd-e19d-4eb6-93b5-6828ed8a7972-kube-api-access-8pnt4\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:25:21.237646 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:21.237612 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d73c16e8-e273-4208-97ab-6d05913126a6" path="/var/lib/kubelet/pods/d73c16e8-e273-4208-97ab-6d05913126a6/volumes" Jul 30 23:25:21.786621 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:21.786593 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" Jul 30 23:25:21.786621 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:21.786607 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl" event={"ID":"ac7da1dd-e19d-4eb6-93b5-6828ed8a7972","Type":"ContainerDied","Data":"aaf529c648f0d0f012d435411ab02f829f4b537f3a3f4f10224a066ed47d168a"} Jul 30 23:25:21.787187 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:21.786668 2576 scope.go:117] "RemoveContainer" containerID="357da8c9a663c73973c582914305c223d285cd69e85d85f24814fb9c61c5d5cc" Jul 30 23:25:21.788032 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:21.788000 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" Jul 30 23:25:21.788094 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:21.788046 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87" event={"ID":"e952258d-eaa9-4020-8b84-c3a0dc4a0d2f","Type":"ContainerDied","Data":"acbf53a63477ce6969b12ef3ececae7d1c5d154179ccbf37d34b9f09ceda8a3d"} Jul 30 23:25:21.796037 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:21.796015 2576 scope.go:117] "RemoveContainer" containerID="6c6cd1807de236d843a3fc0430790f3de284f86d37237cbe5246d6aa8d6fe0ee" Jul 30 23:25:21.806529 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:21.806508 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87"] Jul 30 23:25:21.808624 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:21.808601 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d04222a5-5bbb48cf68-n9t87"] Jul 30 23:25:21.818120 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:21.818099 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl"] Jul 30 23:25:21.820452 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:21.820431 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d04222a5-6c85c8df74-zpzzl"] Jul 30 23:25:23.236851 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:23.236814 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac7da1dd-e19d-4eb6-93b5-6828ed8a7972" path="/var/lib/kubelet/pods/ac7da1dd-e19d-4eb6-93b5-6828ed8a7972/volumes" Jul 30 23:25:23.237262 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:25:23.237187 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e952258d-eaa9-4020-8b84-c3a0dc4a0d2f" path="/var/lib/kubelet/pods/e952258d-eaa9-4020-8b84-c3a0dc4a0d2f/volumes" Jul 30 23:26:11.983133 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:11.983093 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8"] Jul 30 23:26:11.983719 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:11.983378 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" podUID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" containerName="istio-proxy" containerID="cri-o://41f7f387b2db49a421855f3a0b3973db9f5dc5e518831eeb781f1c98b81d0e3f" gracePeriod=30 Jul 30 23:26:13.774111 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:13.774068 2576 patch_prober.go:28] interesting pod/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 23:26:13.774538 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:13.774139 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" podUID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 23:26:17.234103 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.234076 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:26:17.358236 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.358152 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-token\") pod \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " Jul 30 23:26:17.358236 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.358192 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-data\") pod \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " Jul 30 23:26:17.358236 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.358212 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-envoy\") pod \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " Jul 30 23:26:17.358236 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.358235 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-workload-socket\") pod \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " Jul 30 23:26:17.358571 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.358298 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzvt9\" (UniqueName: \"kubernetes.io/projected/08de82b0-1476-4cd2-b802-e8a347c3e1ed-kube-api-access-qzvt9\") pod \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " Jul 30 23:26:17.358571 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.358340 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istiod-ca-cert\") pod \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " Jul 30 23:26:17.358571 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.358365 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-podinfo\") pod \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " Jul 30 23:26:17.358571 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.358443 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-workload-certs\") pod \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " Jul 30 23:26:17.358571 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.358478 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-credential-socket\") pod \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\" (UID: \"08de82b0-1476-4cd2-b802-e8a347c3e1ed\") " Jul 30 23:26:17.358571 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.358485 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-data" (OuterVolumeSpecName: "istio-data") pod "08de82b0-1476-4cd2-b802-e8a347c3e1ed" (UID: "08de82b0-1476-4cd2-b802-e8a347c3e1ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:26:17.358938 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.358684 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "08de82b0-1476-4cd2-b802-e8a347c3e1ed" (UID: "08de82b0-1476-4cd2-b802-e8a347c3e1ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:26:17.358938 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.358705 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "08de82b0-1476-4cd2-b802-e8a347c3e1ed" (UID: "08de82b0-1476-4cd2-b802-e8a347c3e1ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:26:17.358938 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.358772 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:26:17.358938 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.358786 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:26:17.358938 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.358798 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:26:17.358938 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.358789 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "08de82b0-1476-4cd2-b802-e8a347c3e1ed" (UID: "08de82b0-1476-4cd2-b802-e8a347c3e1ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:26:17.358938 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.358913 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "08de82b0-1476-4cd2-b802-e8a347c3e1ed" (UID: "08de82b0-1476-4cd2-b802-e8a347c3e1ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:26:17.360536 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.360512 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "08de82b0-1476-4cd2-b802-e8a347c3e1ed" (UID: "08de82b0-1476-4cd2-b802-e8a347c3e1ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:26:17.360662 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.360507 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "08de82b0-1476-4cd2-b802-e8a347c3e1ed" (UID: "08de82b0-1476-4cd2-b802-e8a347c3e1ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 23:26:17.360962 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.360938 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "08de82b0-1476-4cd2-b802-e8a347c3e1ed" (UID: "08de82b0-1476-4cd2-b802-e8a347c3e1ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:26:17.361038 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.360972 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08de82b0-1476-4cd2-b802-e8a347c3e1ed-kube-api-access-qzvt9" (OuterVolumeSpecName: "kube-api-access-qzvt9") pod "08de82b0-1476-4cd2-b802-e8a347c3e1ed" (UID: "08de82b0-1476-4cd2-b802-e8a347c3e1ed"). InnerVolumeSpecName "kube-api-access-qzvt9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:26:17.460013 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.459985 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:26:17.460013 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.460011 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:26:17.460197 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.460023 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:26:17.460197 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.460036 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzvt9\" (UniqueName: \"kubernetes.io/projected/08de82b0-1476-4cd2-b802-e8a347c3e1ed-kube-api-access-qzvt9\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:26:17.460197 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.460047 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:26:17.460197 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:17.460058 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08de82b0-1476-4cd2-b802-e8a347c3e1ed-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:26:18.081276 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:18.081235 2576 generic.go:356] "Generic (PLEG): container finished" podID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" containerID="41f7f387b2db49a421855f3a0b3973db9f5dc5e518831eeb781f1c98b81d0e3f" exitCode=0 Jul 30 23:26:18.081491 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:18.081301 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" Jul 30 23:26:18.081491 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:18.081332 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" event={"ID":"08de82b0-1476-4cd2-b802-e8a347c3e1ed","Type":"ContainerDied","Data":"41f7f387b2db49a421855f3a0b3973db9f5dc5e518831eeb781f1c98b81d0e3f"} Jul 30 23:26:18.081491 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:18.081430 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8" event={"ID":"08de82b0-1476-4cd2-b802-e8a347c3e1ed","Type":"ContainerDied","Data":"bf70fc7958e75b6823b2dd9d923b660d2de14673e9c6c94e50091e67cd3eca16"} Jul 30 23:26:18.081491 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:18.081456 2576 scope.go:117] "RemoveContainer" containerID="41f7f387b2db49a421855f3a0b3973db9f5dc5e518831eeb781f1c98b81d0e3f" Jul 30 23:26:18.090745 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:18.090726 2576 scope.go:117] "RemoveContainer" containerID="8623aea3bd3616d0f71385b7a0552378bd645ef35a11b8ff144ee908a9489ed5" Jul 30 23:26:18.098279 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:18.098258 2576 scope.go:117] "RemoveContainer" containerID="41f7f387b2db49a421855f3a0b3973db9f5dc5e518831eeb781f1c98b81d0e3f" Jul 30 23:26:18.098528 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:26:18.098508 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41f7f387b2db49a421855f3a0b3973db9f5dc5e518831eeb781f1c98b81d0e3f\": container with ID starting with 41f7f387b2db49a421855f3a0b3973db9f5dc5e518831eeb781f1c98b81d0e3f not found: ID does not exist" containerID="41f7f387b2db49a421855f3a0b3973db9f5dc5e518831eeb781f1c98b81d0e3f" Jul 30 23:26:18.098580 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:18.098537 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f7f387b2db49a421855f3a0b3973db9f5dc5e518831eeb781f1c98b81d0e3f"} err="failed to get container status \"41f7f387b2db49a421855f3a0b3973db9f5dc5e518831eeb781f1c98b81d0e3f\": rpc error: code = NotFound desc = could not find container \"41f7f387b2db49a421855f3a0b3973db9f5dc5e518831eeb781f1c98b81d0e3f\": container with ID starting with 41f7f387b2db49a421855f3a0b3973db9f5dc5e518831eeb781f1c98b81d0e3f not found: ID does not exist" Jul 30 23:26:18.098580 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:18.098555 2576 scope.go:117] "RemoveContainer" containerID="8623aea3bd3616d0f71385b7a0552378bd645ef35a11b8ff144ee908a9489ed5" Jul 30 23:26:18.098787 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:26:18.098770 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8623aea3bd3616d0f71385b7a0552378bd645ef35a11b8ff144ee908a9489ed5\": container with ID starting with 8623aea3bd3616d0f71385b7a0552378bd645ef35a11b8ff144ee908a9489ed5 not found: ID does not exist" containerID="8623aea3bd3616d0f71385b7a0552378bd645ef35a11b8ff144ee908a9489ed5" Jul 30 23:26:18.098842 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:18.098797 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8623aea3bd3616d0f71385b7a0552378bd645ef35a11b8ff144ee908a9489ed5"} err="failed to get container status \"8623aea3bd3616d0f71385b7a0552378bd645ef35a11b8ff144ee908a9489ed5\": rpc error: code = NotFound desc = could not find container \"8623aea3bd3616d0f71385b7a0552378bd645ef35a11b8ff144ee908a9489ed5\": container with ID starting with 8623aea3bd3616d0f71385b7a0552378bd645ef35a11b8ff144ee908a9489ed5 not found: ID does not exist" Jul 30 23:26:18.104709 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:18.104688 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8"] Jul 30 23:26:18.108980 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:18.108960 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d04222a5-openshift-default-655b664488-jnrr8"] Jul 30 23:26:19.236144 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:26:19.236113 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" path="/var/lib/kubelet/pods/08de82b0-1476-4cd2-b802-e8a347c3e1ed/volumes" Jul 30 23:27:18.530636 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.530598 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk"] Jul 30 23:27:18.531077 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.530934 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d73c16e8-e273-4208-97ab-6d05913126a6" containerName="revoke-keys" Jul 30 23:27:18.531077 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.530945 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d73c16e8-e273-4208-97ab-6d05913126a6" containerName="revoke-keys" Jul 30 23:27:18.531077 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.530956 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac7da1dd-e19d-4eb6-93b5-6828ed8a7972" containerName="payload-processing" Jul 30 23:27:18.531077 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.530962 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac7da1dd-e19d-4eb6-93b5-6828ed8a7972" containerName="payload-processing" Jul 30 23:27:18.531077 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.530972 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e952258d-eaa9-4020-8b84-c3a0dc4a0d2f" containerName="payload-pre-processing" Jul 30 23:27:18.531077 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.530977 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e952258d-eaa9-4020-8b84-c3a0dc4a0d2f" containerName="payload-pre-processing" Jul 30 23:27:18.531077 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.530985 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" containerName="istio-proxy" Jul 30 23:27:18.531077 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.530990 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" containerName="istio-proxy" Jul 30 23:27:18.531077 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.530999 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" containerName="istio-proxy" Jul 30 23:27:18.531077 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.531004 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" containerName="istio-proxy" Jul 30 23:27:18.531077 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.531061 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" containerName="istio-proxy" Jul 30 23:27:18.531077 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.531070 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d73c16e8-e273-4208-97ab-6d05913126a6" containerName="revoke-keys" Jul 30 23:27:18.531077 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.531077 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="08de82b0-1476-4cd2-b802-e8a347c3e1ed" containerName="istio-proxy" Jul 30 23:27:18.531077 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.531083 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e952258d-eaa9-4020-8b84-c3a0dc4a0d2f" containerName="payload-pre-processing" Jul 30 23:27:18.531505 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.531089 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac7da1dd-e19d-4eb6-93b5-6828ed8a7972" containerName="payload-processing" Jul 30 23:27:18.534129 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.534108 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.536674 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.536650 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-2f122f-openshift-default-dockercfg-xlkwb\"" Jul 30 23:27:18.544598 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.544576 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk"] Jul 30 23:27:18.600867 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.600817 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-istio-data\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.601046 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.600880 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-credential-socket\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.601046 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.600941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b152575a-d90d-488f-874b-5472265bde34-istio-podinfo\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.601046 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.601002 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b152575a-d90d-488f-874b-5472265bde34-istio-token\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.601171 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.601061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfxdl\" (UniqueName: \"kubernetes.io/projected/b152575a-d90d-488f-874b-5472265bde34-kube-api-access-zfxdl\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.601171 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.601095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-workload-certs\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.601171 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.601138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-workload-socket\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.601171 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.601158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-istio-envoy\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.601331 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.601172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b152575a-d90d-488f-874b-5472265bde34-istiod-ca-cert\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.701885 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.701827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfxdl\" (UniqueName: \"kubernetes.io/projected/b152575a-d90d-488f-874b-5472265bde34-kube-api-access-zfxdl\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.702068 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.701907 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-workload-certs\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.702068 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.701952 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-workload-socket\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.702068 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.701974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-istio-envoy\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.702217 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.702106 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b152575a-d90d-488f-874b-5472265bde34-istiod-ca-cert\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.702217 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.702180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-istio-data\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.702326 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.702218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-credential-socket\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.702326 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.702252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b152575a-d90d-488f-874b-5472265bde34-istio-podinfo\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.702326 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.702287 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b152575a-d90d-488f-874b-5472265bde34-istio-token\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.702326 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.702315 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-workload-certs\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.702545 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.702347 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-workload-socket\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.702651 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.702623 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-istio-data\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.702761 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.702700 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-credential-socket\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.702825 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.702806 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b152575a-d90d-488f-874b-5472265bde34-istiod-ca-cert\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.704347 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.704324 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-istio-envoy\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.704669 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.704643 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b152575a-d90d-488f-874b-5472265bde34-istio-podinfo\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.710456 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.710433 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b152575a-d90d-488f-874b-5472265bde34-istio-token\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.710986 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.710965 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfxdl\" (UniqueName: \"kubernetes.io/projected/b152575a-d90d-488f-874b-5472265bde34-kube-api-access-zfxdl\") pod \"e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.845211 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.845125 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:18.981456 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.981428 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk"] Jul 30 23:27:18.983507 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:27:18.983479 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb152575a_d90d_488f_874b_5472265bde34.slice/crio-635654221ff3be8ba6a8e15e6faf0fb4e0f5345171f015e4d23600a8afa6ee05 WatchSource:0}: Error finding container 635654221ff3be8ba6a8e15e6faf0fb4e0f5345171f015e4d23600a8afa6ee05: Status 404 returned error can't find the container with id 635654221ff3be8ba6a8e15e6faf0fb4e0f5345171f015e4d23600a8afa6ee05 Jul 30 23:27:18.985590 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.985557 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:27:18.985681 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.985633 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:27:18.985681 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:18.985675 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:27:19.404696 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:19.404658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" event={"ID":"b152575a-d90d-488f-874b-5472265bde34","Type":"ContainerStarted","Data":"05d92f7f94254ad4bd7815f4f332d21d140b3a2985b79e8ebca0a87546e8479f"} Jul 30 23:27:19.404904 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:19.404713 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" event={"ID":"b152575a-d90d-488f-874b-5472265bde34","Type":"ContainerStarted","Data":"635654221ff3be8ba6a8e15e6faf0fb4e0f5345171f015e4d23600a8afa6ee05"} Jul 30 23:27:19.426481 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:19.426436 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" podStartSLOduration=1.426422598 podStartE2EDuration="1.426422598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:27:19.425195427 +0000 UTC m=+2366.629014661" watchObservedRunningTime="2026-07-30 23:27:19.426422598 +0000 UTC m=+2366.630241895" Jul 30 23:27:19.845617 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:19.845531 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:20.851912 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:20.851876 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:21.416016 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:21.415988 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:21.416907 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:21.416888 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:23.528211 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.528173 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk"] Jul 30 23:27:23.534816 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.534790 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" Jul 30 23:27:23.538355 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.538329 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-2f122f-dockercfg-h9sc2\"" Jul 30 23:27:23.538355 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.538348 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-2f122f\"" Jul 30 23:27:23.539799 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.539770 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk"] Jul 30 23:27:23.597787 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.597740 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7"] Jul 30 23:27:23.601710 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.601680 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" Jul 30 23:27:23.612463 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.612424 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7"] Jul 30 23:27:23.646256 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.646227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d258dee-6329-4e1c-aa5c-a0338a560cf6-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk\" (UID: \"6d258dee-6329-4e1c-aa5c-a0338a560cf6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" Jul 30 23:27:23.646420 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.646262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rgdh\" (UniqueName: \"kubernetes.io/projected/6d258dee-6329-4e1c-aa5c-a0338a560cf6-kube-api-access-9rgdh\") pod \"payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk\" (UID: \"6d258dee-6329-4e1c-aa5c-a0338a560cf6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" Jul 30 23:27:23.747393 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.747358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d258dee-6329-4e1c-aa5c-a0338a560cf6-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk\" (UID: \"6d258dee-6329-4e1c-aa5c-a0338a560cf6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" Jul 30 23:27:23.747393 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.747399 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rgdh\" (UniqueName: \"kubernetes.io/projected/6d258dee-6329-4e1c-aa5c-a0338a560cf6-kube-api-access-9rgdh\") pod \"payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk\" (UID: \"6d258dee-6329-4e1c-aa5c-a0338a560cf6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" Jul 30 23:27:23.747660 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.747445 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lqrs\" (UniqueName: \"kubernetes.io/projected/7312d896-d388-4bfe-a36d-311609d3f7ad-kube-api-access-8lqrs\") pod \"payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7\" (UID: \"7312d896-d388-4bfe-a36d-311609d3f7ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" Jul 30 23:27:23.747660 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.747506 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7312d896-d388-4bfe-a36d-311609d3f7ad-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7\" (UID: \"7312d896-d388-4bfe-a36d-311609d3f7ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" Jul 30 23:27:23.748190 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.748170 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d258dee-6329-4e1c-aa5c-a0338a560cf6-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk\" (UID: \"6d258dee-6329-4e1c-aa5c-a0338a560cf6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" Jul 30 23:27:23.755912 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.755877 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rgdh\" (UniqueName: \"kubernetes.io/projected/6d258dee-6329-4e1c-aa5c-a0338a560cf6-kube-api-access-9rgdh\") pod \"payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk\" (UID: \"6d258dee-6329-4e1c-aa5c-a0338a560cf6\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" Jul 30 23:27:23.846926 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.846825 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" Jul 30 23:27:23.848161 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.848139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7312d896-d388-4bfe-a36d-311609d3f7ad-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7\" (UID: \"7312d896-d388-4bfe-a36d-311609d3f7ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" Jul 30 23:27:23.848235 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.848226 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lqrs\" (UniqueName: \"kubernetes.io/projected/7312d896-d388-4bfe-a36d-311609d3f7ad-kube-api-access-8lqrs\") pod \"payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7\" (UID: \"7312d896-d388-4bfe-a36d-311609d3f7ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" Jul 30 23:27:23.848806 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.848780 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7312d896-d388-4bfe-a36d-311609d3f7ad-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7\" (UID: \"7312d896-d388-4bfe-a36d-311609d3f7ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" Jul 30 23:27:23.855889 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.855836 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lqrs\" (UniqueName: \"kubernetes.io/projected/7312d896-d388-4bfe-a36d-311609d3f7ad-kube-api-access-8lqrs\") pod \"payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7\" (UID: \"7312d896-d388-4bfe-a36d-311609d3f7ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" Jul 30 23:27:23.916568 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.916538 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" Jul 30 23:27:23.984051 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:23.983920 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk"] Jul 30 23:27:23.985958 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:27:23.985932 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d258dee_6329_4e1c_aa5c_a0338a560cf6.slice/crio-1edb5a349a0b4378f4b20fbc191ee0f39b50fc1b2038d07e77e11d9ab5c33aea WatchSource:0}: Error finding container 1edb5a349a0b4378f4b20fbc191ee0f39b50fc1b2038d07e77e11d9ab5c33aea: Status 404 returned error can't find the container with id 1edb5a349a0b4378f4b20fbc191ee0f39b50fc1b2038d07e77e11d9ab5c33aea Jul 30 23:27:24.056577 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:24.056552 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7"] Jul 30 23:27:24.057294 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:27:24.057266 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7312d896_d388_4bfe_a36d_311609d3f7ad.slice/crio-004a6a5734c606d504bf08a13bcbe2efe4b830a76be8294ca7dafb9bf708552d WatchSource:0}: Error finding container 004a6a5734c606d504bf08a13bcbe2efe4b830a76be8294ca7dafb9bf708552d: Status 404 returned error can't find the container with id 004a6a5734c606d504bf08a13bcbe2efe4b830a76be8294ca7dafb9bf708552d Jul 30 23:27:24.433582 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:24.433542 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" event={"ID":"7312d896-d388-4bfe-a36d-311609d3f7ad","Type":"ContainerStarted","Data":"2856a143d09fa0286e817dd1888c481da47e9b8204e547cd88d9463313439e9d"} Jul 30 23:27:24.433819 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:24.433607 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" event={"ID":"7312d896-d388-4bfe-a36d-311609d3f7ad","Type":"ContainerStarted","Data":"004a6a5734c606d504bf08a13bcbe2efe4b830a76be8294ca7dafb9bf708552d"} Jul 30 23:27:24.433819 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:24.433652 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" Jul 30 23:27:24.435081 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:24.435053 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" event={"ID":"6d258dee-6329-4e1c-aa5c-a0338a560cf6","Type":"ContainerStarted","Data":"ec475a1b2f5eadce92677b0283f0b66c441dac17a6c28cc71d90b041f18a8d98"} Jul 30 23:27:24.435185 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:24.435097 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" event={"ID":"6d258dee-6329-4e1c-aa5c-a0338a560cf6","Type":"ContainerStarted","Data":"1edb5a349a0b4378f4b20fbc191ee0f39b50fc1b2038d07e77e11d9ab5c33aea"} Jul 30 23:27:24.435185 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:24.435131 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" Jul 30 23:27:24.450903 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:24.450848 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" podStartSLOduration=1.450833848 podStartE2EDuration="1.450833848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:27:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:27:24.449363076 +0000 UTC m=+2371.653182311" watchObservedRunningTime="2026-07-30 23:27:24.450833848 +0000 UTC m=+2371.654653082" Jul 30 23:27:24.464872 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:24.464819 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" podStartSLOduration=1.464806034 podStartE2EDuration="1.464806034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:27:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:27:24.464038914 +0000 UTC m=+2371.667858183" watchObservedRunningTime="2026-07-30 23:27:24.464806034 +0000 UTC m=+2371.668625268" Jul 30 23:27:35.442962 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:35.442887 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" Jul 30 23:27:35.443372 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:35.443063 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" Jul 30 23:27:35.504908 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:35.504817 2576 generic.go:356] "Generic (PLEG): container finished" podID="b152575a-d90d-488f-874b-5472265bde34" containerID="05d92f7f94254ad4bd7815f4f332d21d140b3a2985b79e8ebca0a87546e8479f" exitCode=0 Jul 30 23:27:35.504908 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:35.504897 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" event={"ID":"b152575a-d90d-488f-874b-5472265bde34","Type":"ContainerDied","Data":"05d92f7f94254ad4bd7815f4f332d21d140b3a2985b79e8ebca0a87546e8479f"} Jul 30 23:27:35.505294 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:35.505273 2576 scope.go:117] "RemoveContainer" containerID="05d92f7f94254ad4bd7815f4f332d21d140b3a2985b79e8ebca0a87546e8479f" Jul 30 23:27:35.506439 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:35.506411 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:27:35.506520 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:35.506480 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:27:35.506563 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:35.506517 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:27:36.416670 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:36.416629 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:36.512468 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:36.512427 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" event={"ID":"b152575a-d90d-488f-874b-5472265bde34","Type":"ContainerStarted","Data":"9bd72aca52ad3cd342757a0a3ed6377b38b1a4fa7449192f05a690fdef656cf9"} Jul 30 23:27:36.846197 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:36.846044 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:36.847455 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:36.847424 2576 patch_prober.go:28] interesting pod/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Jul 30 23:27:36.847600 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:36.847486 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" podUID="b152575a-d90d-488f-874b-5472265bde34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Jul 30 23:27:37.846571 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:37.846535 2576 patch_prober.go:28] interesting pod/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Jul 30 23:27:37.847181 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:37.847150 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" podUID="b152575a-d90d-488f-874b-5472265bde34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Jul 30 23:27:38.845676 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:38.845634 2576 patch_prober.go:28] interesting pod/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Jul 30 23:27:38.846013 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:38.845983 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" podUID="b152575a-d90d-488f-874b-5472265bde34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Jul 30 23:27:39.846528 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:39.846483 2576 patch_prober.go:28] interesting pod/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Jul 30 23:27:39.847044 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:39.846549 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" podUID="b152575a-d90d-488f-874b-5472265bde34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Jul 30 23:27:40.845757 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:40.845722 2576 patch_prober.go:28] interesting pod/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Jul 30 23:27:40.846079 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:40.846041 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" podUID="b152575a-d90d-488f-874b-5472265bde34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Jul 30 23:27:41.849609 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:41.849578 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:41.849997 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:41.849873 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:41.850518 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:41.850502 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:27:47.022953 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.022921 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp"] Jul 30 23:27:47.025402 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.025342 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.028145 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.028126 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-fcdf3e-openshift-default-dockercfg-5mmnx\"" Jul 30 23:27:47.044467 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.044443 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp"] Jul 30 23:27:47.064965 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.064941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6f8fc59-12b8-440a-828f-ef53bb763feb-istiod-ca-cert\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.065056 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.064976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-envoy\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.065056 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.065025 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-podinfo\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.065056 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.065048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcn57\" (UniqueName: \"kubernetes.io/projected/c6f8fc59-12b8-440a-828f-ef53bb763feb-kube-api-access-xcn57\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.065211 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.065092 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-token\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.065211 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.065117 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-workload-socket\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.065211 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.065135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-credential-socket\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.065211 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.065156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-data\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.065211 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.065199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-workload-certs\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.166308 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.166275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-podinfo\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.166308 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.166313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcn57\" (UniqueName: \"kubernetes.io/projected/c6f8fc59-12b8-440a-828f-ef53bb763feb-kube-api-access-xcn57\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.166508 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.166439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-token\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.166508 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.166490 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-workload-socket\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.166604 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.166518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-credential-socket\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.166604 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.166544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-data\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.166604 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.166567 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-workload-certs\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.166746 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.166641 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6f8fc59-12b8-440a-828f-ef53bb763feb-istiod-ca-cert\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.166746 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.166677 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-envoy\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.166983 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.166959 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-workload-socket\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.166983 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.166979 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-workload-certs\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.167118 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.167018 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-credential-socket\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.167118 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.167075 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-data\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.167509 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.167485 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6f8fc59-12b8-440a-828f-ef53bb763feb-istiod-ca-cert\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.168838 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.168816 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-envoy\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.168995 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.168978 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-podinfo\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.174207 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.174184 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-token\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.174838 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.174822 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcn57\" (UniqueName: \"kubernetes.io/projected/c6f8fc59-12b8-440a-828f-ef53bb763feb-kube-api-access-xcn57\") pod \"e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.336398 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.336328 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:47.473154 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.472992 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp"] Jul 30 23:27:47.475967 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:27:47.475935 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6f8fc59_12b8_440a_828f_ef53bb763feb.slice/crio-8fd9320d0cb559ca5350f59d763a5cabbf6862f19ee76ed76aca0cd971e05f67 WatchSource:0}: Error finding container 8fd9320d0cb559ca5350f59d763a5cabbf6862f19ee76ed76aca0cd971e05f67: Status 404 returned error can't find the container with id 8fd9320d0cb559ca5350f59d763a5cabbf6862f19ee76ed76aca0cd971e05f67 Jul 30 23:27:47.478094 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.478060 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:27:47.478199 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.478124 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:27:47.478199 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.478154 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:27:47.572310 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.572278 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" event={"ID":"c6f8fc59-12b8-440a-828f-ef53bb763feb","Type":"ContainerStarted","Data":"955ae8e38eb392cf265af4c0a07f366b89ae321e1da7f24ea755e4fe79c84f71"} Jul 30 23:27:47.572448 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.572330 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" event={"ID":"c6f8fc59-12b8-440a-828f-ef53bb763feb","Type":"ContainerStarted","Data":"8fd9320d0cb559ca5350f59d763a5cabbf6862f19ee76ed76aca0cd971e05f67"} Jul 30 23:27:47.596278 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:47.596182 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" podStartSLOduration=1.596167877 podStartE2EDuration="1.596167877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:27:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:27:47.593223215 +0000 UTC m=+2394.797042461" watchObservedRunningTime="2026-07-30 23:27:47.596167877 +0000 UTC m=+2394.799987111" Jul 30 23:27:48.336569 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:48.336532 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:48.341673 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:48.341649 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:48.578467 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:48.578430 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:48.579445 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:48.579423 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:27:51.333666 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.333633 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs"] Jul 30 23:27:51.336122 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.336102 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" Jul 30 23:27:51.338941 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.338920 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-fcdf3e-dockercfg-l9lpg\"" Jul 30 23:27:51.339059 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.338989 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-fcdf3e\"" Jul 30 23:27:51.352375 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.352352 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs"] Jul 30 23:27:51.369983 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.369955 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg"] Jul 30 23:27:51.374292 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.374270 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" Jul 30 23:27:51.383125 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.383103 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg"] Jul 30 23:27:51.408849 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.408826 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmhcf\" (UniqueName: \"kubernetes.io/projected/1d725d81-a975-4d94-b074-97ce81290e59-kube-api-access-fmhcf\") pod \"payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs\" (UID: \"1d725d81-a975-4d94-b074-97ce81290e59\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" Jul 30 23:27:51.408972 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.408959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d725d81-a975-4d94-b074-97ce81290e59-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs\" (UID: \"1d725d81-a975-4d94-b074-97ce81290e59\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" Jul 30 23:27:51.509843 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.509808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d130e0f2-0b0c-47d9-96ad-e1e39d20f074-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg\" (UID: \"d130e0f2-0b0c-47d9-96ad-e1e39d20f074\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" Jul 30 23:27:51.510038 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.509869 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmhcf\" (UniqueName: \"kubernetes.io/projected/1d725d81-a975-4d94-b074-97ce81290e59-kube-api-access-fmhcf\") pod \"payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs\" (UID: \"1d725d81-a975-4d94-b074-97ce81290e59\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" Jul 30 23:27:51.510038 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.510004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvx9c\" (UniqueName: \"kubernetes.io/projected/d130e0f2-0b0c-47d9-96ad-e1e39d20f074-kube-api-access-tvx9c\") pod \"payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg\" (UID: \"d130e0f2-0b0c-47d9-96ad-e1e39d20f074\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" Jul 30 23:27:51.510156 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.510047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d725d81-a975-4d94-b074-97ce81290e59-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs\" (UID: \"1d725d81-a975-4d94-b074-97ce81290e59\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" Jul 30 23:27:51.510710 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.510687 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d725d81-a975-4d94-b074-97ce81290e59-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs\" (UID: \"1d725d81-a975-4d94-b074-97ce81290e59\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" Jul 30 23:27:51.517739 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.517720 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmhcf\" (UniqueName: \"kubernetes.io/projected/1d725d81-a975-4d94-b074-97ce81290e59-kube-api-access-fmhcf\") pod \"payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs\" (UID: \"1d725d81-a975-4d94-b074-97ce81290e59\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" Jul 30 23:27:51.611096 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.611024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvx9c\" (UniqueName: \"kubernetes.io/projected/d130e0f2-0b0c-47d9-96ad-e1e39d20f074-kube-api-access-tvx9c\") pod \"payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg\" (UID: \"d130e0f2-0b0c-47d9-96ad-e1e39d20f074\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" Jul 30 23:27:51.611096 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.611076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d130e0f2-0b0c-47d9-96ad-e1e39d20f074-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg\" (UID: \"d130e0f2-0b0c-47d9-96ad-e1e39d20f074\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" Jul 30 23:27:51.611703 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.611684 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d130e0f2-0b0c-47d9-96ad-e1e39d20f074-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg\" (UID: \"d130e0f2-0b0c-47d9-96ad-e1e39d20f074\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" Jul 30 23:27:51.619014 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.618991 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvx9c\" (UniqueName: \"kubernetes.io/projected/d130e0f2-0b0c-47d9-96ad-e1e39d20f074-kube-api-access-tvx9c\") pod \"payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg\" (UID: \"d130e0f2-0b0c-47d9-96ad-e1e39d20f074\") " pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" Jul 30 23:27:51.646880 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.646836 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" Jul 30 23:27:51.686067 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.686041 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" Jul 30 23:27:51.824583 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.824554 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg"] Jul 30 23:27:51.825696 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:27:51.825669 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd130e0f2_0b0c_47d9_96ad_e1e39d20f074.slice/crio-5b9fd8ca8c3b359f1fbc51e15f305f8ad3b102f3e67a318c691fe22776a4d1fd WatchSource:0}: Error finding container 5b9fd8ca8c3b359f1fbc51e15f305f8ad3b102f3e67a318c691fe22776a4d1fd: Status 404 returned error can't find the container with id 5b9fd8ca8c3b359f1fbc51e15f305f8ad3b102f3e67a318c691fe22776a4d1fd Jul 30 23:27:51.994324 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:51.994297 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs"] Jul 30 23:27:51.996058 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:27:51.996030 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d725d81_a975_4d94_b074_97ce81290e59.slice/crio-c392dbfde378280b4df7cd1527baef7526eff737a0728144051913acafbe3dbe WatchSource:0}: Error finding container c392dbfde378280b4df7cd1527baef7526eff737a0728144051913acafbe3dbe: Status 404 returned error can't find the container with id c392dbfde378280b4df7cd1527baef7526eff737a0728144051913acafbe3dbe Jul 30 23:27:52.602825 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:52.602790 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" event={"ID":"1d725d81-a975-4d94-b074-97ce81290e59","Type":"ContainerStarted","Data":"4c3a5712707e71bc13da6ec38a8bcbe31ae3f14ff82187c6d9e698db223b5d73"} Jul 30 23:27:52.603270 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:52.602843 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" event={"ID":"1d725d81-a975-4d94-b074-97ce81290e59","Type":"ContainerStarted","Data":"c392dbfde378280b4df7cd1527baef7526eff737a0728144051913acafbe3dbe"} Jul 30 23:27:52.603270 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:52.602915 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" Jul 30 23:27:52.604624 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:52.604603 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" event={"ID":"d130e0f2-0b0c-47d9-96ad-e1e39d20f074","Type":"ContainerStarted","Data":"68fc36d73652bd6a317ad6631e12714dbccbfc1aecb53411c38a0554258603e1"} Jul 30 23:27:52.604736 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:52.604637 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" event={"ID":"d130e0f2-0b0c-47d9-96ad-e1e39d20f074","Type":"ContainerStarted","Data":"5b9fd8ca8c3b359f1fbc51e15f305f8ad3b102f3e67a318c691fe22776a4d1fd"} Jul 30 23:27:52.604736 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:52.604673 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" Jul 30 23:27:52.620108 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:52.620065 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" podStartSLOduration=1.620050601 podStartE2EDuration="1.620050601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:27:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:27:52.617575555 +0000 UTC m=+2399.821394996" watchObservedRunningTime="2026-07-30 23:27:52.620050601 +0000 UTC m=+2399.823869847" Jul 30 23:27:52.634892 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:52.634834 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" podStartSLOduration=1.634818858 podStartE2EDuration="1.634818858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:27:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:27:52.632765243 +0000 UTC m=+2399.836584525" watchObservedRunningTime="2026-07-30 23:27:52.634818858 +0000 UTC m=+2399.838638092" Jul 30 23:27:53.367463 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:53.367423 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:27:53.377975 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:53.377951 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:27:54.664744 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:27:54.664710 2576 scope.go:117] "RemoveContainer" containerID="bec2ab221dfff89ee934c397133d252b2ad6e09308d3c8da098d13d4c7ecea7c" Jul 30 23:28:03.579910 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:03.579801 2576 patch_prober.go:28] interesting pod/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Jul 30 23:28:03.579910 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:03.579887 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" podUID="c6f8fc59-12b8-440a-828f-ef53bb763feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Jul 30 23:28:03.611387 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:03.611344 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" podUID="1d725d81-a975-4d94-b074-97ce81290e59" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.69:9004: connect: connection refused" Jul 30 23:28:03.611995 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:03.611976 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" Jul 30 23:28:03.684008 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:03.683976 2576 generic.go:356] "Generic (PLEG): container finished" podID="c6f8fc59-12b8-440a-828f-ef53bb763feb" containerID="955ae8e38eb392cf265af4c0a07f366b89ae321e1da7f24ea755e4fe79c84f71" exitCode=0 Jul 30 23:28:03.684167 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:03.684051 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" event={"ID":"c6f8fc59-12b8-440a-828f-ef53bb763feb","Type":"ContainerDied","Data":"955ae8e38eb392cf265af4c0a07f366b89ae321e1da7f24ea755e4fe79c84f71"} Jul 30 23:28:03.684478 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:03.684464 2576 scope.go:117] "RemoveContainer" containerID="955ae8e38eb392cf265af4c0a07f366b89ae321e1da7f24ea755e4fe79c84f71" Jul 30 23:28:03.685462 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:03.685437 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:28:03.685515 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:03.685497 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:28:03.685550 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:03.685532 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:28:04.691690 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:04.691655 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" event={"ID":"c6f8fc59-12b8-440a-828f-ef53bb763feb","Type":"ContainerStarted","Data":"07047206f295ba68571eb4c693f8dc98fac79c9db91407b835f3975012c29b87"} Jul 30 23:28:05.337297 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:05.337261 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:28:05.337609 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:05.337502 2576 patch_prober.go:28] interesting pod/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Jul 30 23:28:05.337804 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:05.337781 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" podUID="c6f8fc59-12b8-440a-828f-ef53bb763feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Jul 30 23:28:06.336792 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:06.336753 2576 patch_prober.go:28] interesting pod/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Jul 30 23:28:06.337403 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:06.337365 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" podUID="c6f8fc59-12b8-440a-828f-ef53bb763feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Jul 30 23:28:07.337710 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:07.337671 2576 patch_prober.go:28] interesting pod/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Jul 30 23:28:07.338246 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:07.337735 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" podUID="c6f8fc59-12b8-440a-828f-ef53bb763feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Jul 30 23:28:08.336779 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:08.336741 2576 patch_prober.go:28] interesting pod/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Jul 30 23:28:08.337197 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:08.337166 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" podUID="c6f8fc59-12b8-440a-828f-ef53bb763feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Jul 30 23:28:09.337545 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:09.337496 2576 patch_prober.go:28] interesting pod/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Jul 30 23:28:09.338169 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:09.338134 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" podUID="c6f8fc59-12b8-440a-828f-ef53bb763feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Jul 30 23:28:10.341167 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:10.341136 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:28:10.341566 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:10.341519 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:28:10.342254 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:10.342236 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:28:13.611452 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:28:13.611416 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" Jul 30 23:29:35.644805 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:35.644768 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7"] Jul 30 23:29:35.645327 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:35.645015 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" podUID="7312d896-d388-4bfe-a36d-311609d3f7ad" containerName="payload-processing" containerID="cri-o://2856a143d09fa0286e817dd1888c481da47e9b8204e547cd88d9463313439e9d" gracePeriod=30 Jul 30 23:29:35.651535 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:35.651503 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk"] Jul 30 23:29:35.651738 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:35.651714 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" podUID="6d258dee-6329-4e1c-aa5c-a0338a560cf6" containerName="payload-pre-processing" containerID="cri-o://ec475a1b2f5eadce92677b0283f0b66c441dac17a6c28cc71d90b041f18a8d98" gracePeriod=30 Jul 30 23:29:35.907520 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:35.907462 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" Jul 30 23:29:35.937637 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:35.937610 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" Jul 30 23:29:35.992467 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:35.992435 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7312d896-d388-4bfe-a36d-311609d3f7ad-plugins-config-volume\") pod \"7312d896-d388-4bfe-a36d-311609d3f7ad\" (UID: \"7312d896-d388-4bfe-a36d-311609d3f7ad\") " Jul 30 23:29:35.992630 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:35.992610 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lqrs\" (UniqueName: \"kubernetes.io/projected/7312d896-d388-4bfe-a36d-311609d3f7ad-kube-api-access-8lqrs\") pod \"7312d896-d388-4bfe-a36d-311609d3f7ad\" (UID: \"7312d896-d388-4bfe-a36d-311609d3f7ad\") " Jul 30 23:29:35.992797 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:35.992773 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7312d896-d388-4bfe-a36d-311609d3f7ad-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7312d896-d388-4bfe-a36d-311609d3f7ad" (UID: "7312d896-d388-4bfe-a36d-311609d3f7ad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:29:35.994650 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:35.994627 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7312d896-d388-4bfe-a36d-311609d3f7ad-kube-api-access-8lqrs" (OuterVolumeSpecName: "kube-api-access-8lqrs") pod "7312d896-d388-4bfe-a36d-311609d3f7ad" (UID: "7312d896-d388-4bfe-a36d-311609d3f7ad"). InnerVolumeSpecName "kube-api-access-8lqrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:29:36.093799 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.093759 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d258dee-6329-4e1c-aa5c-a0338a560cf6-plugins-config-volume\") pod \"6d258dee-6329-4e1c-aa5c-a0338a560cf6\" (UID: \"6d258dee-6329-4e1c-aa5c-a0338a560cf6\") " Jul 30 23:29:36.094017 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.093839 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rgdh\" (UniqueName: \"kubernetes.io/projected/6d258dee-6329-4e1c-aa5c-a0338a560cf6-kube-api-access-9rgdh\") pod \"6d258dee-6329-4e1c-aa5c-a0338a560cf6\" (UID: \"6d258dee-6329-4e1c-aa5c-a0338a560cf6\") " Jul 30 23:29:36.094116 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.094096 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lqrs\" (UniqueName: \"kubernetes.io/projected/7312d896-d388-4bfe-a36d-311609d3f7ad-kube-api-access-8lqrs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:29:36.094170 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.094122 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7312d896-d388-4bfe-a36d-311609d3f7ad-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:29:36.094170 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.094146 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d258dee-6329-4e1c-aa5c-a0338a560cf6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6d258dee-6329-4e1c-aa5c-a0338a560cf6" (UID: "6d258dee-6329-4e1c-aa5c-a0338a560cf6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:29:36.095833 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.095813 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d258dee-6329-4e1c-aa5c-a0338a560cf6-kube-api-access-9rgdh" (OuterVolumeSpecName: "kube-api-access-9rgdh") pod "6d258dee-6329-4e1c-aa5c-a0338a560cf6" (UID: "6d258dee-6329-4e1c-aa5c-a0338a560cf6"). InnerVolumeSpecName "kube-api-access-9rgdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:29:36.195106 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.195021 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d258dee-6329-4e1c-aa5c-a0338a560cf6-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:29:36.195106 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.195050 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rgdh\" (UniqueName: \"kubernetes.io/projected/6d258dee-6329-4e1c-aa5c-a0338a560cf6-kube-api-access-9rgdh\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:29:36.204824 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.204796 2576 generic.go:356] "Generic (PLEG): container finished" podID="7312d896-d388-4bfe-a36d-311609d3f7ad" containerID="2856a143d09fa0286e817dd1888c481da47e9b8204e547cd88d9463313439e9d" exitCode=0 Jul 30 23:29:36.204993 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.204837 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" Jul 30 23:29:36.204993 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.204888 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" event={"ID":"7312d896-d388-4bfe-a36d-311609d3f7ad","Type":"ContainerDied","Data":"2856a143d09fa0286e817dd1888c481da47e9b8204e547cd88d9463313439e9d"} Jul 30 23:29:36.204993 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.204948 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7" event={"ID":"7312d896-d388-4bfe-a36d-311609d3f7ad","Type":"ContainerDied","Data":"004a6a5734c606d504bf08a13bcbe2efe4b830a76be8294ca7dafb9bf708552d"} Jul 30 23:29:36.204993 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.204979 2576 scope.go:117] "RemoveContainer" containerID="2856a143d09fa0286e817dd1888c481da47e9b8204e547cd88d9463313439e9d" Jul 30 23:29:36.206207 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.206181 2576 generic.go:356] "Generic (PLEG): container finished" podID="6d258dee-6329-4e1c-aa5c-a0338a560cf6" containerID="ec475a1b2f5eadce92677b0283f0b66c441dac17a6c28cc71d90b041f18a8d98" exitCode=0 Jul 30 23:29:36.206343 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.206220 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" Jul 30 23:29:36.206343 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.206233 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" event={"ID":"6d258dee-6329-4e1c-aa5c-a0338a560cf6","Type":"ContainerDied","Data":"ec475a1b2f5eadce92677b0283f0b66c441dac17a6c28cc71d90b041f18a8d98"} Jul 30 23:29:36.206343 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.206276 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk" event={"ID":"6d258dee-6329-4e1c-aa5c-a0338a560cf6","Type":"ContainerDied","Data":"1edb5a349a0b4378f4b20fbc191ee0f39b50fc1b2038d07e77e11d9ab5c33aea"} Jul 30 23:29:36.214828 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.214812 2576 scope.go:117] "RemoveContainer" containerID="2856a143d09fa0286e817dd1888c481da47e9b8204e547cd88d9463313439e9d" Jul 30 23:29:36.215116 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:29:36.215100 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2856a143d09fa0286e817dd1888c481da47e9b8204e547cd88d9463313439e9d\": container with ID starting with 2856a143d09fa0286e817dd1888c481da47e9b8204e547cd88d9463313439e9d not found: ID does not exist" containerID="2856a143d09fa0286e817dd1888c481da47e9b8204e547cd88d9463313439e9d" Jul 30 23:29:36.215271 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.215125 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2856a143d09fa0286e817dd1888c481da47e9b8204e547cd88d9463313439e9d"} err="failed to get container status \"2856a143d09fa0286e817dd1888c481da47e9b8204e547cd88d9463313439e9d\": rpc error: code = NotFound desc = could not find container \"2856a143d09fa0286e817dd1888c481da47e9b8204e547cd88d9463313439e9d\": container with ID starting with 2856a143d09fa0286e817dd1888c481da47e9b8204e547cd88d9463313439e9d not found: ID does not exist" Jul 30 23:29:36.215271 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.215141 2576 scope.go:117] "RemoveContainer" containerID="ec475a1b2f5eadce92677b0283f0b66c441dac17a6c28cc71d90b041f18a8d98" Jul 30 23:29:36.222887 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.222872 2576 scope.go:117] "RemoveContainer" containerID="ec475a1b2f5eadce92677b0283f0b66c441dac17a6c28cc71d90b041f18a8d98" Jul 30 23:29:36.223135 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:29:36.223114 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec475a1b2f5eadce92677b0283f0b66c441dac17a6c28cc71d90b041f18a8d98\": container with ID starting with ec475a1b2f5eadce92677b0283f0b66c441dac17a6c28cc71d90b041f18a8d98 not found: ID does not exist" containerID="ec475a1b2f5eadce92677b0283f0b66c441dac17a6c28cc71d90b041f18a8d98" Jul 30 23:29:36.223197 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.223142 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec475a1b2f5eadce92677b0283f0b66c441dac17a6c28cc71d90b041f18a8d98"} err="failed to get container status \"ec475a1b2f5eadce92677b0283f0b66c441dac17a6c28cc71d90b041f18a8d98\": rpc error: code = NotFound desc = could not find container \"ec475a1b2f5eadce92677b0283f0b66c441dac17a6c28cc71d90b041f18a8d98\": container with ID starting with ec475a1b2f5eadce92677b0283f0b66c441dac17a6c28cc71d90b041f18a8d98 not found: ID does not exist" Jul 30 23:29:36.230368 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.230347 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk"] Jul 30 23:29:36.234475 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.234453 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-2f122f-844999885b-klpfk"] Jul 30 23:29:36.244355 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.244333 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7"] Jul 30 23:29:36.248266 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:36.248236 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2f122f-75d985d756-smxc7"] Jul 30 23:29:37.235591 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:37.235538 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d258dee-6329-4e1c-aa5c-a0338a560cf6" path="/var/lib/kubelet/pods/6d258dee-6329-4e1c-aa5c-a0338a560cf6/volumes" Jul 30 23:29:37.236157 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:37.236095 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7312d896-d388-4bfe-a36d-311609d3f7ad" path="/var/lib/kubelet/pods/7312d896-d388-4bfe-a36d-311609d3f7ad/volumes" Jul 30 23:29:42.432121 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:42.432086 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk"] Jul 30 23:29:42.432576 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:42.432305 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" podUID="b152575a-d90d-488f-874b-5472265bde34" containerName="istio-proxy" containerID="cri-o://9bd72aca52ad3cd342757a0a3ed6377b38b1a4fa7449192f05a690fdef656cf9" gracePeriod=30 Jul 30 23:29:47.679777 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.679753 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:29:47.690060 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.690037 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfxdl\" (UniqueName: \"kubernetes.io/projected/b152575a-d90d-488f-874b-5472265bde34-kube-api-access-zfxdl\") pod \"b152575a-d90d-488f-874b-5472265bde34\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " Jul 30 23:29:47.690196 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.690093 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-workload-socket\") pod \"b152575a-d90d-488f-874b-5472265bde34\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " Jul 30 23:29:47.690196 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.690126 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b152575a-d90d-488f-874b-5472265bde34-istio-token\") pod \"b152575a-d90d-488f-874b-5472265bde34\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " Jul 30 23:29:47.690196 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.690156 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b152575a-d90d-488f-874b-5472265bde34-istio-podinfo\") pod \"b152575a-d90d-488f-874b-5472265bde34\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " Jul 30 23:29:47.690196 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.690184 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-credential-socket\") pod \"b152575a-d90d-488f-874b-5472265bde34\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " Jul 30 23:29:47.690417 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.690210 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-workload-certs\") pod \"b152575a-d90d-488f-874b-5472265bde34\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " Jul 30 23:29:47.690417 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.690252 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-istio-data\") pod \"b152575a-d90d-488f-874b-5472265bde34\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " Jul 30 23:29:47.690417 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.690284 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-istio-envoy\") pod \"b152575a-d90d-488f-874b-5472265bde34\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " Jul 30 23:29:47.690417 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.690311 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b152575a-d90d-488f-874b-5472265bde34-istiod-ca-cert\") pod \"b152575a-d90d-488f-874b-5472265bde34\" (UID: \"b152575a-d90d-488f-874b-5472265bde34\") " Jul 30 23:29:47.690680 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.690545 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b152575a-d90d-488f-874b-5472265bde34" (UID: "b152575a-d90d-488f-874b-5472265bde34"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:29:47.690742 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.690678 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:29:47.690963 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.690844 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b152575a-d90d-488f-874b-5472265bde34-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b152575a-d90d-488f-874b-5472265bde34" (UID: "b152575a-d90d-488f-874b-5472265bde34"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:29:47.691116 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.690846 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b152575a-d90d-488f-874b-5472265bde34" (UID: "b152575a-d90d-488f-874b-5472265bde34"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:29:47.691116 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.690910 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-istio-data" (OuterVolumeSpecName: "istio-data") pod "b152575a-d90d-488f-874b-5472265bde34" (UID: "b152575a-d90d-488f-874b-5472265bde34"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:29:47.691116 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.690941 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b152575a-d90d-488f-874b-5472265bde34" (UID: "b152575a-d90d-488f-874b-5472265bde34"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:29:47.692713 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.692687 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b152575a-d90d-488f-874b-5472265bde34-istio-token" (OuterVolumeSpecName: "istio-token") pod "b152575a-d90d-488f-874b-5472265bde34" (UID: "b152575a-d90d-488f-874b-5472265bde34"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:29:47.692816 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.692747 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b152575a-d90d-488f-874b-5472265bde34-kube-api-access-zfxdl" (OuterVolumeSpecName: "kube-api-access-zfxdl") pod "b152575a-d90d-488f-874b-5472265bde34" (UID: "b152575a-d90d-488f-874b-5472265bde34"). InnerVolumeSpecName "kube-api-access-zfxdl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:29:47.692816 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.692771 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b152575a-d90d-488f-874b-5472265bde34-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b152575a-d90d-488f-874b-5472265bde34" (UID: "b152575a-d90d-488f-874b-5472265bde34"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 23:29:47.693009 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.692993 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b152575a-d90d-488f-874b-5472265bde34" (UID: "b152575a-d90d-488f-874b-5472265bde34"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:29:47.791680 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.791641 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:29:47.791680 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.791675 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:29:47.791680 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.791684 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:29:47.791680 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.791692 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b152575a-d90d-488f-874b-5472265bde34-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:29:47.791942 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.791699 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b152575a-d90d-488f-874b-5472265bde34-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:29:47.791942 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.791707 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfxdl\" (UniqueName: \"kubernetes.io/projected/b152575a-d90d-488f-874b-5472265bde34-kube-api-access-zfxdl\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:29:47.791942 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.791715 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b152575a-d90d-488f-874b-5472265bde34-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:29:47.791942 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:47.791723 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b152575a-d90d-488f-874b-5472265bde34-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:29:48.278077 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:48.278039 2576 generic.go:356] "Generic (PLEG): container finished" podID="b152575a-d90d-488f-874b-5472265bde34" containerID="9bd72aca52ad3cd342757a0a3ed6377b38b1a4fa7449192f05a690fdef656cf9" exitCode=0 Jul 30 23:29:48.278264 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:48.278084 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" Jul 30 23:29:48.278264 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:48.278076 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" event={"ID":"b152575a-d90d-488f-874b-5472265bde34","Type":"ContainerDied","Data":"9bd72aca52ad3cd342757a0a3ed6377b38b1a4fa7449192f05a690fdef656cf9"} Jul 30 23:29:48.278264 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:48.278197 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk" event={"ID":"b152575a-d90d-488f-874b-5472265bde34","Type":"ContainerDied","Data":"635654221ff3be8ba6a8e15e6faf0fb4e0f5345171f015e4d23600a8afa6ee05"} Jul 30 23:29:48.278264 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:48.278226 2576 scope.go:117] "RemoveContainer" containerID="9bd72aca52ad3cd342757a0a3ed6377b38b1a4fa7449192f05a690fdef656cf9" Jul 30 23:29:48.287634 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:48.287616 2576 scope.go:117] "RemoveContainer" containerID="05d92f7f94254ad4bd7815f4f332d21d140b3a2985b79e8ebca0a87546e8479f" Jul 30 23:29:48.295290 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:48.295270 2576 scope.go:117] "RemoveContainer" containerID="9bd72aca52ad3cd342757a0a3ed6377b38b1a4fa7449192f05a690fdef656cf9" Jul 30 23:29:48.295550 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:29:48.295528 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bd72aca52ad3cd342757a0a3ed6377b38b1a4fa7449192f05a690fdef656cf9\": container with ID starting with 9bd72aca52ad3cd342757a0a3ed6377b38b1a4fa7449192f05a690fdef656cf9 not found: ID does not exist" containerID="9bd72aca52ad3cd342757a0a3ed6377b38b1a4fa7449192f05a690fdef656cf9" Jul 30 23:29:48.295631 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:48.295555 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bd72aca52ad3cd342757a0a3ed6377b38b1a4fa7449192f05a690fdef656cf9"} err="failed to get container status \"9bd72aca52ad3cd342757a0a3ed6377b38b1a4fa7449192f05a690fdef656cf9\": rpc error: code = NotFound desc = could not find container \"9bd72aca52ad3cd342757a0a3ed6377b38b1a4fa7449192f05a690fdef656cf9\": container with ID starting with 9bd72aca52ad3cd342757a0a3ed6377b38b1a4fa7449192f05a690fdef656cf9 not found: ID does not exist" Jul 30 23:29:48.295631 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:48.295571 2576 scope.go:117] "RemoveContainer" containerID="05d92f7f94254ad4bd7815f4f332d21d140b3a2985b79e8ebca0a87546e8479f" Jul 30 23:29:48.295814 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:29:48.295796 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05d92f7f94254ad4bd7815f4f332d21d140b3a2985b79e8ebca0a87546e8479f\": container with ID starting with 05d92f7f94254ad4bd7815f4f332d21d140b3a2985b79e8ebca0a87546e8479f not found: ID does not exist" containerID="05d92f7f94254ad4bd7815f4f332d21d140b3a2985b79e8ebca0a87546e8479f" Jul 30 23:29:48.295879 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:48.295820 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d92f7f94254ad4bd7815f4f332d21d140b3a2985b79e8ebca0a87546e8479f"} err="failed to get container status \"05d92f7f94254ad4bd7815f4f332d21d140b3a2985b79e8ebca0a87546e8479f\": rpc error: code = NotFound desc = could not find container \"05d92f7f94254ad4bd7815f4f332d21d140b3a2985b79e8ebca0a87546e8479f\": container with ID starting with 05d92f7f94254ad4bd7815f4f332d21d140b3a2985b79e8ebca0a87546e8479f not found: ID does not exist" Jul 30 23:29:48.299693 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:48.299673 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk"] Jul 30 23:29:48.304573 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:48.304553 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-2f122f-openshift-default-5679d5c648-pcjhk"] Jul 30 23:29:49.236366 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:49.236334 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b152575a-d90d-488f-874b-5472265bde34" path="/var/lib/kubelet/pods/b152575a-d90d-488f-874b-5472265bde34/volumes" Jul 30 23:29:53.266760 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.266717 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg"] Jul 30 23:29:53.267721 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.267655 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" podUID="d130e0f2-0b0c-47d9-96ad-e1e39d20f074" containerName="payload-processing" containerID="cri-o://68fc36d73652bd6a317ad6631e12714dbccbfc1aecb53411c38a0554258603e1" gracePeriod=30 Jul 30 23:29:53.271776 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.271747 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs"] Jul 30 23:29:53.272047 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.271994 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" podUID="1d725d81-a975-4d94-b074-97ce81290e59" containerName="payload-pre-processing" containerID="cri-o://4c3a5712707e71bc13da6ec38a8bcbe31ae3f14ff82187c6d9e698db223b5d73" gracePeriod=30 Jul 30 23:29:53.531488 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.531420 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" Jul 30 23:29:53.562939 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.562912 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" Jul 30 23:29:53.639929 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.639894 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmhcf\" (UniqueName: \"kubernetes.io/projected/1d725d81-a975-4d94-b074-97ce81290e59-kube-api-access-fmhcf\") pod \"1d725d81-a975-4d94-b074-97ce81290e59\" (UID: \"1d725d81-a975-4d94-b074-97ce81290e59\") " Jul 30 23:29:53.639929 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.639935 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvx9c\" (UniqueName: \"kubernetes.io/projected/d130e0f2-0b0c-47d9-96ad-e1e39d20f074-kube-api-access-tvx9c\") pod \"d130e0f2-0b0c-47d9-96ad-e1e39d20f074\" (UID: \"d130e0f2-0b0c-47d9-96ad-e1e39d20f074\") " Jul 30 23:29:53.640174 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.640001 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d130e0f2-0b0c-47d9-96ad-e1e39d20f074-plugins-config-volume\") pod \"d130e0f2-0b0c-47d9-96ad-e1e39d20f074\" (UID: \"d130e0f2-0b0c-47d9-96ad-e1e39d20f074\") " Jul 30 23:29:53.640174 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.640050 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d725d81-a975-4d94-b074-97ce81290e59-plugins-config-volume\") pod \"1d725d81-a975-4d94-b074-97ce81290e59\" (UID: \"1d725d81-a975-4d94-b074-97ce81290e59\") " Jul 30 23:29:53.640435 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.640411 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d130e0f2-0b0c-47d9-96ad-e1e39d20f074-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d130e0f2-0b0c-47d9-96ad-e1e39d20f074" (UID: "d130e0f2-0b0c-47d9-96ad-e1e39d20f074"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:29:53.640507 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.640448 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d725d81-a975-4d94-b074-97ce81290e59-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1d725d81-a975-4d94-b074-97ce81290e59" (UID: "1d725d81-a975-4d94-b074-97ce81290e59"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:29:53.641955 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.641935 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d725d81-a975-4d94-b074-97ce81290e59-kube-api-access-fmhcf" (OuterVolumeSpecName: "kube-api-access-fmhcf") pod "1d725d81-a975-4d94-b074-97ce81290e59" (UID: "1d725d81-a975-4d94-b074-97ce81290e59"). InnerVolumeSpecName "kube-api-access-fmhcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:29:53.642018 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.642005 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d130e0f2-0b0c-47d9-96ad-e1e39d20f074-kube-api-access-tvx9c" (OuterVolumeSpecName: "kube-api-access-tvx9c") pod "d130e0f2-0b0c-47d9-96ad-e1e39d20f074" (UID: "d130e0f2-0b0c-47d9-96ad-e1e39d20f074"). InnerVolumeSpecName "kube-api-access-tvx9c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:29:53.740883 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.740825 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d130e0f2-0b0c-47d9-96ad-e1e39d20f074-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:29:53.740883 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.740851 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d725d81-a975-4d94-b074-97ce81290e59-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:29:53.740883 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.740879 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmhcf\" (UniqueName: \"kubernetes.io/projected/1d725d81-a975-4d94-b074-97ce81290e59-kube-api-access-fmhcf\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:29:53.740883 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:53.740890 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvx9c\" (UniqueName: \"kubernetes.io/projected/d130e0f2-0b0c-47d9-96ad-e1e39d20f074-kube-api-access-tvx9c\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:29:54.312697 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.312664 2576 generic.go:356] "Generic (PLEG): container finished" podID="1d725d81-a975-4d94-b074-97ce81290e59" containerID="4c3a5712707e71bc13da6ec38a8bcbe31ae3f14ff82187c6d9e698db223b5d73" exitCode=0 Jul 30 23:29:54.313144 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.312710 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" Jul 30 23:29:54.313144 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.312765 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" event={"ID":"1d725d81-a975-4d94-b074-97ce81290e59","Type":"ContainerDied","Data":"4c3a5712707e71bc13da6ec38a8bcbe31ae3f14ff82187c6d9e698db223b5d73"} Jul 30 23:29:54.313144 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.312821 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs" event={"ID":"1d725d81-a975-4d94-b074-97ce81290e59","Type":"ContainerDied","Data":"c392dbfde378280b4df7cd1527baef7526eff737a0728144051913acafbe3dbe"} Jul 30 23:29:54.313144 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.312843 2576 scope.go:117] "RemoveContainer" containerID="4c3a5712707e71bc13da6ec38a8bcbe31ae3f14ff82187c6d9e698db223b5d73" Jul 30 23:29:54.314235 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.314164 2576 generic.go:356] "Generic (PLEG): container finished" podID="d130e0f2-0b0c-47d9-96ad-e1e39d20f074" containerID="68fc36d73652bd6a317ad6631e12714dbccbfc1aecb53411c38a0554258603e1" exitCode=0 Jul 30 23:29:54.314235 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.314193 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" event={"ID":"d130e0f2-0b0c-47d9-96ad-e1e39d20f074","Type":"ContainerDied","Data":"68fc36d73652bd6a317ad6631e12714dbccbfc1aecb53411c38a0554258603e1"} Jul 30 23:29:54.314235 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.314219 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" Jul 30 23:29:54.314439 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.314248 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg" event={"ID":"d130e0f2-0b0c-47d9-96ad-e1e39d20f074","Type":"ContainerDied","Data":"5b9fd8ca8c3b359f1fbc51e15f305f8ad3b102f3e67a318c691fe22776a4d1fd"} Jul 30 23:29:54.326807 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.326794 2576 scope.go:117] "RemoveContainer" containerID="4c3a5712707e71bc13da6ec38a8bcbe31ae3f14ff82187c6d9e698db223b5d73" Jul 30 23:29:54.327076 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:29:54.327055 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c3a5712707e71bc13da6ec38a8bcbe31ae3f14ff82187c6d9e698db223b5d73\": container with ID starting with 4c3a5712707e71bc13da6ec38a8bcbe31ae3f14ff82187c6d9e698db223b5d73 not found: ID does not exist" containerID="4c3a5712707e71bc13da6ec38a8bcbe31ae3f14ff82187c6d9e698db223b5d73" Jul 30 23:29:54.327154 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.327087 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c3a5712707e71bc13da6ec38a8bcbe31ae3f14ff82187c6d9e698db223b5d73"} err="failed to get container status \"4c3a5712707e71bc13da6ec38a8bcbe31ae3f14ff82187c6d9e698db223b5d73\": rpc error: code = NotFound desc = could not find container \"4c3a5712707e71bc13da6ec38a8bcbe31ae3f14ff82187c6d9e698db223b5d73\": container with ID starting with 4c3a5712707e71bc13da6ec38a8bcbe31ae3f14ff82187c6d9e698db223b5d73 not found: ID does not exist" Jul 30 23:29:54.327154 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.327111 2576 scope.go:117] "RemoveContainer" containerID="68fc36d73652bd6a317ad6631e12714dbccbfc1aecb53411c38a0554258603e1" Jul 30 23:29:54.335012 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.334994 2576 scope.go:117] "RemoveContainer" containerID="68fc36d73652bd6a317ad6631e12714dbccbfc1aecb53411c38a0554258603e1" Jul 30 23:29:54.335253 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:29:54.335236 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68fc36d73652bd6a317ad6631e12714dbccbfc1aecb53411c38a0554258603e1\": container with ID starting with 68fc36d73652bd6a317ad6631e12714dbccbfc1aecb53411c38a0554258603e1 not found: ID does not exist" containerID="68fc36d73652bd6a317ad6631e12714dbccbfc1aecb53411c38a0554258603e1" Jul 30 23:29:54.335303 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.335261 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68fc36d73652bd6a317ad6631e12714dbccbfc1aecb53411c38a0554258603e1"} err="failed to get container status \"68fc36d73652bd6a317ad6631e12714dbccbfc1aecb53411c38a0554258603e1\": rpc error: code = NotFound desc = could not find container \"68fc36d73652bd6a317ad6631e12714dbccbfc1aecb53411c38a0554258603e1\": container with ID starting with 68fc36d73652bd6a317ad6631e12714dbccbfc1aecb53411c38a0554258603e1 not found: ID does not exist" Jul 30 23:29:54.340271 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.340250 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg"] Jul 30 23:29:54.343835 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.343804 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-fcdf3e-d964fb8c4-dz7dg"] Jul 30 23:29:54.355532 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.355512 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs"] Jul 30 23:29:54.359820 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:54.359801 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-fcdf3e-7f85874756-x5qcs"] Jul 30 23:29:55.235609 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:55.235572 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d725d81-a975-4d94-b074-97ce81290e59" path="/var/lib/kubelet/pods/1d725d81-a975-4d94-b074-97ce81290e59/volumes" Jul 30 23:29:55.235959 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:29:55.235945 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d130e0f2-0b0c-47d9-96ad-e1e39d20f074" path="/var/lib/kubelet/pods/d130e0f2-0b0c-47d9-96ad-e1e39d20f074/volumes" Jul 30 23:30:00.024204 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.024163 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp"] Jul 30 23:30:00.024671 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.024431 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" podUID="c6f8fc59-12b8-440a-828f-ef53bb763feb" containerName="istio-proxy" containerID="cri-o://07047206f295ba68571eb4c693f8dc98fac79c9db91407b835f3975012c29b87" gracePeriod=30 Jul 30 23:30:00.143730 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.143696 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757570-hjdpq"] Jul 30 23:30:00.144062 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144048 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b152575a-d90d-488f-874b-5472265bde34" containerName="istio-proxy" Jul 30 23:30:00.144117 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144063 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b152575a-d90d-488f-874b-5472265bde34" containerName="istio-proxy" Jul 30 23:30:00.144117 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144072 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d130e0f2-0b0c-47d9-96ad-e1e39d20f074" containerName="payload-processing" Jul 30 23:30:00.144117 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144077 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d130e0f2-0b0c-47d9-96ad-e1e39d20f074" containerName="payload-processing" Jul 30 23:30:00.144117 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144086 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7312d896-d388-4bfe-a36d-311609d3f7ad" containerName="payload-processing" Jul 30 23:30:00.144117 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144093 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7312d896-d388-4bfe-a36d-311609d3f7ad" containerName="payload-processing" Jul 30 23:30:00.144117 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144099 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d725d81-a975-4d94-b074-97ce81290e59" containerName="payload-pre-processing" Jul 30 23:30:00.144117 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144104 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d725d81-a975-4d94-b074-97ce81290e59" containerName="payload-pre-processing" Jul 30 23:30:00.144117 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144116 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d258dee-6329-4e1c-aa5c-a0338a560cf6" containerName="payload-pre-processing" Jul 30 23:30:00.144359 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144122 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d258dee-6329-4e1c-aa5c-a0338a560cf6" containerName="payload-pre-processing" Jul 30 23:30:00.144359 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144131 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b152575a-d90d-488f-874b-5472265bde34" containerName="istio-proxy" Jul 30 23:30:00.144359 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144136 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b152575a-d90d-488f-874b-5472265bde34" containerName="istio-proxy" Jul 30 23:30:00.144359 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144195 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d258dee-6329-4e1c-aa5c-a0338a560cf6" containerName="payload-pre-processing" Jul 30 23:30:00.144359 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144202 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d130e0f2-0b0c-47d9-96ad-e1e39d20f074" containerName="payload-processing" Jul 30 23:30:00.144359 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144209 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b152575a-d90d-488f-874b-5472265bde34" containerName="istio-proxy" Jul 30 23:30:00.144359 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144213 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7312d896-d388-4bfe-a36d-311609d3f7ad" containerName="payload-processing" Jul 30 23:30:00.144359 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144219 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b152575a-d90d-488f-874b-5472265bde34" containerName="istio-proxy" Jul 30 23:30:00.144359 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.144226 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d725d81-a975-4d94-b074-97ce81290e59" containerName="payload-pre-processing" Jul 30 23:30:00.145972 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.145957 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757570-hjdpq" Jul 30 23:30:00.149280 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.149259 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52wcc\"" Jul 30 23:30:00.155044 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.155018 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757570-hjdpq"] Jul 30 23:30:00.156768 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.156750 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757570-hjdpq" Jul 30 23:30:00.286338 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.286313 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757570-hjdpq"] Jul 30 23:30:00.288706 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:30:00.288665 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda513fb38_7fb5_4795_a6b1_4fab9317489f.slice/crio-1baf109e4a837bd01694d13ca6980dd8bcdccec1a6abe55aedc633768b817554 WatchSource:0}: Error finding container 1baf109e4a837bd01694d13ca6980dd8bcdccec1a6abe55aedc633768b817554: Status 404 returned error can't find the container with id 1baf109e4a837bd01694d13ca6980dd8bcdccec1a6abe55aedc633768b817554 Jul 30 23:30:00.347005 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.346981 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757570-hjdpq" event={"ID":"a513fb38-7fb5-4795-a6b1-4fab9317489f","Type":"ContainerStarted","Data":"1baf109e4a837bd01694d13ca6980dd8bcdccec1a6abe55aedc633768b817554"} Jul 30 23:30:00.887331 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.887293 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n"] Jul 30 23:30:00.889568 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.889552 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:00.892170 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.892147 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-0ff11c-openshift-default-dockercfg-gjn8d\"" Jul 30 23:30:00.903685 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:00.903660 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n"] Jul 30 23:30:01.000916 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.000878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrsgd\" (UniqueName: \"kubernetes.io/projected/d1ac8449-b909-4e0f-b369-f86122d71548-kube-api-access-hrsgd\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.001092 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.000930 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-istio-data\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.001092 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.000959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-workload-certs\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.001092 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.000982 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-credential-socket\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.001092 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.001012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1ac8449-b909-4e0f-b369-f86122d71548-istio-podinfo\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.001092 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.001081 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-workload-socket\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.001325 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.001125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1ac8449-b909-4e0f-b369-f86122d71548-istio-token\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.001325 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.001201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1ac8449-b909-4e0f-b369-f86122d71548-istiod-ca-cert\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.001325 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.001243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-istio-envoy\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.102306 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.102266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-istio-envoy\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.102306 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.102317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrsgd\" (UniqueName: \"kubernetes.io/projected/d1ac8449-b909-4e0f-b369-f86122d71548-kube-api-access-hrsgd\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.102924 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.102436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-istio-data\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.102924 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.102471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-workload-certs\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.102924 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.102493 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-credential-socket\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.102924 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.102518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1ac8449-b909-4e0f-b369-f86122d71548-istio-podinfo\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.102924 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.102589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-workload-socket\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.102924 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.102658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1ac8449-b909-4e0f-b369-f86122d71548-istio-token\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.102924 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.102730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1ac8449-b909-4e0f-b369-f86122d71548-istiod-ca-cert\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.102924 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.102897 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-istio-data\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.103380 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.102937 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-credential-socket\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.103380 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.102953 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-workload-certs\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.103380 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.103014 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-workload-socket\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.103546 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.103385 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1ac8449-b909-4e0f-b369-f86122d71548-istiod-ca-cert\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.104838 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.104807 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-istio-envoy\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.105092 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.105072 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1ac8449-b909-4e0f-b369-f86122d71548-istio-podinfo\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.110275 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.110251 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1ac8449-b909-4e0f-b369-f86122d71548-istio-token\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.110404 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.110311 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrsgd\" (UniqueName: \"kubernetes.io/projected/d1ac8449-b909-4e0f-b369-f86122d71548-kube-api-access-hrsgd\") pod \"e2e-api-a-0ff11c-openshift-default-845855784b-nn26n\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.199374 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.199344 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:01.354528 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.354490 2576 generic.go:356] "Generic (PLEG): container finished" podID="a513fb38-7fb5-4795-a6b1-4fab9317489f" containerID="f0c05995d3f2aabdc002544faa5634955f4e9aadbedc908d31de76e316c1b2cb" exitCode=0 Jul 30 23:30:01.354692 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.354576 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757570-hjdpq" event={"ID":"a513fb38-7fb5-4795-a6b1-4fab9317489f","Type":"ContainerDied","Data":"f0c05995d3f2aabdc002544faa5634955f4e9aadbedc908d31de76e316c1b2cb"} Jul 30 23:30:01.359584 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.359565 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n"] Jul 30 23:30:01.361364 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:30:01.361329 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ac8449_b909_4e0f_b369_f86122d71548.slice/crio-94815c8bd3b0868ef92c11ccdfbb8d168b3fd4c4b99fb5cd5d671d06761a8c08 WatchSource:0}: Error finding container 94815c8bd3b0868ef92c11ccdfbb8d168b3fd4c4b99fb5cd5d671d06761a8c08: Status 404 returned error can't find the container with id 94815c8bd3b0868ef92c11ccdfbb8d168b3fd4c4b99fb5cd5d671d06761a8c08 Jul 30 23:30:01.363559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.363527 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:30:01.363647 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.363615 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:30:01.363688 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:01.363659 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:30:02.361385 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:02.361346 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" event={"ID":"d1ac8449-b909-4e0f-b369-f86122d71548","Type":"ContainerStarted","Data":"63b0850b03e00f3aaa7d6a97952ed89d6a188b72eb6cbfdf242dca54a449f81d"} Jul 30 23:30:02.361769 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:02.361408 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" event={"ID":"d1ac8449-b909-4e0f-b369-f86122d71548","Type":"ContainerStarted","Data":"94815c8bd3b0868ef92c11ccdfbb8d168b3fd4c4b99fb5cd5d671d06761a8c08"} Jul 30 23:30:02.382638 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:02.382586 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" podStartSLOduration=2.382570854 podStartE2EDuration="2.382570854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:30:02.380976595 +0000 UTC m=+2529.584795835" watchObservedRunningTime="2026-07-30 23:30:02.382570854 +0000 UTC m=+2529.586390088" Jul 30 23:30:02.498455 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:02.498332 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757570-hjdpq" Jul 30 23:30:03.199891 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:03.199847 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:03.204776 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:03.204752 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:03.367361 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:03.367336 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757570-hjdpq" Jul 30 23:30:03.367361 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:03.367348 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757570-hjdpq" event={"ID":"a513fb38-7fb5-4795-a6b1-4fab9317489f","Type":"ContainerDied","Data":"1baf109e4a837bd01694d13ca6980dd8bcdccec1a6abe55aedc633768b817554"} Jul 30 23:30:03.367780 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:03.367401 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1baf109e4a837bd01694d13ca6980dd8bcdccec1a6abe55aedc633768b817554" Jul 30 23:30:03.367780 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:03.367729 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:03.368760 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:03.368741 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:05.270267 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.270243 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:30:05.337692 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.337616 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcn57\" (UniqueName: \"kubernetes.io/projected/c6f8fc59-12b8-440a-828f-ef53bb763feb-kube-api-access-xcn57\") pod \"c6f8fc59-12b8-440a-828f-ef53bb763feb\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " Jul 30 23:30:05.337692 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.337664 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-workload-socket\") pod \"c6f8fc59-12b8-440a-828f-ef53bb763feb\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " Jul 30 23:30:05.337946 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.337702 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-podinfo\") pod \"c6f8fc59-12b8-440a-828f-ef53bb763feb\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " Jul 30 23:30:05.337946 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.337818 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-data\") pod \"c6f8fc59-12b8-440a-828f-ef53bb763feb\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " Jul 30 23:30:05.337946 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.337886 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-workload-certs\") pod \"c6f8fc59-12b8-440a-828f-ef53bb763feb\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " Jul 30 23:30:05.337946 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.337929 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-envoy\") pod \"c6f8fc59-12b8-440a-828f-ef53bb763feb\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " Jul 30 23:30:05.338156 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.337988 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-token\") pod \"c6f8fc59-12b8-440a-828f-ef53bb763feb\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " Jul 30 23:30:05.338156 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.338037 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6f8fc59-12b8-440a-828f-ef53bb763feb-istiod-ca-cert\") pod \"c6f8fc59-12b8-440a-828f-ef53bb763feb\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " Jul 30 23:30:05.338156 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.338038 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c6f8fc59-12b8-440a-828f-ef53bb763feb" (UID: "c6f8fc59-12b8-440a-828f-ef53bb763feb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:30:05.338156 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.338059 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-data" (OuterVolumeSpecName: "istio-data") pod "c6f8fc59-12b8-440a-828f-ef53bb763feb" (UID: "c6f8fc59-12b8-440a-828f-ef53bb763feb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:30:05.338366 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.338170 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c6f8fc59-12b8-440a-828f-ef53bb763feb" (UID: "c6f8fc59-12b8-440a-828f-ef53bb763feb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:30:05.338366 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.338184 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-credential-socket\") pod \"c6f8fc59-12b8-440a-828f-ef53bb763feb\" (UID: \"c6f8fc59-12b8-440a-828f-ef53bb763feb\") " Jul 30 23:30:05.338516 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.338424 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6f8fc59-12b8-440a-828f-ef53bb763feb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c6f8fc59-12b8-440a-828f-ef53bb763feb" (UID: "c6f8fc59-12b8-440a-828f-ef53bb763feb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:30:05.338516 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.338475 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c6f8fc59-12b8-440a-828f-ef53bb763feb" (UID: "c6f8fc59-12b8-440a-828f-ef53bb763feb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:30:05.338592 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.338537 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:30:05.338592 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.338556 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:30:05.338592 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.338570 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:30:05.338592 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.338584 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6f8fc59-12b8-440a-828f-ef53bb763feb-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:30:05.339999 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.339977 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6f8fc59-12b8-440a-828f-ef53bb763feb-kube-api-access-xcn57" (OuterVolumeSpecName: "kube-api-access-xcn57") pod "c6f8fc59-12b8-440a-828f-ef53bb763feb" (UID: "c6f8fc59-12b8-440a-828f-ef53bb763feb"). InnerVolumeSpecName "kube-api-access-xcn57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:30:05.339999 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.339993 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c6f8fc59-12b8-440a-828f-ef53bb763feb" (UID: "c6f8fc59-12b8-440a-828f-ef53bb763feb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:30:05.340274 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.340257 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c6f8fc59-12b8-440a-828f-ef53bb763feb" (UID: "c6f8fc59-12b8-440a-828f-ef53bb763feb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 23:30:05.340332 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.340284 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-token" (OuterVolumeSpecName: "istio-token") pod "c6f8fc59-12b8-440a-828f-ef53bb763feb" (UID: "c6f8fc59-12b8-440a-828f-ef53bb763feb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:30:05.382237 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.382198 2576 generic.go:356] "Generic (PLEG): container finished" podID="c6f8fc59-12b8-440a-828f-ef53bb763feb" containerID="07047206f295ba68571eb4c693f8dc98fac79c9db91407b835f3975012c29b87" exitCode=0 Jul 30 23:30:05.382387 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.382241 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" Jul 30 23:30:05.382387 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.382284 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" event={"ID":"c6f8fc59-12b8-440a-828f-ef53bb763feb","Type":"ContainerDied","Data":"07047206f295ba68571eb4c693f8dc98fac79c9db91407b835f3975012c29b87"} Jul 30 23:30:05.382387 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.382351 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp" event={"ID":"c6f8fc59-12b8-440a-828f-ef53bb763feb","Type":"ContainerDied","Data":"8fd9320d0cb559ca5350f59d763a5cabbf6862f19ee76ed76aca0cd971e05f67"} Jul 30 23:30:05.382387 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.382384 2576 scope.go:117] "RemoveContainer" containerID="07047206f295ba68571eb4c693f8dc98fac79c9db91407b835f3975012c29b87" Jul 30 23:30:05.393002 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.392984 2576 scope.go:117] "RemoveContainer" containerID="955ae8e38eb392cf265af4c0a07f366b89ae321e1da7f24ea755e4fe79c84f71" Jul 30 23:30:05.401144 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.401123 2576 scope.go:117] "RemoveContainer" containerID="07047206f295ba68571eb4c693f8dc98fac79c9db91407b835f3975012c29b87" Jul 30 23:30:05.401396 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:30:05.401373 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07047206f295ba68571eb4c693f8dc98fac79c9db91407b835f3975012c29b87\": container with ID starting with 07047206f295ba68571eb4c693f8dc98fac79c9db91407b835f3975012c29b87 not found: ID does not exist" containerID="07047206f295ba68571eb4c693f8dc98fac79c9db91407b835f3975012c29b87" Jul 30 23:30:05.401442 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.401410 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07047206f295ba68571eb4c693f8dc98fac79c9db91407b835f3975012c29b87"} err="failed to get container status \"07047206f295ba68571eb4c693f8dc98fac79c9db91407b835f3975012c29b87\": rpc error: code = NotFound desc = could not find container \"07047206f295ba68571eb4c693f8dc98fac79c9db91407b835f3975012c29b87\": container with ID starting with 07047206f295ba68571eb4c693f8dc98fac79c9db91407b835f3975012c29b87 not found: ID does not exist" Jul 30 23:30:05.401442 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.401433 2576 scope.go:117] "RemoveContainer" containerID="955ae8e38eb392cf265af4c0a07f366b89ae321e1da7f24ea755e4fe79c84f71" Jul 30 23:30:05.401674 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:30:05.401658 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"955ae8e38eb392cf265af4c0a07f366b89ae321e1da7f24ea755e4fe79c84f71\": container with ID starting with 955ae8e38eb392cf265af4c0a07f366b89ae321e1da7f24ea755e4fe79c84f71 not found: ID does not exist" containerID="955ae8e38eb392cf265af4c0a07f366b89ae321e1da7f24ea755e4fe79c84f71" Jul 30 23:30:05.401717 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.401682 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"955ae8e38eb392cf265af4c0a07f366b89ae321e1da7f24ea755e4fe79c84f71"} err="failed to get container status \"955ae8e38eb392cf265af4c0a07f366b89ae321e1da7f24ea755e4fe79c84f71\": rpc error: code = NotFound desc = could not find container \"955ae8e38eb392cf265af4c0a07f366b89ae321e1da7f24ea755e4fe79c84f71\": container with ID starting with 955ae8e38eb392cf265af4c0a07f366b89ae321e1da7f24ea755e4fe79c84f71 not found: ID does not exist" Jul 30 23:30:05.409848 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.409826 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp"] Jul 30 23:30:05.412068 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.412048 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-fcdf3e-openshift-default-7455fb45db-tb7zp"] Jul 30 23:30:05.440158 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.440125 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:30:05.440158 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.440152 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcn57\" (UniqueName: \"kubernetes.io/projected/c6f8fc59-12b8-440a-828f-ef53bb763feb-kube-api-access-xcn57\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:30:05.440158 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.440163 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:30:05.440158 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.440172 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:30:05.440158 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:05.440180 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6f8fc59-12b8-440a-828f-ef53bb763feb-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:30:06.047636 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.047600 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs"] Jul 30 23:30:06.047944 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.047932 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a513fb38-7fb5-4795-a6b1-4fab9317489f" containerName="cleanup" Jul 30 23:30:06.048003 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.047945 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a513fb38-7fb5-4795-a6b1-4fab9317489f" containerName="cleanup" Jul 30 23:30:06.048003 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.047966 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6f8fc59-12b8-440a-828f-ef53bb763feb" containerName="istio-proxy" Jul 30 23:30:06.048003 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.047972 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6f8fc59-12b8-440a-828f-ef53bb763feb" containerName="istio-proxy" Jul 30 23:30:06.048003 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.047979 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6f8fc59-12b8-440a-828f-ef53bb763feb" containerName="istio-proxy" Jul 30 23:30:06.048003 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.047985 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6f8fc59-12b8-440a-828f-ef53bb763feb" containerName="istio-proxy" Jul 30 23:30:06.048150 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.048035 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6f8fc59-12b8-440a-828f-ef53bb763feb" containerName="istio-proxy" Jul 30 23:30:06.048150 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.048045 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a513fb38-7fb5-4795-a6b1-4fab9317489f" containerName="cleanup" Jul 30 23:30:06.050649 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.050632 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" Jul 30 23:30:06.053245 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.053219 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-0ff11c\"" Jul 30 23:30:06.053372 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.053248 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-0ff11c-dockercfg-pb5l5\"" Jul 30 23:30:06.062420 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.062399 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs"] Jul 30 23:30:06.090999 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.090961 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj"] Jul 30 23:30:06.092450 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.092257 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6f8fc59-12b8-440a-828f-ef53bb763feb" containerName="istio-proxy" Jul 30 23:30:06.094644 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.094626 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj"] Jul 30 23:30:06.094764 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.094727 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" Jul 30 23:30:06.148051 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.148012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs\" (UID: \"111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf\") " pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" Jul 30 23:30:06.148237 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.148086 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a3e36ff-53aa-40dd-94ad-b323ca6939cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj\" (UID: \"8a3e36ff-53aa-40dd-94ad-b323ca6939cb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" Jul 30 23:30:06.148237 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.148194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx65k\" (UniqueName: \"kubernetes.io/projected/8a3e36ff-53aa-40dd-94ad-b323ca6939cb-kube-api-access-zx65k\") pod \"payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj\" (UID: \"8a3e36ff-53aa-40dd-94ad-b323ca6939cb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" Jul 30 23:30:06.148359 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.148266 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4psx\" (UniqueName: \"kubernetes.io/projected/111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf-kube-api-access-n4psx\") pod \"payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs\" (UID: \"111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf\") " pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" Jul 30 23:30:06.248731 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.248689 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4psx\" (UniqueName: \"kubernetes.io/projected/111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf-kube-api-access-n4psx\") pod \"payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs\" (UID: \"111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf\") " pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" Jul 30 23:30:06.248948 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.248745 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs\" (UID: \"111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf\") " pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" Jul 30 23:30:06.248948 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.248798 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a3e36ff-53aa-40dd-94ad-b323ca6939cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj\" (UID: \"8a3e36ff-53aa-40dd-94ad-b323ca6939cb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" Jul 30 23:30:06.248948 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.248817 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx65k\" (UniqueName: \"kubernetes.io/projected/8a3e36ff-53aa-40dd-94ad-b323ca6939cb-kube-api-access-zx65k\") pod \"payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj\" (UID: \"8a3e36ff-53aa-40dd-94ad-b323ca6939cb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" Jul 30 23:30:06.249522 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.249500 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a3e36ff-53aa-40dd-94ad-b323ca6939cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj\" (UID: \"8a3e36ff-53aa-40dd-94ad-b323ca6939cb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" Jul 30 23:30:06.249575 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.249503 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs\" (UID: \"111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf\") " pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" Jul 30 23:30:06.257008 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.256982 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4psx\" (UniqueName: \"kubernetes.io/projected/111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf-kube-api-access-n4psx\") pod \"payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs\" (UID: \"111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf\") " pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" Jul 30 23:30:06.257107 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.257029 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx65k\" (UniqueName: \"kubernetes.io/projected/8a3e36ff-53aa-40dd-94ad-b323ca6939cb-kube-api-access-zx65k\") pod \"payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj\" (UID: \"8a3e36ff-53aa-40dd-94ad-b323ca6939cb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" Jul 30 23:30:06.361374 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.361278 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" Jul 30 23:30:06.405809 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.405773 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" Jul 30 23:30:06.510519 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.510309 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs"] Jul 30 23:30:06.511747 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:30:06.511706 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111bb5c4_8ed1_46ed_b4ea_7b75ba6b6eaf.slice/crio-4008d6b9fe21ac3e89bdf4d3ef9298258a2aaf91b91236d4b14267742dfe79e6 WatchSource:0}: Error finding container 4008d6b9fe21ac3e89bdf4d3ef9298258a2aaf91b91236d4b14267742dfe79e6: Status 404 returned error can't find the container with id 4008d6b9fe21ac3e89bdf4d3ef9298258a2aaf91b91236d4b14267742dfe79e6 Jul 30 23:30:06.554445 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:06.554419 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj"] Jul 30 23:30:06.558915 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:30:06.558887 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3e36ff_53aa_40dd_94ad_b323ca6939cb.slice/crio-0a9970ae9ee2d19b067b5374b09f43fdc2d581a584e992069c68d37d49f3e21d WatchSource:0}: Error finding container 0a9970ae9ee2d19b067b5374b09f43fdc2d581a584e992069c68d37d49f3e21d: Status 404 returned error can't find the container with id 0a9970ae9ee2d19b067b5374b09f43fdc2d581a584e992069c68d37d49f3e21d Jul 30 23:30:07.239482 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:07.239442 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6f8fc59-12b8-440a-828f-ef53bb763feb" path="/var/lib/kubelet/pods/c6f8fc59-12b8-440a-828f-ef53bb763feb/volumes" Jul 30 23:30:07.396529 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:07.396496 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" event={"ID":"8a3e36ff-53aa-40dd-94ad-b323ca6939cb","Type":"ContainerStarted","Data":"8488353c9bb662971c28dd67d951f8b0e50c1b7fc6e99de2c24cd57a1471deee"} Jul 30 23:30:07.396983 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:07.396553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" event={"ID":"8a3e36ff-53aa-40dd-94ad-b323ca6939cb","Type":"ContainerStarted","Data":"0a9970ae9ee2d19b067b5374b09f43fdc2d581a584e992069c68d37d49f3e21d"} Jul 30 23:30:07.396983 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:07.396577 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" Jul 30 23:30:07.398145 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:07.398120 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" event={"ID":"111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf","Type":"ContainerStarted","Data":"a103b2d32dd7c13b5b4c50e27101ace1440e4051746f81a82218bbfe43846e3f"} Jul 30 23:30:07.398278 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:07.398171 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" event={"ID":"111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf","Type":"ContainerStarted","Data":"4008d6b9fe21ac3e89bdf4d3ef9298258a2aaf91b91236d4b14267742dfe79e6"} Jul 30 23:30:07.398278 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:07.398200 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" Jul 30 23:30:07.412273 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:07.412232 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" podStartSLOduration=1.412215345 podStartE2EDuration="1.412215345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:30:07.411456234 +0000 UTC m=+2534.615275469" watchObservedRunningTime="2026-07-30 23:30:07.412215345 +0000 UTC m=+2534.616034557" Jul 30 23:30:07.429430 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:07.429382 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" podStartSLOduration=1.429366706 podStartE2EDuration="1.429366706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:30:07.428330793 +0000 UTC m=+2534.632150028" watchObservedRunningTime="2026-07-30 23:30:07.429366706 +0000 UTC m=+2534.633185939" Jul 30 23:30:18.369762 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:18.369728 2576 patch_prober.go:28] interesting pod/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body= Jul 30 23:30:18.370270 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:18.369797 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" podUID="d1ac8449-b909-4e0f-b369-f86122d71548" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" Jul 30 23:30:18.405520 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:18.405495 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" Jul 30 23:30:18.405697 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:18.405580 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" Jul 30 23:30:18.469428 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:18.469397 2576 generic.go:356] "Generic (PLEG): container finished" podID="d1ac8449-b909-4e0f-b369-f86122d71548" containerID="63b0850b03e00f3aaa7d6a97952ed89d6a188b72eb6cbfdf242dca54a449f81d" exitCode=0 Jul 30 23:30:18.469593 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:18.469436 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" event={"ID":"d1ac8449-b909-4e0f-b369-f86122d71548","Type":"ContainerDied","Data":"63b0850b03e00f3aaa7d6a97952ed89d6a188b72eb6cbfdf242dca54a449f81d"} Jul 30 23:30:18.469851 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:18.469825 2576 scope.go:117] "RemoveContainer" containerID="63b0850b03e00f3aaa7d6a97952ed89d6a188b72eb6cbfdf242dca54a449f81d" Jul 30 23:30:18.470961 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:18.470933 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:30:18.471030 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:18.471011 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:30:18.471071 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:18.471056 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:30:19.477044 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:19.477008 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" event={"ID":"d1ac8449-b909-4e0f-b369-f86122d71548","Type":"ContainerStarted","Data":"7e6f43b54d55004ff8cca8b9ce0ef0004d56518a121151d2f89d98ef93679138"} Jul 30 23:30:20.199745 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:20.199702 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:20.199997 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:20.199966 2576 patch_prober.go:28] interesting pod/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body= Jul 30 23:30:20.200087 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:20.200024 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" podUID="d1ac8449-b909-4e0f-b369-f86122d71548" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" Jul 30 23:30:21.200623 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:21.200585 2576 patch_prober.go:28] interesting pod/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body= Jul 30 23:30:21.201057 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:21.200640 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" podUID="d1ac8449-b909-4e0f-b369-f86122d71548" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" Jul 30 23:30:22.200257 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:22.200219 2576 patch_prober.go:28] interesting pod/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body= Jul 30 23:30:22.200432 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:22.200283 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" podUID="d1ac8449-b909-4e0f-b369-f86122d71548" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" Jul 30 23:30:23.200531 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:23.200491 2576 patch_prober.go:28] interesting pod/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body= Jul 30 23:30:23.200959 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:23.200562 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" podUID="d1ac8449-b909-4e0f-b369-f86122d71548" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" Jul 30 23:30:24.200055 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:24.200016 2576 patch_prober.go:28] interesting pod/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body= Jul 30 23:30:24.200213 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:24.200070 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" podUID="d1ac8449-b909-4e0f-b369-f86122d71548" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" Jul 30 23:30:25.203573 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:25.203535 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:25.204077 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:25.204058 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:25.204582 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:25.204561 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:30:30.058831 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.058776 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg"] Jul 30 23:30:30.062363 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.062341 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.065438 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.065418 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-13c529-openshift-default-dockercfg-lq9c7\"" Jul 30 23:30:30.076246 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.076220 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg"] Jul 30 23:30:30.182190 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.182160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-data\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.182389 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.182197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-podinfo\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.182389 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.182233 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-workload-certs\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.182389 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.182253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-envoy\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.182389 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.182325 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-workload-socket\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.182389 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.182372 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-credential-socket\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.182650 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.182416 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-token\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.182650 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.182455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk5r8\" (UniqueName: \"kubernetes.io/projected/c0f095f6-e7cb-4980-a5b0-663efdf68f14-kube-api-access-vk5r8\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.182650 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.182486 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istiod-ca-cert\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.283417 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.283375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-data\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.283417 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.283418 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-podinfo\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.283672 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.283461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-workload-certs\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.283672 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.283484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-envoy\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.283672 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.283521 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-workload-socket\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.283672 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.283548 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-credential-socket\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.283672 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.283579 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-token\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.283672 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.283613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk5r8\" (UniqueName: \"kubernetes.io/projected/c0f095f6-e7cb-4980-a5b0-663efdf68f14-kube-api-access-vk5r8\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.283672 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.283643 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istiod-ca-cert\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.284102 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.284000 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-credential-socket\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.284102 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.284022 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-workload-socket\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.284102 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.284085 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-data\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.284236 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.284196 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-workload-certs\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.284422 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.284404 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istiod-ca-cert\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.285870 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.285825 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-envoy\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.285979 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.285939 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-podinfo\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.291303 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.291281 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-token\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.291590 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.291572 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk5r8\" (UniqueName: \"kubernetes.io/projected/c0f095f6-e7cb-4980-a5b0-663efdf68f14-kube-api-access-vk5r8\") pod \"e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.373220 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.373192 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:30.517822 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.517795 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg"] Jul 30 23:30:30.519993 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:30:30.519964 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0f095f6_e7cb_4980_a5b0_663efdf68f14.slice/crio-6a02fb5f50e3ded96fd064e4c6420b1e0688181a42b6c8d06b9217bef5c1c2cb WatchSource:0}: Error finding container 6a02fb5f50e3ded96fd064e4c6420b1e0688181a42b6c8d06b9217bef5c1c2cb: Status 404 returned error can't find the container with id 6a02fb5f50e3ded96fd064e4c6420b1e0688181a42b6c8d06b9217bef5c1c2cb Jul 30 23:30:30.522179 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.522147 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:30:30.522265 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.522210 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:30:30.522265 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.522241 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:30:30.537112 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:30.537083 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" event={"ID":"c0f095f6-e7cb-4980-a5b0-663efdf68f14","Type":"ContainerStarted","Data":"6a02fb5f50e3ded96fd064e4c6420b1e0688181a42b6c8d06b9217bef5c1c2cb"} Jul 30 23:30:31.544477 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:31.544439 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" event={"ID":"c0f095f6-e7cb-4980-a5b0-663efdf68f14","Type":"ContainerStarted","Data":"d316324f884c6296eef9111ce4aa42334125d2c4cd43df24de3c0a7d5a8a1993"} Jul 30 23:30:31.566347 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:31.566299 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" podStartSLOduration=1.566281741 podStartE2EDuration="1.566281741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:30:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:30:31.564741742 +0000 UTC m=+2558.768560976" watchObservedRunningTime="2026-07-30 23:30:31.566281741 +0000 UTC m=+2558.770100976" Jul 30 23:30:32.374378 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:32.374343 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:32.379149 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:32.379127 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:32.550105 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:32.550074 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:32.550949 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:32.550930 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:35.287115 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.287083 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k"] Jul 30 23:30:35.290636 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.290621 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" Jul 30 23:30:35.293155 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.293131 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-13c529\"" Jul 30 23:30:35.293328 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.293236 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-13c529-dockercfg-skx8f\"" Jul 30 23:30:35.302902 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.302877 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k"] Jul 30 23:30:35.314278 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.314255 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm"] Jul 30 23:30:35.317608 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.317586 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" Jul 30 23:30:35.336027 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.336004 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm"] Jul 30 23:30:35.338630 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.338605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/230ba98c-cfa1-470e-9721-6f1f65cfdea5-plugins-config-volume\") pod \"payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm\" (UID: \"230ba98c-cfa1-470e-9721-6f1f65cfdea5\") " pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" Jul 30 23:30:35.338735 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.338662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa2282b2-e116-42bd-9021-36f347dfd381-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k\" (UID: \"aa2282b2-e116-42bd-9021-36f347dfd381\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" Jul 30 23:30:35.338735 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.338694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpbn8\" (UniqueName: \"kubernetes.io/projected/aa2282b2-e116-42bd-9021-36f347dfd381-kube-api-access-bpbn8\") pod \"payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k\" (UID: \"aa2282b2-e116-42bd-9021-36f347dfd381\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" Jul 30 23:30:35.338820 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.338759 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrq7l\" (UniqueName: \"kubernetes.io/projected/230ba98c-cfa1-470e-9721-6f1f65cfdea5-kube-api-access-nrq7l\") pod \"payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm\" (UID: \"230ba98c-cfa1-470e-9721-6f1f65cfdea5\") " pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" Jul 30 23:30:35.439220 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.439190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa2282b2-e116-42bd-9021-36f347dfd381-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k\" (UID: \"aa2282b2-e116-42bd-9021-36f347dfd381\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" Jul 30 23:30:35.439409 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.439236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpbn8\" (UniqueName: \"kubernetes.io/projected/aa2282b2-e116-42bd-9021-36f347dfd381-kube-api-access-bpbn8\") pod \"payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k\" (UID: \"aa2282b2-e116-42bd-9021-36f347dfd381\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" Jul 30 23:30:35.439409 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.439286 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrq7l\" (UniqueName: \"kubernetes.io/projected/230ba98c-cfa1-470e-9721-6f1f65cfdea5-kube-api-access-nrq7l\") pod \"payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm\" (UID: \"230ba98c-cfa1-470e-9721-6f1f65cfdea5\") " pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" Jul 30 23:30:35.439409 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.439321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/230ba98c-cfa1-470e-9721-6f1f65cfdea5-plugins-config-volume\") pod \"payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm\" (UID: \"230ba98c-cfa1-470e-9721-6f1f65cfdea5\") " pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" Jul 30 23:30:35.439930 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.439906 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa2282b2-e116-42bd-9021-36f347dfd381-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k\" (UID: \"aa2282b2-e116-42bd-9021-36f347dfd381\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" Jul 30 23:30:35.440036 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.440019 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/230ba98c-cfa1-470e-9721-6f1f65cfdea5-plugins-config-volume\") pod \"payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm\" (UID: \"230ba98c-cfa1-470e-9721-6f1f65cfdea5\") " pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" Jul 30 23:30:35.447776 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.447754 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpbn8\" (UniqueName: \"kubernetes.io/projected/aa2282b2-e116-42bd-9021-36f347dfd381-kube-api-access-bpbn8\") pod \"payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k\" (UID: \"aa2282b2-e116-42bd-9021-36f347dfd381\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" Jul 30 23:30:35.447937 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.447921 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrq7l\" (UniqueName: \"kubernetes.io/projected/230ba98c-cfa1-470e-9721-6f1f65cfdea5-kube-api-access-nrq7l\") pod \"payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm\" (UID: \"230ba98c-cfa1-470e-9721-6f1f65cfdea5\") " pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" Jul 30 23:30:35.604244 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.604163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" Jul 30 23:30:35.630985 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.630954 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" Jul 30 23:30:35.953638 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.953603 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k"] Jul 30 23:30:35.956646 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:30:35.956617 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa2282b2_e116_42bd_9021_36f347dfd381.slice/crio-78a3c9a0dff7c9c642454b5cba9aed66e51ddd7290be3b8bdc89d3b22bca8622 WatchSource:0}: Error finding container 78a3c9a0dff7c9c642454b5cba9aed66e51ddd7290be3b8bdc89d3b22bca8622: Status 404 returned error can't find the container with id 78a3c9a0dff7c9c642454b5cba9aed66e51ddd7290be3b8bdc89d3b22bca8622 Jul 30 23:30:35.980801 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:35.980775 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm"] Jul 30 23:30:35.981948 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:30:35.981916 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod230ba98c_cfa1_470e_9721_6f1f65cfdea5.slice/crio-0201bc5d53da2eb4d3db5466162baaba4742ada1f4a5d2df0abdb2ebec392a29 WatchSource:0}: Error finding container 0201bc5d53da2eb4d3db5466162baaba4742ada1f4a5d2df0abdb2ebec392a29: Status 404 returned error can't find the container with id 0201bc5d53da2eb4d3db5466162baaba4742ada1f4a5d2df0abdb2ebec392a29 Jul 30 23:30:36.574430 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:36.574389 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" event={"ID":"230ba98c-cfa1-470e-9721-6f1f65cfdea5","Type":"ContainerStarted","Data":"1b36d95268db31a41a1dc4e4349f550b367320207a5d6450ddc9f07fad6e6847"} Jul 30 23:30:36.574939 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:36.574463 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" Jul 30 23:30:36.574939 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:36.574487 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" event={"ID":"230ba98c-cfa1-470e-9721-6f1f65cfdea5","Type":"ContainerStarted","Data":"0201bc5d53da2eb4d3db5466162baaba4742ada1f4a5d2df0abdb2ebec392a29"} Jul 30 23:30:36.575947 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:36.575920 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" event={"ID":"aa2282b2-e116-42bd-9021-36f347dfd381","Type":"ContainerStarted","Data":"d1d574c23700bce08267bf1b5a9822929683c76640b301712c459d75a05e1f1d"} Jul 30 23:30:36.576070 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:36.575968 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" event={"ID":"aa2282b2-e116-42bd-9021-36f347dfd381","Type":"ContainerStarted","Data":"78a3c9a0dff7c9c642454b5cba9aed66e51ddd7290be3b8bdc89d3b22bca8622"} Jul 30 23:30:36.576070 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:36.575996 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" Jul 30 23:30:36.591298 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:36.591255 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" podStartSLOduration=1.591240671 podStartE2EDuration="1.591240671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:30:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:30:36.589802742 +0000 UTC m=+2563.793621976" watchObservedRunningTime="2026-07-30 23:30:36.591240671 +0000 UTC m=+2563.795059882" Jul 30 23:30:36.606870 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:36.606819 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" podStartSLOduration=1.6068052750000001 podStartE2EDuration="1.606805275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:30:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:30:36.60425991 +0000 UTC m=+2563.808079145" watchObservedRunningTime="2026-07-30 23:30:36.606805275 +0000 UTC m=+2563.810624509" Jul 30 23:30:47.552031 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:47.551996 2576 patch_prober.go:28] interesting pod/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body= Jul 30 23:30:47.552447 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:47.552064 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" podUID="c0f095f6-e7cb-4980-a5b0-663efdf68f14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" Jul 30 23:30:47.584292 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:47.584266 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" Jul 30 23:30:47.584436 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:47.584331 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" Jul 30 23:30:47.640081 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:47.640044 2576 generic.go:356] "Generic (PLEG): container finished" podID="c0f095f6-e7cb-4980-a5b0-663efdf68f14" containerID="d316324f884c6296eef9111ce4aa42334125d2c4cd43df24de3c0a7d5a8a1993" exitCode=0 Jul 30 23:30:47.640265 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:47.640115 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" event={"ID":"c0f095f6-e7cb-4980-a5b0-663efdf68f14","Type":"ContainerDied","Data":"d316324f884c6296eef9111ce4aa42334125d2c4cd43df24de3c0a7d5a8a1993"} Jul 30 23:30:47.640572 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:47.640556 2576 scope.go:117] "RemoveContainer" containerID="d316324f884c6296eef9111ce4aa42334125d2c4cd43df24de3c0a7d5a8a1993" Jul 30 23:30:47.641750 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:47.641724 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:30:47.641806 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:47.641789 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:30:47.641844 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:47.641826 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:30:48.651826 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:48.651779 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" event={"ID":"c0f095f6-e7cb-4980-a5b0-663efdf68f14","Type":"ContainerStarted","Data":"5fa57dde6a464796c87d6b8f38c64122c34ab83ca165f66f86a76f55f04fd9b7"} Jul 30 23:30:49.373732 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:49.373692 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:49.373982 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:49.373959 2576 patch_prober.go:28] interesting pod/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body= Jul 30 23:30:49.374044 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:49.374018 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" podUID="c0f095f6-e7cb-4980-a5b0-663efdf68f14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" Jul 30 23:30:50.374128 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:50.374087 2576 patch_prober.go:28] interesting pod/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body= Jul 30 23:30:50.374534 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:50.374148 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" podUID="c0f095f6-e7cb-4980-a5b0-663efdf68f14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" Jul 30 23:30:51.374556 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:51.374514 2576 patch_prober.go:28] interesting pod/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body= Jul 30 23:30:51.374968 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:51.374578 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" podUID="c0f095f6-e7cb-4980-a5b0-663efdf68f14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" Jul 30 23:30:52.374266 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:52.374231 2576 patch_prober.go:28] interesting pod/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body= Jul 30 23:30:52.374460 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:52.374286 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" podUID="c0f095f6-e7cb-4980-a5b0-663efdf68f14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" Jul 30 23:30:53.374312 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:53.374275 2576 patch_prober.go:28] interesting pod/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body= Jul 30 23:30:53.374709 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:53.374332 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" podUID="c0f095f6-e7cb-4980-a5b0-663efdf68f14" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" Jul 30 23:30:54.378771 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:54.378741 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:54.379169 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:54.379091 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:30:54.379667 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:30:54.379651 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:31:16.798565 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:16.798481 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs"] Jul 30 23:31:16.799039 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:16.798741 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" podUID="111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf" containerName="payload-processing" containerID="cri-o://a103b2d32dd7c13b5b4c50e27101ace1440e4051746f81a82218bbfe43846e3f" gracePeriod=30 Jul 30 23:31:16.805806 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:16.805774 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj"] Jul 30 23:31:16.806065 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:16.806015 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" podUID="8a3e36ff-53aa-40dd-94ad-b323ca6939cb" containerName="payload-pre-processing" containerID="cri-o://8488353c9bb662971c28dd67d951f8b0e50c1b7fc6e99de2c24cd57a1471deee" gracePeriod=30 Jul 30 23:31:17.058820 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.058762 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" Jul 30 23:31:17.091790 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.091766 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" Jul 30 23:31:17.237817 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.237785 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx65k\" (UniqueName: \"kubernetes.io/projected/8a3e36ff-53aa-40dd-94ad-b323ca6939cb-kube-api-access-zx65k\") pod \"8a3e36ff-53aa-40dd-94ad-b323ca6939cb\" (UID: \"8a3e36ff-53aa-40dd-94ad-b323ca6939cb\") " Jul 30 23:31:17.237817 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.237817 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf-plugins-config-volume\") pod \"111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf\" (UID: \"111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf\") " Jul 30 23:31:17.238066 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.237900 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4psx\" (UniqueName: \"kubernetes.io/projected/111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf-kube-api-access-n4psx\") pod \"111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf\" (UID: \"111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf\") " Jul 30 23:31:17.238066 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.237933 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a3e36ff-53aa-40dd-94ad-b323ca6939cb-plugins-config-volume\") pod \"8a3e36ff-53aa-40dd-94ad-b323ca6939cb\" (UID: \"8a3e36ff-53aa-40dd-94ad-b323ca6939cb\") " Jul 30 23:31:17.238341 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.238313 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf" (UID: "111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:31:17.238426 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.238361 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a3e36ff-53aa-40dd-94ad-b323ca6939cb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8a3e36ff-53aa-40dd-94ad-b323ca6939cb" (UID: "8a3e36ff-53aa-40dd-94ad-b323ca6939cb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:31:17.240063 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.240039 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf-kube-api-access-n4psx" (OuterVolumeSpecName: "kube-api-access-n4psx") pod "111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf" (UID: "111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf"). InnerVolumeSpecName "kube-api-access-n4psx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:31:17.240142 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.240057 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a3e36ff-53aa-40dd-94ad-b323ca6939cb-kube-api-access-zx65k" (OuterVolumeSpecName: "kube-api-access-zx65k") pod "8a3e36ff-53aa-40dd-94ad-b323ca6939cb" (UID: "8a3e36ff-53aa-40dd-94ad-b323ca6939cb"). InnerVolumeSpecName "kube-api-access-zx65k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:31:17.338980 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.338886 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx65k\" (UniqueName: \"kubernetes.io/projected/8a3e36ff-53aa-40dd-94ad-b323ca6939cb-kube-api-access-zx65k\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:17.338980 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.338926 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:17.338980 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.338935 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4psx\" (UniqueName: \"kubernetes.io/projected/111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf-kube-api-access-n4psx\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:17.338980 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.338945 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a3e36ff-53aa-40dd-94ad-b323ca6939cb-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:17.826176 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.826145 2576 generic.go:356] "Generic (PLEG): container finished" podID="111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf" containerID="a103b2d32dd7c13b5b4c50e27101ace1440e4051746f81a82218bbfe43846e3f" exitCode=0 Jul 30 23:31:17.826546 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.826189 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" Jul 30 23:31:17.826546 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.826233 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" event={"ID":"111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf","Type":"ContainerDied","Data":"a103b2d32dd7c13b5b4c50e27101ace1440e4051746f81a82218bbfe43846e3f"} Jul 30 23:31:17.826546 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.826293 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs" event={"ID":"111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf","Type":"ContainerDied","Data":"4008d6b9fe21ac3e89bdf4d3ef9298258a2aaf91b91236d4b14267742dfe79e6"} Jul 30 23:31:17.826546 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.826328 2576 scope.go:117] "RemoveContainer" containerID="a103b2d32dd7c13b5b4c50e27101ace1440e4051746f81a82218bbfe43846e3f" Jul 30 23:31:17.827694 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.827538 2576 generic.go:356] "Generic (PLEG): container finished" podID="8a3e36ff-53aa-40dd-94ad-b323ca6939cb" containerID="8488353c9bb662971c28dd67d951f8b0e50c1b7fc6e99de2c24cd57a1471deee" exitCode=0 Jul 30 23:31:17.827694 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.827569 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" event={"ID":"8a3e36ff-53aa-40dd-94ad-b323ca6939cb","Type":"ContainerDied","Data":"8488353c9bb662971c28dd67d951f8b0e50c1b7fc6e99de2c24cd57a1471deee"} Jul 30 23:31:17.827694 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.827587 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" Jul 30 23:31:17.827694 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.827601 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj" event={"ID":"8a3e36ff-53aa-40dd-94ad-b323ca6939cb","Type":"ContainerDied","Data":"0a9970ae9ee2d19b067b5374b09f43fdc2d581a584e992069c68d37d49f3e21d"} Jul 30 23:31:17.836206 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.836189 2576 scope.go:117] "RemoveContainer" containerID="a103b2d32dd7c13b5b4c50e27101ace1440e4051746f81a82218bbfe43846e3f" Jul 30 23:31:17.836511 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:31:17.836486 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a103b2d32dd7c13b5b4c50e27101ace1440e4051746f81a82218bbfe43846e3f\": container with ID starting with a103b2d32dd7c13b5b4c50e27101ace1440e4051746f81a82218bbfe43846e3f not found: ID does not exist" containerID="a103b2d32dd7c13b5b4c50e27101ace1440e4051746f81a82218bbfe43846e3f" Jul 30 23:31:17.836643 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.836521 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a103b2d32dd7c13b5b4c50e27101ace1440e4051746f81a82218bbfe43846e3f"} err="failed to get container status \"a103b2d32dd7c13b5b4c50e27101ace1440e4051746f81a82218bbfe43846e3f\": rpc error: code = NotFound desc = could not find container \"a103b2d32dd7c13b5b4c50e27101ace1440e4051746f81a82218bbfe43846e3f\": container with ID starting with a103b2d32dd7c13b5b4c50e27101ace1440e4051746f81a82218bbfe43846e3f not found: ID does not exist" Jul 30 23:31:17.836643 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.836546 2576 scope.go:117] "RemoveContainer" containerID="8488353c9bb662971c28dd67d951f8b0e50c1b7fc6e99de2c24cd57a1471deee" Jul 30 23:31:17.844958 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.844939 2576 scope.go:117] "RemoveContainer" containerID="8488353c9bb662971c28dd67d951f8b0e50c1b7fc6e99de2c24cd57a1471deee" Jul 30 23:31:17.845187 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:31:17.845169 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8488353c9bb662971c28dd67d951f8b0e50c1b7fc6e99de2c24cd57a1471deee\": container with ID starting with 8488353c9bb662971c28dd67d951f8b0e50c1b7fc6e99de2c24cd57a1471deee not found: ID does not exist" containerID="8488353c9bb662971c28dd67d951f8b0e50c1b7fc6e99de2c24cd57a1471deee" Jul 30 23:31:17.845251 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.845194 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8488353c9bb662971c28dd67d951f8b0e50c1b7fc6e99de2c24cd57a1471deee"} err="failed to get container status \"8488353c9bb662971c28dd67d951f8b0e50c1b7fc6e99de2c24cd57a1471deee\": rpc error: code = NotFound desc = could not find container \"8488353c9bb662971c28dd67d951f8b0e50c1b7fc6e99de2c24cd57a1471deee\": container with ID starting with 8488353c9bb662971c28dd67d951f8b0e50c1b7fc6e99de2c24cd57a1471deee not found: ID does not exist" Jul 30 23:31:17.851338 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.851321 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj"] Jul 30 23:31:17.855528 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.855499 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0ff11c-5fd68cb9d8-559sj"] Jul 30 23:31:17.865996 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.865976 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs"] Jul 30 23:31:17.872364 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:17.872346 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0ff11c-5f94ddcc86-pvsgs"] Jul 30 23:31:19.235714 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:19.235680 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf" path="/var/lib/kubelet/pods/111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf/volumes" Jul 30 23:31:19.236102 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:19.236080 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a3e36ff-53aa-40dd-94ad-b323ca6939cb" path="/var/lib/kubelet/pods/8a3e36ff-53aa-40dd-94ad-b323ca6939cb/volumes" Jul 30 23:31:23.457980 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:23.457943 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n"] Jul 30 23:31:23.458554 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:23.458204 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" podUID="d1ac8449-b909-4e0f-b369-f86122d71548" containerName="istio-proxy" containerID="cri-o://7e6f43b54d55004ff8cca8b9ce0ef0004d56518a121151d2f89d98ef93679138" gracePeriod=30 Jul 30 23:31:25.206954 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:25.206916 2576 patch_prober.go:28] interesting pod/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 30 23:31:25.207390 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:25.206980 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" podUID="d1ac8449-b909-4e0f-b369-f86122d71548" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 30 23:31:28.707134 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.707104 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:31:28.743332 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.743253 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1ac8449-b909-4e0f-b369-f86122d71548-istio-token\") pod \"d1ac8449-b909-4e0f-b369-f86122d71548\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " Jul 30 23:31:28.743488 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.743338 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-workload-socket\") pod \"d1ac8449-b909-4e0f-b369-f86122d71548\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " Jul 30 23:31:28.743488 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.743387 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-istio-data\") pod \"d1ac8449-b909-4e0f-b369-f86122d71548\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " Jul 30 23:31:28.743488 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.743404 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-workload-certs\") pod \"d1ac8449-b909-4e0f-b369-f86122d71548\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " Jul 30 23:31:28.743488 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.743435 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrsgd\" (UniqueName: \"kubernetes.io/projected/d1ac8449-b909-4e0f-b369-f86122d71548-kube-api-access-hrsgd\") pod \"d1ac8449-b909-4e0f-b369-f86122d71548\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " Jul 30 23:31:28.743726 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.743507 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-credential-socket\") pod \"d1ac8449-b909-4e0f-b369-f86122d71548\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " Jul 30 23:31:28.743726 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.743538 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-istio-envoy\") pod \"d1ac8449-b909-4e0f-b369-f86122d71548\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " Jul 30 23:31:28.743726 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.743584 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1ac8449-b909-4e0f-b369-f86122d71548-istio-podinfo\") pod \"d1ac8449-b909-4e0f-b369-f86122d71548\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " Jul 30 23:31:28.743726 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.743613 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1ac8449-b909-4e0f-b369-f86122d71548-istiod-ca-cert\") pod \"d1ac8449-b909-4e0f-b369-f86122d71548\" (UID: \"d1ac8449-b909-4e0f-b369-f86122d71548\") " Jul 30 23:31:28.743726 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.743629 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d1ac8449-b909-4e0f-b369-f86122d71548" (UID: "d1ac8449-b909-4e0f-b369-f86122d71548"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:31:28.743726 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.743644 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-istio-data" (OuterVolumeSpecName: "istio-data") pod "d1ac8449-b909-4e0f-b369-f86122d71548" (UID: "d1ac8449-b909-4e0f-b369-f86122d71548"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:31:28.743726 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.743675 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d1ac8449-b909-4e0f-b369-f86122d71548" (UID: "d1ac8449-b909-4e0f-b369-f86122d71548"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:31:28.744141 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.743903 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d1ac8449-b909-4e0f-b369-f86122d71548" (UID: "d1ac8449-b909-4e0f-b369-f86122d71548"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:31:28.744141 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.743951 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:28.744141 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.743970 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:28.744141 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.743987 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:28.744360 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.744194 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1ac8449-b909-4e0f-b369-f86122d71548-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d1ac8449-b909-4e0f-b369-f86122d71548" (UID: "d1ac8449-b909-4e0f-b369-f86122d71548"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:31:28.745719 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.745690 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d1ac8449-b909-4e0f-b369-f86122d71548-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d1ac8449-b909-4e0f-b369-f86122d71548" (UID: "d1ac8449-b909-4e0f-b369-f86122d71548"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 23:31:28.745719 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.745692 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1ac8449-b909-4e0f-b369-f86122d71548-kube-api-access-hrsgd" (OuterVolumeSpecName: "kube-api-access-hrsgd") pod "d1ac8449-b909-4e0f-b369-f86122d71548" (UID: "d1ac8449-b909-4e0f-b369-f86122d71548"). InnerVolumeSpecName "kube-api-access-hrsgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:31:28.745916 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.745890 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1ac8449-b909-4e0f-b369-f86122d71548-istio-token" (OuterVolumeSpecName: "istio-token") pod "d1ac8449-b909-4e0f-b369-f86122d71548" (UID: "d1ac8449-b909-4e0f-b369-f86122d71548"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:31:28.745970 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.745940 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d1ac8449-b909-4e0f-b369-f86122d71548" (UID: "d1ac8449-b909-4e0f-b369-f86122d71548"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:31:28.845376 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.845342 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1ac8449-b909-4e0f-b369-f86122d71548-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:28.845376 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.845370 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1ac8449-b909-4e0f-b369-f86122d71548-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:28.845376 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.845379 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1ac8449-b909-4e0f-b369-f86122d71548-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:28.845613 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.845388 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrsgd\" (UniqueName: \"kubernetes.io/projected/d1ac8449-b909-4e0f-b369-f86122d71548-kube-api-access-hrsgd\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:28.845613 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.845396 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:28.845613 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.845405 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1ac8449-b909-4e0f-b369-f86122d71548-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:28.900466 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.900435 2576 generic.go:356] "Generic (PLEG): container finished" podID="d1ac8449-b909-4e0f-b369-f86122d71548" containerID="7e6f43b54d55004ff8cca8b9ce0ef0004d56518a121151d2f89d98ef93679138" exitCode=0 Jul 30 23:31:28.900653 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.900481 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" Jul 30 23:31:28.900653 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.900529 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" event={"ID":"d1ac8449-b909-4e0f-b369-f86122d71548","Type":"ContainerDied","Data":"7e6f43b54d55004ff8cca8b9ce0ef0004d56518a121151d2f89d98ef93679138"} Jul 30 23:31:28.900653 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.900590 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n" event={"ID":"d1ac8449-b909-4e0f-b369-f86122d71548","Type":"ContainerDied","Data":"94815c8bd3b0868ef92c11ccdfbb8d168b3fd4c4b99fb5cd5d671d06761a8c08"} Jul 30 23:31:28.900653 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.900619 2576 scope.go:117] "RemoveContainer" containerID="7e6f43b54d55004ff8cca8b9ce0ef0004d56518a121151d2f89d98ef93679138" Jul 30 23:31:28.910909 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.910884 2576 scope.go:117] "RemoveContainer" containerID="63b0850b03e00f3aaa7d6a97952ed89d6a188b72eb6cbfdf242dca54a449f81d" Jul 30 23:31:28.919066 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.919047 2576 scope.go:117] "RemoveContainer" containerID="7e6f43b54d55004ff8cca8b9ce0ef0004d56518a121151d2f89d98ef93679138" Jul 30 23:31:28.919343 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:31:28.919322 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e6f43b54d55004ff8cca8b9ce0ef0004d56518a121151d2f89d98ef93679138\": container with ID starting with 7e6f43b54d55004ff8cca8b9ce0ef0004d56518a121151d2f89d98ef93679138 not found: ID does not exist" containerID="7e6f43b54d55004ff8cca8b9ce0ef0004d56518a121151d2f89d98ef93679138" Jul 30 23:31:28.919392 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.919353 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e6f43b54d55004ff8cca8b9ce0ef0004d56518a121151d2f89d98ef93679138"} err="failed to get container status \"7e6f43b54d55004ff8cca8b9ce0ef0004d56518a121151d2f89d98ef93679138\": rpc error: code = NotFound desc = could not find container \"7e6f43b54d55004ff8cca8b9ce0ef0004d56518a121151d2f89d98ef93679138\": container with ID starting with 7e6f43b54d55004ff8cca8b9ce0ef0004d56518a121151d2f89d98ef93679138 not found: ID does not exist" Jul 30 23:31:28.919392 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.919371 2576 scope.go:117] "RemoveContainer" containerID="63b0850b03e00f3aaa7d6a97952ed89d6a188b72eb6cbfdf242dca54a449f81d" Jul 30 23:31:28.919631 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:31:28.919612 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63b0850b03e00f3aaa7d6a97952ed89d6a188b72eb6cbfdf242dca54a449f81d\": container with ID starting with 63b0850b03e00f3aaa7d6a97952ed89d6a188b72eb6cbfdf242dca54a449f81d not found: ID does not exist" containerID="63b0850b03e00f3aaa7d6a97952ed89d6a188b72eb6cbfdf242dca54a449f81d" Jul 30 23:31:28.919680 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.919635 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63b0850b03e00f3aaa7d6a97952ed89d6a188b72eb6cbfdf242dca54a449f81d"} err="failed to get container status \"63b0850b03e00f3aaa7d6a97952ed89d6a188b72eb6cbfdf242dca54a449f81d\": rpc error: code = NotFound desc = could not find container \"63b0850b03e00f3aaa7d6a97952ed89d6a188b72eb6cbfdf242dca54a449f81d\": container with ID starting with 63b0850b03e00f3aaa7d6a97952ed89d6a188b72eb6cbfdf242dca54a449f81d not found: ID does not exist" Jul 30 23:31:28.923533 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.923513 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n"] Jul 30 23:31:28.927704 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:28.927681 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-0ff11c-openshift-default-845855784b-nn26n"] Jul 30 23:31:29.236430 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:29.236393 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1ac8449-b909-4e0f-b369-f86122d71548" path="/var/lib/kubelet/pods/d1ac8449-b909-4e0f-b369-f86122d71548/volumes" Jul 30 23:31:39.314022 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.313984 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm"] Jul 30 23:31:39.314436 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.314246 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" podUID="230ba98c-cfa1-470e-9721-6f1f65cfdea5" containerName="payload-processing" containerID="cri-o://1b36d95268db31a41a1dc4e4349f550b367320207a5d6450ddc9f07fad6e6847" gracePeriod=30 Jul 30 23:31:39.320883 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.320838 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k"] Jul 30 23:31:39.321274 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.321238 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" podUID="aa2282b2-e116-42bd-9021-36f347dfd381" containerName="payload-pre-processing" containerID="cri-o://d1d574c23700bce08267bf1b5a9822929683c76640b301712c459d75a05e1f1d" gracePeriod=30 Jul 30 23:31:39.575820 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.575757 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" Jul 30 23:31:39.607594 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.607567 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" Jul 30 23:31:39.641044 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.641019 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrq7l\" (UniqueName: \"kubernetes.io/projected/230ba98c-cfa1-470e-9721-6f1f65cfdea5-kube-api-access-nrq7l\") pod \"230ba98c-cfa1-470e-9721-6f1f65cfdea5\" (UID: \"230ba98c-cfa1-470e-9721-6f1f65cfdea5\") " Jul 30 23:31:39.641185 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.641086 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/230ba98c-cfa1-470e-9721-6f1f65cfdea5-plugins-config-volume\") pod \"230ba98c-cfa1-470e-9721-6f1f65cfdea5\" (UID: \"230ba98c-cfa1-470e-9721-6f1f65cfdea5\") " Jul 30 23:31:39.641498 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.641478 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/230ba98c-cfa1-470e-9721-6f1f65cfdea5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "230ba98c-cfa1-470e-9721-6f1f65cfdea5" (UID: "230ba98c-cfa1-470e-9721-6f1f65cfdea5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:31:39.643139 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.643113 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/230ba98c-cfa1-470e-9721-6f1f65cfdea5-kube-api-access-nrq7l" (OuterVolumeSpecName: "kube-api-access-nrq7l") pod "230ba98c-cfa1-470e-9721-6f1f65cfdea5" (UID: "230ba98c-cfa1-470e-9721-6f1f65cfdea5"). InnerVolumeSpecName "kube-api-access-nrq7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:31:39.741751 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.741717 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa2282b2-e116-42bd-9021-36f347dfd381-plugins-config-volume\") pod \"aa2282b2-e116-42bd-9021-36f347dfd381\" (UID: \"aa2282b2-e116-42bd-9021-36f347dfd381\") " Jul 30 23:31:39.741912 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.741843 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpbn8\" (UniqueName: \"kubernetes.io/projected/aa2282b2-e116-42bd-9021-36f347dfd381-kube-api-access-bpbn8\") pod \"aa2282b2-e116-42bd-9021-36f347dfd381\" (UID: \"aa2282b2-e116-42bd-9021-36f347dfd381\") " Jul 30 23:31:39.742101 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.742079 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa2282b2-e116-42bd-9021-36f347dfd381-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aa2282b2-e116-42bd-9021-36f347dfd381" (UID: "aa2282b2-e116-42bd-9021-36f347dfd381"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:31:39.742142 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.742099 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/230ba98c-cfa1-470e-9721-6f1f65cfdea5-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:39.742142 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.742118 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrq7l\" (UniqueName: \"kubernetes.io/projected/230ba98c-cfa1-470e-9721-6f1f65cfdea5-kube-api-access-nrq7l\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:39.743816 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.743798 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa2282b2-e116-42bd-9021-36f347dfd381-kube-api-access-bpbn8" (OuterVolumeSpecName: "kube-api-access-bpbn8") pod "aa2282b2-e116-42bd-9021-36f347dfd381" (UID: "aa2282b2-e116-42bd-9021-36f347dfd381"). InnerVolumeSpecName "kube-api-access-bpbn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:31:39.843019 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.842936 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa2282b2-e116-42bd-9021-36f347dfd381-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:39.843019 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.842963 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpbn8\" (UniqueName: \"kubernetes.io/projected/aa2282b2-e116-42bd-9021-36f347dfd381-kube-api-access-bpbn8\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:39.962483 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.962450 2576 generic.go:356] "Generic (PLEG): container finished" podID="230ba98c-cfa1-470e-9721-6f1f65cfdea5" containerID="1b36d95268db31a41a1dc4e4349f550b367320207a5d6450ddc9f07fad6e6847" exitCode=0 Jul 30 23:31:39.962663 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.962496 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" Jul 30 23:31:39.962663 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.962538 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" event={"ID":"230ba98c-cfa1-470e-9721-6f1f65cfdea5","Type":"ContainerDied","Data":"1b36d95268db31a41a1dc4e4349f550b367320207a5d6450ddc9f07fad6e6847"} Jul 30 23:31:39.962663 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.962589 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm" event={"ID":"230ba98c-cfa1-470e-9721-6f1f65cfdea5","Type":"ContainerDied","Data":"0201bc5d53da2eb4d3db5466162baaba4742ada1f4a5d2df0abdb2ebec392a29"} Jul 30 23:31:39.962663 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.962608 2576 scope.go:117] "RemoveContainer" containerID="1b36d95268db31a41a1dc4e4349f550b367320207a5d6450ddc9f07fad6e6847" Jul 30 23:31:39.963792 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.963773 2576 generic.go:356] "Generic (PLEG): container finished" podID="aa2282b2-e116-42bd-9021-36f347dfd381" containerID="d1d574c23700bce08267bf1b5a9822929683c76640b301712c459d75a05e1f1d" exitCode=0 Jul 30 23:31:39.963907 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.963821 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" Jul 30 23:31:39.963907 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.963889 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" event={"ID":"aa2282b2-e116-42bd-9021-36f347dfd381","Type":"ContainerDied","Data":"d1d574c23700bce08267bf1b5a9822929683c76640b301712c459d75a05e1f1d"} Jul 30 23:31:39.963992 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.963936 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k" event={"ID":"aa2282b2-e116-42bd-9021-36f347dfd381","Type":"ContainerDied","Data":"78a3c9a0dff7c9c642454b5cba9aed66e51ddd7290be3b8bdc89d3b22bca8622"} Jul 30 23:31:39.972890 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.972852 2576 scope.go:117] "RemoveContainer" containerID="1b36d95268db31a41a1dc4e4349f550b367320207a5d6450ddc9f07fad6e6847" Jul 30 23:31:39.973131 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:31:39.973111 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b36d95268db31a41a1dc4e4349f550b367320207a5d6450ddc9f07fad6e6847\": container with ID starting with 1b36d95268db31a41a1dc4e4349f550b367320207a5d6450ddc9f07fad6e6847 not found: ID does not exist" containerID="1b36d95268db31a41a1dc4e4349f550b367320207a5d6450ddc9f07fad6e6847" Jul 30 23:31:39.973206 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.973138 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b36d95268db31a41a1dc4e4349f550b367320207a5d6450ddc9f07fad6e6847"} err="failed to get container status \"1b36d95268db31a41a1dc4e4349f550b367320207a5d6450ddc9f07fad6e6847\": rpc error: code = NotFound desc = could not find container \"1b36d95268db31a41a1dc4e4349f550b367320207a5d6450ddc9f07fad6e6847\": container with ID starting with 1b36d95268db31a41a1dc4e4349f550b367320207a5d6450ddc9f07fad6e6847 not found: ID does not exist" Jul 30 23:31:39.973206 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.973160 2576 scope.go:117] "RemoveContainer" containerID="d1d574c23700bce08267bf1b5a9822929683c76640b301712c459d75a05e1f1d" Jul 30 23:31:39.981226 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.981212 2576 scope.go:117] "RemoveContainer" containerID="d1d574c23700bce08267bf1b5a9822929683c76640b301712c459d75a05e1f1d" Jul 30 23:31:39.981471 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:31:39.981454 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1d574c23700bce08267bf1b5a9822929683c76640b301712c459d75a05e1f1d\": container with ID starting with d1d574c23700bce08267bf1b5a9822929683c76640b301712c459d75a05e1f1d not found: ID does not exist" containerID="d1d574c23700bce08267bf1b5a9822929683c76640b301712c459d75a05e1f1d" Jul 30 23:31:39.981512 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.981477 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1d574c23700bce08267bf1b5a9822929683c76640b301712c459d75a05e1f1d"} err="failed to get container status \"d1d574c23700bce08267bf1b5a9822929683c76640b301712c459d75a05e1f1d\": rpc error: code = NotFound desc = could not find container \"d1d574c23700bce08267bf1b5a9822929683c76640b301712c459d75a05e1f1d\": container with ID starting with d1d574c23700bce08267bf1b5a9822929683c76640b301712c459d75a05e1f1d not found: ID does not exist" Jul 30 23:31:39.986013 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.985994 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm"] Jul 30 23:31:39.989769 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:39.989750 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-13c529-5b678d87b4-f4vdm"] Jul 30 23:31:40.000619 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:40.000598 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k"] Jul 30 23:31:40.004448 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:40.004428 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-13c529-8454b4dd4-jsq4k"] Jul 30 23:31:41.236245 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:41.236211 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="230ba98c-cfa1-470e-9721-6f1f65cfdea5" path="/var/lib/kubelet/pods/230ba98c-cfa1-470e-9721-6f1f65cfdea5/volumes" Jul 30 23:31:41.236622 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:41.236599 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa2282b2-e116-42bd-9021-36f347dfd381" path="/var/lib/kubelet/pods/aa2282b2-e116-42bd-9021-36f347dfd381/volumes" Jul 30 23:31:45.842555 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:45.842511 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg"] Jul 30 23:31:45.843027 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:45.842789 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" podUID="c0f095f6-e7cb-4980-a5b0-663efdf68f14" containerName="istio-proxy" containerID="cri-o://5fa57dde6a464796c87d6b8f38c64122c34ab83ca165f66f86a76f55f04fd9b7" gracePeriod=30 Jul 30 23:31:46.674638 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.674607 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k"] Jul 30 23:31:46.674958 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.674944 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1ac8449-b909-4e0f-b369-f86122d71548" containerName="istio-proxy" Jul 30 23:31:46.674958 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.674958 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1ac8449-b909-4e0f-b369-f86122d71548" containerName="istio-proxy" Jul 30 23:31:46.675096 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.674970 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1ac8449-b909-4e0f-b369-f86122d71548" containerName="istio-proxy" Jul 30 23:31:46.675096 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.674975 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1ac8449-b909-4e0f-b369-f86122d71548" containerName="istio-proxy" Jul 30 23:31:46.675096 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.674984 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf" containerName="payload-processing" Jul 30 23:31:46.675096 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.674991 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf" containerName="payload-processing" Jul 30 23:31:46.675096 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.675002 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa2282b2-e116-42bd-9021-36f347dfd381" containerName="payload-pre-processing" Jul 30 23:31:46.675096 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.675007 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa2282b2-e116-42bd-9021-36f347dfd381" containerName="payload-pre-processing" Jul 30 23:31:46.675096 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.675015 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a3e36ff-53aa-40dd-94ad-b323ca6939cb" containerName="payload-pre-processing" Jul 30 23:31:46.675096 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.675020 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a3e36ff-53aa-40dd-94ad-b323ca6939cb" containerName="payload-pre-processing" Jul 30 23:31:46.675096 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.675027 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="230ba98c-cfa1-470e-9721-6f1f65cfdea5" containerName="payload-processing" Jul 30 23:31:46.675096 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.675032 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="230ba98c-cfa1-470e-9721-6f1f65cfdea5" containerName="payload-processing" Jul 30 23:31:46.675096 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.675084 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1ac8449-b909-4e0f-b369-f86122d71548" containerName="istio-proxy" Jul 30 23:31:46.675096 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.675091 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1ac8449-b909-4e0f-b369-f86122d71548" containerName="istio-proxy" Jul 30 23:31:46.675096 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.675099 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a3e36ff-53aa-40dd-94ad-b323ca6939cb" containerName="payload-pre-processing" Jul 30 23:31:46.675738 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.675106 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="230ba98c-cfa1-470e-9721-6f1f65cfdea5" containerName="payload-processing" Jul 30 23:31:46.675738 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.675112 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="111bb5c4-8ed1-46ed-b4ea-7b75ba6b6eaf" containerName="payload-processing" Jul 30 23:31:46.675738 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.675117 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa2282b2-e116-42bd-9021-36f347dfd381" containerName="payload-pre-processing" Jul 30 23:31:46.679661 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.679644 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.682350 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.682331 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-5049e4-openshift-default-dockercfg-vc8zd\"" Jul 30 23:31:46.689510 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.689485 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k"] Jul 30 23:31:46.799376 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.799343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-istio-envoy\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.799604 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.799385 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-istio-data\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.799604 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.799417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c4vh\" (UniqueName: \"kubernetes.io/projected/f848754d-0b20-4311-b285-c7958edd3c1a-kube-api-access-9c4vh\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.799604 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.799443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-workload-certs\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.799604 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.799550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-workload-socket\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.799786 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.799637 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f848754d-0b20-4311-b285-c7958edd3c1a-istio-token\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.799786 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.799680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-credential-socket\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.799786 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.799699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f848754d-0b20-4311-b285-c7958edd3c1a-istiod-ca-cert\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.799786 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.799722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f848754d-0b20-4311-b285-c7958edd3c1a-istio-podinfo\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.900745 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.900711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-workload-socket\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.901240 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.900761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f848754d-0b20-4311-b285-c7958edd3c1a-istio-token\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.901240 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.900896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-credential-socket\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.901240 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.900928 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f848754d-0b20-4311-b285-c7958edd3c1a-istiod-ca-cert\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.901240 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.900946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f848754d-0b20-4311-b285-c7958edd3c1a-istio-podinfo\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.901240 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.901149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-istio-envoy\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.901240 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.901204 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-workload-socket\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.901240 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.901218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-istio-data\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.901646 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.901263 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-credential-socket\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.901646 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.901269 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c4vh\" (UniqueName: \"kubernetes.io/projected/f848754d-0b20-4311-b285-c7958edd3c1a-kube-api-access-9c4vh\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.901646 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.901350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-workload-certs\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.901646 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.901591 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-istio-data\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.901839 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.901659 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-workload-certs\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.901839 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.901670 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f848754d-0b20-4311-b285-c7958edd3c1a-istiod-ca-cert\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.903308 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.903288 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-istio-envoy\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.903596 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.903576 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f848754d-0b20-4311-b285-c7958edd3c1a-istio-podinfo\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.908933 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.908906 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f848754d-0b20-4311-b285-c7958edd3c1a-istio-token\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.909040 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.909022 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c4vh\" (UniqueName: \"kubernetes.io/projected/f848754d-0b20-4311-b285-c7958edd3c1a-kube-api-access-9c4vh\") pod \"e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:46.990599 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:46.990515 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:47.125727 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:47.125700 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k"] Jul 30 23:31:47.126956 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:31:47.126931 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf848754d_0b20_4311_b285_c7958edd3c1a.slice/crio-d14572c3c2ff67bcf9d55672fccf81f0f3e1602e20b394892e6e370c9a942149 WatchSource:0}: Error finding container d14572c3c2ff67bcf9d55672fccf81f0f3e1602e20b394892e6e370c9a942149: Status 404 returned error can't find the container with id d14572c3c2ff67bcf9d55672fccf81f0f3e1602e20b394892e6e370c9a942149 Jul 30 23:31:47.129083 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:47.129050 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:31:47.129180 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:47.129110 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:31:47.129180 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:47.129150 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:31:48.010295 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:48.010263 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" event={"ID":"f848754d-0b20-4311-b285-c7958edd3c1a","Type":"ContainerStarted","Data":"05d6898a03419ef841543724cebc73b316aba416d7f5cfc4338cf21292953041"} Jul 30 23:31:48.010653 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:48.010311 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" event={"ID":"f848754d-0b20-4311-b285-c7958edd3c1a","Type":"ContainerStarted","Data":"d14572c3c2ff67bcf9d55672fccf81f0f3e1602e20b394892e6e370c9a942149"} Jul 30 23:31:48.032797 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:48.032755 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" podStartSLOduration=2.032739567 podStartE2EDuration="2.032739567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:31:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:31:48.031583998 +0000 UTC m=+2635.235403222" watchObservedRunningTime="2026-07-30 23:31:48.032739567 +0000 UTC m=+2635.236558800" Jul 30 23:31:48.990938 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:48.990903 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:48.995572 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:48.995550 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:49.016928 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:49.016893 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:49.017919 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:49.017899 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:31:51.029786 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.029751 2576 generic.go:356] "Generic (PLEG): container finished" podID="c0f095f6-e7cb-4980-a5b0-663efdf68f14" containerID="5fa57dde6a464796c87d6b8f38c64122c34ab83ca165f66f86a76f55f04fd9b7" exitCode=0 Jul 30 23:31:51.030211 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.029831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" event={"ID":"c0f095f6-e7cb-4980-a5b0-663efdf68f14","Type":"ContainerDied","Data":"5fa57dde6a464796c87d6b8f38c64122c34ab83ca165f66f86a76f55f04fd9b7"} Jul 30 23:31:51.030211 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.029937 2576 scope.go:117] "RemoveContainer" containerID="d316324f884c6296eef9111ce4aa42334125d2c4cd43df24de3c0a7d5a8a1993" Jul 30 23:31:51.091812 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.091788 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:31:51.243678 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.243650 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-data\") pod \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " Jul 30 23:31:51.243820 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.243693 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-token\") pod \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " Jul 30 23:31:51.243820 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.243715 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istiod-ca-cert\") pod \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " Jul 30 23:31:51.243820 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.243753 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vk5r8\" (UniqueName: \"kubernetes.io/projected/c0f095f6-e7cb-4980-a5b0-663efdf68f14-kube-api-access-vk5r8\") pod \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " Jul 30 23:31:51.243820 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.243783 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-workload-socket\") pod \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " Jul 30 23:31:51.244064 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.243824 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-podinfo\") pod \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " Jul 30 23:31:51.244064 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.243902 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-credential-socket\") pod \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " Jul 30 23:31:51.244064 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.243927 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0f095f6-e7cb-4980-a5b0-663efdf68f14" (UID: "c0f095f6-e7cb-4980-a5b0-663efdf68f14"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:31:51.244064 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.243959 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-workload-certs\") pod \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " Jul 30 23:31:51.244064 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.244012 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-envoy\") pod \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\" (UID: \"c0f095f6-e7cb-4980-a5b0-663efdf68f14\") " Jul 30 23:31:51.244315 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.244156 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0f095f6-e7cb-4980-a5b0-663efdf68f14" (UID: "c0f095f6-e7cb-4980-a5b0-663efdf68f14"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:31:51.244315 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.244171 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0f095f6-e7cb-4980-a5b0-663efdf68f14" (UID: "c0f095f6-e7cb-4980-a5b0-663efdf68f14"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:31:51.244315 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.244278 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0f095f6-e7cb-4980-a5b0-663efdf68f14" (UID: "c0f095f6-e7cb-4980-a5b0-663efdf68f14"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:31:51.244460 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.244425 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:51.244460 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.244444 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:51.244574 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.244459 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:51.244574 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.244474 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:51.244574 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.244553 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0f095f6-e7cb-4980-a5b0-663efdf68f14" (UID: "c0f095f6-e7cb-4980-a5b0-663efdf68f14"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:31:51.246014 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.245987 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0f095f6-e7cb-4980-a5b0-663efdf68f14-kube-api-access-vk5r8" (OuterVolumeSpecName: "kube-api-access-vk5r8") pod "c0f095f6-e7cb-4980-a5b0-663efdf68f14" (UID: "c0f095f6-e7cb-4980-a5b0-663efdf68f14"). InnerVolumeSpecName "kube-api-access-vk5r8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:31:51.246139 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.246056 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0f095f6-e7cb-4980-a5b0-663efdf68f14" (UID: "c0f095f6-e7cb-4980-a5b0-663efdf68f14"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:31:51.246249 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.246232 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0f095f6-e7cb-4980-a5b0-663efdf68f14" (UID: "c0f095f6-e7cb-4980-a5b0-663efdf68f14"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 23:31:51.246352 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.246336 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0f095f6-e7cb-4980-a5b0-663efdf68f14" (UID: "c0f095f6-e7cb-4980-a5b0-663efdf68f14"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:31:51.345001 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.344969 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:51.345001 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.344994 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:51.345001 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.345002 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:51.345252 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.345011 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vk5r8\" (UniqueName: \"kubernetes.io/projected/c0f095f6-e7cb-4980-a5b0-663efdf68f14-kube-api-access-vk5r8\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:51.345252 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.345022 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0f095f6-e7cb-4980-a5b0-663efdf68f14-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:31:51.871027 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.870980 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz"] Jul 30 23:31:51.871402 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.871384 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0f095f6-e7cb-4980-a5b0-663efdf68f14" containerName="istio-proxy" Jul 30 23:31:51.871485 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.871405 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0f095f6-e7cb-4980-a5b0-663efdf68f14" containerName="istio-proxy" Jul 30 23:31:51.871485 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.871429 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0f095f6-e7cb-4980-a5b0-663efdf68f14" containerName="istio-proxy" Jul 30 23:31:51.871485 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.871437 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0f095f6-e7cb-4980-a5b0-663efdf68f14" containerName="istio-proxy" Jul 30 23:31:51.871649 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.871526 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0f095f6-e7cb-4980-a5b0-663efdf68f14" containerName="istio-proxy" Jul 30 23:31:51.871649 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.871538 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0f095f6-e7cb-4980-a5b0-663efdf68f14" containerName="istio-proxy" Jul 30 23:31:51.874947 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.874923 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" Jul 30 23:31:51.877423 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.877406 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-5049e4-dockercfg-d5hsw\"" Jul 30 23:31:51.877520 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.877480 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-5049e4\"" Jul 30 23:31:51.884753 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.884732 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz"] Jul 30 23:31:51.905237 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.905212 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h"] Jul 30 23:31:51.908597 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.908581 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" Jul 30 23:31:51.919640 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.919616 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h"] Jul 30 23:31:51.951243 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.951213 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66fmc\" (UniqueName: \"kubernetes.io/projected/e2120ac9-a7e5-4544-883b-2b09931ff9b2-kube-api-access-66fmc\") pod \"payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz\" (UID: \"e2120ac9-a7e5-4544-883b-2b09931ff9b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" Jul 30 23:31:51.951378 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:51.951311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2120ac9-a7e5-4544-883b-2b09931ff9b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz\" (UID: \"e2120ac9-a7e5-4544-883b-2b09931ff9b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" Jul 30 23:31:52.037278 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.037248 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" Jul 30 23:31:52.037708 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.037286 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg" event={"ID":"c0f095f6-e7cb-4980-a5b0-663efdf68f14","Type":"ContainerDied","Data":"6a02fb5f50e3ded96fd064e4c6420b1e0688181a42b6c8d06b9217bef5c1c2cb"} Jul 30 23:31:52.037708 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.037355 2576 scope.go:117] "RemoveContainer" containerID="5fa57dde6a464796c87d6b8f38c64122c34ab83ca165f66f86a76f55f04fd9b7" Jul 30 23:31:52.051736 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.051718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8gs4\" (UniqueName: \"kubernetes.io/projected/3cf10e73-cc6f-45d8-a082-65e464cdcb54-kube-api-access-w8gs4\") pod \"payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h\" (UID: \"3cf10e73-cc6f-45d8-a082-65e464cdcb54\") " pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" Jul 30 23:31:52.051819 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.051765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2120ac9-a7e5-4544-883b-2b09931ff9b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz\" (UID: \"e2120ac9-a7e5-4544-883b-2b09931ff9b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" Jul 30 23:31:52.051819 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.051791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf10e73-cc6f-45d8-a082-65e464cdcb54-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h\" (UID: \"3cf10e73-cc6f-45d8-a082-65e464cdcb54\") " pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" Jul 30 23:31:52.051935 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.051839 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66fmc\" (UniqueName: \"kubernetes.io/projected/e2120ac9-a7e5-4544-883b-2b09931ff9b2-kube-api-access-66fmc\") pod \"payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz\" (UID: \"e2120ac9-a7e5-4544-883b-2b09931ff9b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" Jul 30 23:31:52.052370 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.052352 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2120ac9-a7e5-4544-883b-2b09931ff9b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz\" (UID: \"e2120ac9-a7e5-4544-883b-2b09931ff9b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" Jul 30 23:31:52.059475 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.059450 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg"] Jul 30 23:31:52.061678 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.061625 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66fmc\" (UniqueName: \"kubernetes.io/projected/e2120ac9-a7e5-4544-883b-2b09931ff9b2-kube-api-access-66fmc\") pod \"payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz\" (UID: \"e2120ac9-a7e5-4544-883b-2b09931ff9b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" Jul 30 23:31:52.065592 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.065570 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-13c529-openshift-default-7fcdfb58d8-hmwgg"] Jul 30 23:31:52.152865 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.152835 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf10e73-cc6f-45d8-a082-65e464cdcb54-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h\" (UID: \"3cf10e73-cc6f-45d8-a082-65e464cdcb54\") " pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" Jul 30 23:31:52.153043 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.152951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8gs4\" (UniqueName: \"kubernetes.io/projected/3cf10e73-cc6f-45d8-a082-65e464cdcb54-kube-api-access-w8gs4\") pod \"payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h\" (UID: \"3cf10e73-cc6f-45d8-a082-65e464cdcb54\") " pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" Jul 30 23:31:52.153511 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.153491 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf10e73-cc6f-45d8-a082-65e464cdcb54-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h\" (UID: \"3cf10e73-cc6f-45d8-a082-65e464cdcb54\") " pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" Jul 30 23:31:52.161755 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.161731 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8gs4\" (UniqueName: \"kubernetes.io/projected/3cf10e73-cc6f-45d8-a082-65e464cdcb54-kube-api-access-w8gs4\") pod \"payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h\" (UID: \"3cf10e73-cc6f-45d8-a082-65e464cdcb54\") " pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" Jul 30 23:31:52.187260 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.187238 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" Jul 30 23:31:52.219505 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.219475 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" Jul 30 23:31:52.329302 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.329274 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz"] Jul 30 23:31:52.331347 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:31:52.331314 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2120ac9_a7e5_4544_883b_2b09931ff9b2.slice/crio-bada5518c3126cfd3680d8254ad8df68cd22ec0e76eb7b579b3549a3f37cae1f WatchSource:0}: Error finding container bada5518c3126cfd3680d8254ad8df68cd22ec0e76eb7b579b3549a3f37cae1f: Status 404 returned error can't find the container with id bada5518c3126cfd3680d8254ad8df68cd22ec0e76eb7b579b3549a3f37cae1f Jul 30 23:31:52.566634 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:52.566612 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h"] Jul 30 23:31:52.567996 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:31:52.567968 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf10e73_cc6f_45d8_a082_65e464cdcb54.slice/crio-b22c0f03174d0c95bad6e26788343097ad69623f8ce64b7e8b2779fa1c9f78f4 WatchSource:0}: Error finding container b22c0f03174d0c95bad6e26788343097ad69623f8ce64b7e8b2779fa1c9f78f4: Status 404 returned error can't find the container with id b22c0f03174d0c95bad6e26788343097ad69623f8ce64b7e8b2779fa1c9f78f4 Jul 30 23:31:53.046356 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:53.046317 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" event={"ID":"3cf10e73-cc6f-45d8-a082-65e464cdcb54","Type":"ContainerStarted","Data":"ae85ab5ba2baa04fe53b0e55aca20712083bc4ea78c94a53c41f4254d4b92df4"} Jul 30 23:31:53.046835 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:53.046382 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" event={"ID":"3cf10e73-cc6f-45d8-a082-65e464cdcb54","Type":"ContainerStarted","Data":"b22c0f03174d0c95bad6e26788343097ad69623f8ce64b7e8b2779fa1c9f78f4"} Jul 30 23:31:53.046835 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:53.046427 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" Jul 30 23:31:53.048039 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:53.048012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" event={"ID":"e2120ac9-a7e5-4544-883b-2b09931ff9b2","Type":"ContainerStarted","Data":"dea67317985c4d5d0002b29ce084d3e6f68dc75e5b42e305def9cc91a5ecf5df"} Jul 30 23:31:53.048170 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:53.048057 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" event={"ID":"e2120ac9-a7e5-4544-883b-2b09931ff9b2","Type":"ContainerStarted","Data":"bada5518c3126cfd3680d8254ad8df68cd22ec0e76eb7b579b3549a3f37cae1f"} Jul 30 23:31:53.048170 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:53.048084 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" Jul 30 23:31:53.064030 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:53.063980 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" podStartSLOduration=2.063961319 podStartE2EDuration="2.063961319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:31:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:31:53.060777859 +0000 UTC m=+2640.264597093" watchObservedRunningTime="2026-07-30 23:31:53.063961319 +0000 UTC m=+2640.267780555" Jul 30 23:31:53.076413 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:53.076375 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" podStartSLOduration=2.076360744 podStartE2EDuration="2.076360744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:31:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:31:53.075768592 +0000 UTC m=+2640.279587839" watchObservedRunningTime="2026-07-30 23:31:53.076360744 +0000 UTC m=+2640.280179978" Jul 30 23:31:53.237968 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:53.237934 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0f095f6-e7cb-4980-a5b0-663efdf68f14" path="/var/lib/kubelet/pods/c0f095f6-e7cb-4980-a5b0-663efdf68f14/volumes" Jul 30 23:31:54.734327 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:31:54.734295 2576 scope.go:117] "RemoveContainer" containerID="1809ef7bc44ef2a231a485bb70baed2d5de9569dd0d2b7a6a08ccfacb8d7c17f" Jul 30 23:32:03.107150 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:03.107061 2576 generic.go:356] "Generic (PLEG): container finished" podID="f848754d-0b20-4311-b285-c7958edd3c1a" containerID="05d6898a03419ef841543724cebc73b316aba416d7f5cfc4338cf21292953041" exitCode=0 Jul 30 23:32:03.107150 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:03.107104 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" event={"ID":"f848754d-0b20-4311-b285-c7958edd3c1a","Type":"ContainerDied","Data":"05d6898a03419ef841543724cebc73b316aba416d7f5cfc4338cf21292953041"} Jul 30 23:32:03.107589 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:03.107480 2576 scope.go:117] "RemoveContainer" containerID="05d6898a03419ef841543724cebc73b316aba416d7f5cfc4338cf21292953041" Jul 30 23:32:03.108534 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:03.108503 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:32:03.108602 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:03.108590 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:32:03.108640 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:03.108631 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:32:04.017333 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:04.017297 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:32:04.059483 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:04.059453 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" Jul 30 23:32:04.060235 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:04.060211 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" Jul 30 23:32:04.115774 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:04.115739 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" event={"ID":"f848754d-0b20-4311-b285-c7958edd3c1a","Type":"ContainerStarted","Data":"e9ba034a3d55d9f9be3a15cb240fbc09fdd3746764a9d794fef5afad997a7778"} Jul 30 23:32:04.991117 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:04.991078 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:32:04.992175 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:04.992147 2576 patch_prober.go:28] interesting pod/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body= Jul 30 23:32:04.992316 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:04.992205 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" podUID="f848754d-0b20-4311-b285-c7958edd3c1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" Jul 30 23:32:05.991231 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:05.991194 2576 patch_prober.go:28] interesting pod/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body= Jul 30 23:32:05.991647 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:05.991251 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" podUID="f848754d-0b20-4311-b285-c7958edd3c1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" Jul 30 23:32:06.991265 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:06.991224 2576 patch_prober.go:28] interesting pod/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body= Jul 30 23:32:06.991685 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:06.991282 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" podUID="f848754d-0b20-4311-b285-c7958edd3c1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" Jul 30 23:32:07.991758 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:07.991723 2576 patch_prober.go:28] interesting pod/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body= Jul 30 23:32:07.992174 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:07.991778 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" podUID="f848754d-0b20-4311-b285-c7958edd3c1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" Jul 30 23:32:08.991672 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:08.991632 2576 patch_prober.go:28] interesting pod/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body= Jul 30 23:32:08.991887 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:08.991724 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" podUID="f848754d-0b20-4311-b285-c7958edd3c1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" Jul 30 23:32:09.995168 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:09.995135 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:32:09.995634 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:09.995433 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:32:09.996206 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:09.996188 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:32:20.679957 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.679889 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg"] Jul 30 23:32:20.683873 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.683835 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.686896 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.686876 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-f6f660-openshift-default-dockercfg-kxllb\"" Jul 30 23:32:20.696541 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.696521 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg"] Jul 30 23:32:20.821176 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.821139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-token\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.821176 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.821175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-data\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.821409 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.821200 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-workload-certs\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.821409 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.821254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c3b3478-7944-4f63-ae65-9bd656e0a745-istiod-ca-cert\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.821409 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.821357 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-envoy\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.821409 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.821388 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-podinfo\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.821571 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.821415 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-credential-socket\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.821571 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.821437 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbj79\" (UniqueName: \"kubernetes.io/projected/4c3b3478-7944-4f63-ae65-9bd656e0a745-kube-api-access-lbj79\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.821571 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.821499 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-workload-socket\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.922836 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.922799 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-token\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.922836 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.922838 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-data\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.923120 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.922897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-workload-certs\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.923120 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.922921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c3b3478-7944-4f63-ae65-9bd656e0a745-istiod-ca-cert\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.923120 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.923002 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-envoy\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.923120 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.923039 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-podinfo\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.923120 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.923079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-credential-socket\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.923120 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.923112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbj79\" (UniqueName: \"kubernetes.io/projected/4c3b3478-7944-4f63-ae65-9bd656e0a745-kube-api-access-lbj79\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.923431 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.923346 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-workload-certs\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.923431 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.923366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-workload-socket\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.923431 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.923404 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-data\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.923575 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.923559 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-credential-socket\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.923631 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.923612 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-workload-socket\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.923690 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.923673 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c3b3478-7944-4f63-ae65-9bd656e0a745-istiod-ca-cert\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.925400 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.925382 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-envoy\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.925606 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.925588 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-podinfo\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.931330 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.931275 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbj79\" (UniqueName: \"kubernetes.io/projected/4c3b3478-7944-4f63-ae65-9bd656e0a745-kube-api-access-lbj79\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.931330 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.931307 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-token\") pod \"e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:20.994691 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:20.994655 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:21.126939 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:21.126910 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg"] Jul 30 23:32:21.128208 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:32:21.128180 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c3b3478_7944_4f63_ae65_9bd656e0a745.slice/crio-d4b4c4f5e6f28aeafd11b4adeeb11e5f948dd6f10ca6978c0f4d4b38264d8d8a WatchSource:0}: Error finding container d4b4c4f5e6f28aeafd11b4adeeb11e5f948dd6f10ca6978c0f4d4b38264d8d8a: Status 404 returned error can't find the container with id d4b4c4f5e6f28aeafd11b4adeeb11e5f948dd6f10ca6978c0f4d4b38264d8d8a Jul 30 23:32:21.130642 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:21.130606 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:32:21.130710 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:21.130693 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:32:21.130778 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:21.130763 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:32:21.207522 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:21.207496 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" event={"ID":"4c3b3478-7944-4f63-ae65-9bd656e0a745","Type":"ContainerStarted","Data":"d4b4c4f5e6f28aeafd11b4adeeb11e5f948dd6f10ca6978c0f4d4b38264d8d8a"} Jul 30 23:32:22.214246 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:22.214207 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" event={"ID":"4c3b3478-7944-4f63-ae65-9bd656e0a745","Type":"ContainerStarted","Data":"2124cc95ce33a5d12978ce6480f9c0c3eeabe45d8a5a724f3bc20fde752f5db5"} Jul 30 23:32:22.237418 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:22.237355 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" podStartSLOduration=2.237334231 podStartE2EDuration="2.237334231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:32:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:32:22.234900525 +0000 UTC m=+2669.438719758" watchObservedRunningTime="2026-07-30 23:32:22.237334231 +0000 UTC m=+2669.441153470" Jul 30 23:32:22.995697 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:22.995659 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:23.000627 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:23.000598 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:23.220136 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:23.220102 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:23.221128 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:23.221109 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:25.936014 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:25.935982 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97"] Jul 30 23:32:25.940184 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:25.940165 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" Jul 30 23:32:25.942657 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:25.942636 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-f6f660\"" Jul 30 23:32:25.942758 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:25.942733 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-f6f660-dockercfg-xpvmg\"" Jul 30 23:32:25.949650 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:25.949625 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97"] Jul 30 23:32:25.979906 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:25.979873 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj"] Jul 30 23:32:25.983283 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:25.983266 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" Jul 30 23:32:25.992251 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:25.992226 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj"] Jul 30 23:32:26.075953 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:26.075922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ttxx\" (UniqueName: \"kubernetes.io/projected/1e9fa7a0-aa15-49f8-8c2f-caf9492e609c-kube-api-access-6ttxx\") pod \"payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97\" (UID: \"1e9fa7a0-aa15-49f8-8c2f-caf9492e609c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" Jul 30 23:32:26.076139 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:26.075958 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlk68\" (UniqueName: \"kubernetes.io/projected/4db53d85-9943-4983-b047-45d4a52ebb92-kube-api-access-tlk68\") pod \"payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj\" (UID: \"4db53d85-9943-4983-b047-45d4a52ebb92\") " pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" Jul 30 23:32:26.076139 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:26.075997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e9fa7a0-aa15-49f8-8c2f-caf9492e609c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97\" (UID: \"1e9fa7a0-aa15-49f8-8c2f-caf9492e609c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" Jul 30 23:32:26.076139 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:26.076075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4db53d85-9943-4983-b047-45d4a52ebb92-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj\" (UID: \"4db53d85-9943-4983-b047-45d4a52ebb92\") " pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" Jul 30 23:32:26.177271 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:26.177231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4db53d85-9943-4983-b047-45d4a52ebb92-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj\" (UID: \"4db53d85-9943-4983-b047-45d4a52ebb92\") " pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" Jul 30 23:32:26.177469 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:26.177356 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ttxx\" (UniqueName: \"kubernetes.io/projected/1e9fa7a0-aa15-49f8-8c2f-caf9492e609c-kube-api-access-6ttxx\") pod \"payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97\" (UID: \"1e9fa7a0-aa15-49f8-8c2f-caf9492e609c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" Jul 30 23:32:26.177469 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:26.177376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlk68\" (UniqueName: \"kubernetes.io/projected/4db53d85-9943-4983-b047-45d4a52ebb92-kube-api-access-tlk68\") pod \"payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj\" (UID: \"4db53d85-9943-4983-b047-45d4a52ebb92\") " pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" Jul 30 23:32:26.177469 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:26.177410 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e9fa7a0-aa15-49f8-8c2f-caf9492e609c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97\" (UID: \"1e9fa7a0-aa15-49f8-8c2f-caf9492e609c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" Jul 30 23:32:26.178062 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:26.178043 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e9fa7a0-aa15-49f8-8c2f-caf9492e609c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97\" (UID: \"1e9fa7a0-aa15-49f8-8c2f-caf9492e609c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" Jul 30 23:32:26.178062 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:26.178056 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4db53d85-9943-4983-b047-45d4a52ebb92-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj\" (UID: \"4db53d85-9943-4983-b047-45d4a52ebb92\") " pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" Jul 30 23:32:26.189955 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:26.189886 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ttxx\" (UniqueName: \"kubernetes.io/projected/1e9fa7a0-aa15-49f8-8c2f-caf9492e609c-kube-api-access-6ttxx\") pod \"payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97\" (UID: \"1e9fa7a0-aa15-49f8-8c2f-caf9492e609c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" Jul 30 23:32:26.190254 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:26.190225 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlk68\" (UniqueName: \"kubernetes.io/projected/4db53d85-9943-4983-b047-45d4a52ebb92-kube-api-access-tlk68\") pod \"payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj\" (UID: \"4db53d85-9943-4983-b047-45d4a52ebb92\") " pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" Jul 30 23:32:26.252886 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:26.252833 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" Jul 30 23:32:26.295449 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:26.295407 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" Jul 30 23:32:26.391643 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:26.391609 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97"] Jul 30 23:32:26.392911 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:32:26.392847 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e9fa7a0_aa15_49f8_8c2f_caf9492e609c.slice/crio-b50216ba21165f0ad7189da667f5c1889320c8c796cd92a519aae3b3af649756 WatchSource:0}: Error finding container b50216ba21165f0ad7189da667f5c1889320c8c796cd92a519aae3b3af649756: Status 404 returned error can't find the container with id b50216ba21165f0ad7189da667f5c1889320c8c796cd92a519aae3b3af649756 Jul 30 23:32:26.452628 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:26.452606 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj"] Jul 30 23:32:26.454086 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:32:26.454059 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db53d85_9943_4983_b047_45d4a52ebb92.slice/crio-a0a42c66667fc599dca5cd36c89395764ec96c11445efbd715aab2feb2a0bc42 WatchSource:0}: Error finding container a0a42c66667fc599dca5cd36c89395764ec96c11445efbd715aab2feb2a0bc42: Status 404 returned error can't find the container with id a0a42c66667fc599dca5cd36c89395764ec96c11445efbd715aab2feb2a0bc42 Jul 30 23:32:27.245347 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:27.245317 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" event={"ID":"4db53d85-9943-4983-b047-45d4a52ebb92","Type":"ContainerStarted","Data":"d51b395e0f118340d03eb85eaa2367b587cbe0b427f4f7274f7a4c5547351bf1"} Jul 30 23:32:27.245800 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:27.245364 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" event={"ID":"4db53d85-9943-4983-b047-45d4a52ebb92","Type":"ContainerStarted","Data":"a0a42c66667fc599dca5cd36c89395764ec96c11445efbd715aab2feb2a0bc42"} Jul 30 23:32:27.245800 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:27.245423 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" Jul 30 23:32:27.247156 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:27.247132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" event={"ID":"1e9fa7a0-aa15-49f8-8c2f-caf9492e609c","Type":"ContainerStarted","Data":"488cf188c8c2e982b7143a568099077413183c762220463804b8814d22c3f4c1"} Jul 30 23:32:27.247286 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:27.247171 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" event={"ID":"1e9fa7a0-aa15-49f8-8c2f-caf9492e609c","Type":"ContainerStarted","Data":"b50216ba21165f0ad7189da667f5c1889320c8c796cd92a519aae3b3af649756"} Jul 30 23:32:27.247286 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:27.247276 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" Jul 30 23:32:27.261266 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:27.261228 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" podStartSLOduration=2.261215315 podStartE2EDuration="2.261215315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:32:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:32:27.260665264 +0000 UTC m=+2674.464484521" watchObservedRunningTime="2026-07-30 23:32:27.261215315 +0000 UTC m=+2674.465034546" Jul 30 23:32:27.275361 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:27.275322 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" podStartSLOduration=2.2753068770000002 podStartE2EDuration="2.275306877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:32:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:32:27.274168074 +0000 UTC m=+2674.477987308" watchObservedRunningTime="2026-07-30 23:32:27.275306877 +0000 UTC m=+2674.479126110" Jul 30 23:32:38.221333 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:38.221244 2576 patch_prober.go:28] interesting pod/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body= Jul 30 23:32:38.221333 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:38.221297 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" podUID="4c3b3478-7944-4f63-ae65-9bd656e0a745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" Jul 30 23:32:38.255827 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:38.255796 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" Jul 30 23:32:38.256050 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:38.256031 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" Jul 30 23:32:38.310448 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:38.310414 2576 generic.go:356] "Generic (PLEG): container finished" podID="4c3b3478-7944-4f63-ae65-9bd656e0a745" containerID="2124cc95ce33a5d12978ce6480f9c0c3eeabe45d8a5a724f3bc20fde752f5db5" exitCode=0 Jul 30 23:32:38.310620 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:38.310486 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" event={"ID":"4c3b3478-7944-4f63-ae65-9bd656e0a745","Type":"ContainerDied","Data":"2124cc95ce33a5d12978ce6480f9c0c3eeabe45d8a5a724f3bc20fde752f5db5"} Jul 30 23:32:38.310930 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:38.310903 2576 scope.go:117] "RemoveContainer" containerID="2124cc95ce33a5d12978ce6480f9c0c3eeabe45d8a5a724f3bc20fde752f5db5" Jul 30 23:32:38.312052 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:38.312020 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:32:38.312142 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:38.312122 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:32:38.312196 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:38.312178 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:32:39.317769 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:39.317735 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" event={"ID":"4c3b3478-7944-4f63-ae65-9bd656e0a745","Type":"ContainerStarted","Data":"c25f42c1beba0ed94e9e89fd8094dafa2524b7760199f6393653bb8352c81629"} Jul 30 23:32:39.995099 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:39.995065 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:39.995314 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:39.995291 2576 patch_prober.go:28] interesting pod/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body= Jul 30 23:32:39.995374 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:39.995341 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" podUID="4c3b3478-7944-4f63-ae65-9bd656e0a745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" Jul 30 23:32:40.995381 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:40.995344 2576 patch_prober.go:28] interesting pod/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body= Jul 30 23:32:40.995905 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:40.995406 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" podUID="4c3b3478-7944-4f63-ae65-9bd656e0a745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" Jul 30 23:32:41.995976 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:41.995941 2576 patch_prober.go:28] interesting pod/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body= Jul 30 23:32:41.996367 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:41.995998 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" podUID="4c3b3478-7944-4f63-ae65-9bd656e0a745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" Jul 30 23:32:42.995521 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:42.995481 2576 patch_prober.go:28] interesting pod/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body= Jul 30 23:32:42.995729 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:42.995550 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" podUID="4c3b3478-7944-4f63-ae65-9bd656e0a745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" Jul 30 23:32:43.995748 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:43.995715 2576 patch_prober.go:28] interesting pod/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body= Jul 30 23:32:43.996159 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:43.995765 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" podUID="4c3b3478-7944-4f63-ae65-9bd656e0a745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" Jul 30 23:32:45.000001 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:44.999922 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:45.000409 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:45.000213 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:45.000801 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:45.000786 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:32:53.401192 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:53.401157 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:32:53.414458 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:32:53.414436 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:37:53.435623 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:37:53.435592 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:37:53.448221 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:37:53.448200 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:40:28.346148 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.346051 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk"] Jul 30 23:40:28.349945 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.349917 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.352441 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.352421 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-05d70d-openshift-default-dockercfg-4b69l\"" Jul 30 23:40:28.361739 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.361714 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk"] Jul 30 23:40:28.481691 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.481652 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-token\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.481894 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.481705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-credential-socket\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.481894 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.481824 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-workload-certs\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.481994 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.481889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-workload-socket\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.481994 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.481923 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-data\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.481994 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.481970 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-podinfo\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.481994 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.481989 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-envoy\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.482134 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.482032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a34766e5-b82c-4950-bab7-c6030ccc158e-istiod-ca-cert\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.482134 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.482067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w8zt\" (UniqueName: \"kubernetes.io/projected/a34766e5-b82c-4950-bab7-c6030ccc158e-kube-api-access-2w8zt\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.583610 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.583573 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-workload-certs\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.583806 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.583615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-workload-socket\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.583806 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.583647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-data\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.583806 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.583684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-podinfo\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.583806 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.583713 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-envoy\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.583806 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.583752 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a34766e5-b82c-4950-bab7-c6030ccc158e-istiod-ca-cert\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.583806 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.583786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w8zt\" (UniqueName: \"kubernetes.io/projected/a34766e5-b82c-4950-bab7-c6030ccc158e-kube-api-access-2w8zt\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.584158 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.583832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-token\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.584158 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.583891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-credential-socket\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.584158 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.584098 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-workload-socket\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.584158 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.584129 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-data\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.584344 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.584182 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-workload-certs\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.584459 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.584429 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-credential-socket\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.584591 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.584515 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a34766e5-b82c-4950-bab7-c6030ccc158e-istiod-ca-cert\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.586082 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.586058 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-envoy\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.586284 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.586266 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-podinfo\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.591454 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.591434 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w8zt\" (UniqueName: \"kubernetes.io/projected/a34766e5-b82c-4950-bab7-c6030ccc158e-kube-api-access-2w8zt\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.591577 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.591560 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-token\") pod \"e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.660699 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.660658 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:28.798734 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.798707 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk"] Jul 30 23:40:28.799506 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:40:28.799477 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda34766e5_b82c_4950_bab7_c6030ccc158e.slice/crio-2029e57a4754e6e6e5c4531984e930de66ec40f3f5a4ccff30b15fa4948a12f6 WatchSource:0}: Error finding container 2029e57a4754e6e6e5c4531984e930de66ec40f3f5a4ccff30b15fa4948a12f6: Status 404 returned error can't find the container with id 2029e57a4754e6e6e5c4531984e930de66ec40f3f5a4ccff30b15fa4948a12f6 Jul 30 23:40:28.801726 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.801691 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:40:28.801806 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.801772 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:40:28.801845 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.801812 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:40:28.851511 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:28.851481 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" event={"ID":"a34766e5-b82c-4950-bab7-c6030ccc158e","Type":"ContainerStarted","Data":"2029e57a4754e6e6e5c4531984e930de66ec40f3f5a4ccff30b15fa4948a12f6"} Jul 30 23:40:29.858332 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:29.858295 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" event={"ID":"a34766e5-b82c-4950-bab7-c6030ccc158e","Type":"ContainerStarted","Data":"234191301d17bb254fa55f1df87c2ce00c277246e30c23e9230fdb86f8f25901"} Jul 30 23:40:29.879736 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:29.879673 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" podStartSLOduration=1.8796590119999999 podStartE2EDuration="1.879659012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:40:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:40:29.877835277 +0000 UTC m=+3157.081654524" watchObservedRunningTime="2026-07-30 23:40:29.879659012 +0000 UTC m=+3157.083478246" Jul 30 23:40:30.661838 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:30.661801 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:30.667251 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:30.667225 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:30.863847 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:30.863817 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:30.864957 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:30.864931 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:33.681674 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:33.681646 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw"] Jul 30 23:40:33.685205 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:33.685180 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" Jul 30 23:40:33.687562 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:33.687539 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-05d70d\"" Jul 30 23:40:33.687671 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:33.687539 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-05d70d-dockercfg-5f5xs\"" Jul 30 23:40:33.695950 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:33.695926 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw"] Jul 30 23:40:33.735239 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:33.735204 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62a15bca-1e4a-4f9f-96ab-8861025ef2ce-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw\" (UID: \"62a15bca-1e4a-4f9f-96ab-8861025ef2ce\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" Jul 30 23:40:33.735418 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:33.735358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nbg2\" (UniqueName: \"kubernetes.io/projected/62a15bca-1e4a-4f9f-96ab-8861025ef2ce-kube-api-access-4nbg2\") pod \"payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw\" (UID: \"62a15bca-1e4a-4f9f-96ab-8861025ef2ce\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" Jul 30 23:40:33.836299 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:33.836266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nbg2\" (UniqueName: \"kubernetes.io/projected/62a15bca-1e4a-4f9f-96ab-8861025ef2ce-kube-api-access-4nbg2\") pod \"payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw\" (UID: \"62a15bca-1e4a-4f9f-96ab-8861025ef2ce\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" Jul 30 23:40:33.836508 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:33.836335 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62a15bca-1e4a-4f9f-96ab-8861025ef2ce-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw\" (UID: \"62a15bca-1e4a-4f9f-96ab-8861025ef2ce\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" Jul 30 23:40:33.837057 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:33.837037 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62a15bca-1e4a-4f9f-96ab-8861025ef2ce-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw\" (UID: \"62a15bca-1e4a-4f9f-96ab-8861025ef2ce\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" Jul 30 23:40:33.843902 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:33.843845 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nbg2\" (UniqueName: \"kubernetes.io/projected/62a15bca-1e4a-4f9f-96ab-8861025ef2ce-kube-api-access-4nbg2\") pod \"payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw\" (UID: \"62a15bca-1e4a-4f9f-96ab-8861025ef2ce\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" Jul 30 23:40:33.998016 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:33.997923 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" Jul 30 23:40:34.135323 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:34.135202 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw"] Jul 30 23:40:34.137620 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:40:34.137588 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62a15bca_1e4a_4f9f_96ab_8861025ef2ce.slice/crio-183c745e233bedeb2e24b798eac13234d6028650b24befae765707b2a7a5db09 WatchSource:0}: Error finding container 183c745e233bedeb2e24b798eac13234d6028650b24befae765707b2a7a5db09: Status 404 returned error can't find the container with id 183c745e233bedeb2e24b798eac13234d6028650b24befae765707b2a7a5db09 Jul 30 23:40:34.888806 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:34.888767 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" event={"ID":"62a15bca-1e4a-4f9f-96ab-8861025ef2ce","Type":"ContainerStarted","Data":"6cabae6bf935fc50f02692b4115a13d7f4a05e802ef0766eae4e0fbe94d0f68a"} Jul 30 23:40:34.889300 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:34.888831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" event={"ID":"62a15bca-1e4a-4f9f-96ab-8861025ef2ce","Type":"ContainerStarted","Data":"183c745e233bedeb2e24b798eac13234d6028650b24befae765707b2a7a5db09"} Jul 30 23:40:34.889300 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:34.889085 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" Jul 30 23:40:34.906068 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:34.906023 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" podStartSLOduration=1.9060075109999999 podStartE2EDuration="1.906007511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:40:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:40:34.904102294 +0000 UTC m=+3162.107921544" watchObservedRunningTime="2026-07-30 23:40:34.906007511 +0000 UTC m=+3162.109826744" Jul 30 23:40:45.865797 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:45.865768 2576 patch_prober.go:28] interesting pod/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body= Jul 30 23:40:45.866171 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:45.865814 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" podUID="a34766e5-b82c-4950-bab7-c6030ccc158e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" Jul 30 23:40:45.897277 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:45.897225 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" Jul 30 23:40:45.953051 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:45.953021 2576 generic.go:356] "Generic (PLEG): container finished" podID="a34766e5-b82c-4950-bab7-c6030ccc158e" containerID="234191301d17bb254fa55f1df87c2ce00c277246e30c23e9230fdb86f8f25901" exitCode=0 Jul 30 23:40:45.953183 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:45.953092 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" event={"ID":"a34766e5-b82c-4950-bab7-c6030ccc158e","Type":"ContainerDied","Data":"234191301d17bb254fa55f1df87c2ce00c277246e30c23e9230fdb86f8f25901"} Jul 30 23:40:45.953520 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:45.953505 2576 scope.go:117] "RemoveContainer" containerID="234191301d17bb254fa55f1df87c2ce00c277246e30c23e9230fdb86f8f25901" Jul 30 23:40:45.954600 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:45.954572 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:40:45.954665 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:45.954651 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:40:45.954703 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:45.954692 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Jul 30 23:40:46.963181 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:46.963149 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" event={"ID":"a34766e5-b82c-4950-bab7-c6030ccc158e","Type":"ContainerStarted","Data":"fec0017776c4cb2b32f646947f5d540a8d0964e6de79b07da8d5298a0eae1835"} Jul 30 23:40:47.661655 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:47.661608 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:47.661881 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:47.661829 2576 patch_prober.go:28] interesting pod/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body= Jul 30 23:40:47.661978 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:47.661914 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" podUID="a34766e5-b82c-4950-bab7-c6030ccc158e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" Jul 30 23:40:48.661409 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:48.661361 2576 patch_prober.go:28] interesting pod/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body= Jul 30 23:40:48.661829 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:48.661437 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" podUID="a34766e5-b82c-4950-bab7-c6030ccc158e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" Jul 30 23:40:49.661128 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:49.661090 2576 patch_prober.go:28] interesting pod/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body= Jul 30 23:40:49.661339 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:49.661156 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" podUID="a34766e5-b82c-4950-bab7-c6030ccc158e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" Jul 30 23:40:50.661810 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:50.661774 2576 patch_prober.go:28] interesting pod/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body= Jul 30 23:40:50.662239 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:50.661829 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" podUID="a34766e5-b82c-4950-bab7-c6030ccc158e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" Jul 30 23:40:51.661098 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:51.661059 2576 patch_prober.go:28] interesting pod/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body= Jul 30 23:40:51.661332 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:51.661117 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" podUID="a34766e5-b82c-4950-bab7-c6030ccc158e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" Jul 30 23:40:52.665640 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:52.665608 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:52.666127 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:52.665898 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:40:52.666959 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:40:52.666940 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:42:25.123171 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:25.123140 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw_62a15bca-1e4a-4f9f-96ab-8861025ef2ce/payload-processing/0.log" Jul 30 23:42:53.470465 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:53.470436 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:42:53.483103 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:53.483080 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cm48d_99d0098f-5c85-48d4-8c74-9507b34e99bc/ovn-acl-logging/0.log" Jul 30 23:42:54.443481 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:54.443445 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6"] Jul 30 23:42:54.447054 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:54.447037 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6" Jul 30 23:42:54.449365 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:54.449342 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52wcc\"" Jul 30 23:42:54.449365 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:54.449360 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 23:42:54.454524 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:54.454498 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6"] Jul 30 23:42:54.602193 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:54.602153 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/323a2ef4-0751-4c8c-805b-39d3c556f5e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6\" (UID: \"323a2ef4-0751-4c8c-805b-39d3c556f5e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6" Jul 30 23:42:54.702781 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:54.702697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/323a2ef4-0751-4c8c-805b-39d3c556f5e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6\" (UID: \"323a2ef4-0751-4c8c-805b-39d3c556f5e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6" Jul 30 23:42:54.703305 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:54.703284 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/323a2ef4-0751-4c8c-805b-39d3c556f5e7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6\" (UID: \"323a2ef4-0751-4c8c-805b-39d3c556f5e7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6" Jul 30 23:42:54.760259 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:54.760225 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6" Jul 30 23:42:54.895503 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:54.895480 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6"] Jul 30 23:42:54.898782 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:42:54.898753 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323a2ef4_0751_4c8c_805b_39d3c556f5e7.slice/crio-4d609c85ca8005ef8009d1e4e6de62260afce964686a03b436a5175c47c27b8b WatchSource:0}: Error finding container 4d609c85ca8005ef8009d1e4e6de62260afce964686a03b436a5175c47c27b8b: Status 404 returned error can't find the container with id 4d609c85ca8005ef8009d1e4e6de62260afce964686a03b436a5175c47c27b8b Jul 30 23:42:55.678323 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:55.678290 2576 generic.go:356] "Generic (PLEG): container finished" podID="323a2ef4-0751-4c8c-805b-39d3c556f5e7" containerID="620c1508990fa3a2b5e8569c591b95425bb0b61895ad8b542a5fd00bfb63d382" exitCode=0 Jul 30 23:42:55.678627 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:55.678351 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6" event={"ID":"323a2ef4-0751-4c8c-805b-39d3c556f5e7","Type":"ContainerDied","Data":"620c1508990fa3a2b5e8569c591b95425bb0b61895ad8b542a5fd00bfb63d382"} Jul 30 23:42:55.678627 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:55.678404 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6" event={"ID":"323a2ef4-0751-4c8c-805b-39d3c556f5e7","Type":"ContainerStarted","Data":"4d609c85ca8005ef8009d1e4e6de62260afce964686a03b436a5175c47c27b8b"} Jul 30 23:42:56.820356 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:56.820332 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6" Jul 30 23:42:56.923475 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:56.923438 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/323a2ef4-0751-4c8c-805b-39d3c556f5e7-maas-api-service-ca\") pod \"323a2ef4-0751-4c8c-805b-39d3c556f5e7\" (UID: \"323a2ef4-0751-4c8c-805b-39d3c556f5e7\") " Jul 30 23:42:56.923823 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:56.923798 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/323a2ef4-0751-4c8c-805b-39d3c556f5e7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "323a2ef4-0751-4c8c-805b-39d3c556f5e7" (UID: "323a2ef4-0751-4c8c-805b-39d3c556f5e7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:42:57.024408 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:57.024329 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/323a2ef4-0751-4c8c-805b-39d3c556f5e7-maas-api-service-ca\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:42:57.690879 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:57.690843 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6" Jul 30 23:42:57.691085 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:57.690889 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6" event={"ID":"323a2ef4-0751-4c8c-805b-39d3c556f5e7","Type":"ContainerDied","Data":"4d609c85ca8005ef8009d1e4e6de62260afce964686a03b436a5175c47c27b8b"} Jul 30 23:42:57.691085 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:42:57.690938 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d609c85ca8005ef8009d1e4e6de62260afce964686a03b436a5175c47c27b8b" Jul 30 23:43:00.800308 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:00.800275 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6"] Jul 30 23:43:00.802599 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:00.802578 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-07db9c-tpnk6"] Jul 30 23:43:01.236378 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:01.236341 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="323a2ef4-0751-4c8c-805b-39d3c556f5e7" path="/var/lib/kubelet/pods/323a2ef4-0751-4c8c-805b-39d3c556f5e7/volumes" Jul 30 23:43:10.814929 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:10.814887 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9"] Jul 30 23:43:10.815366 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:10.815341 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323a2ef4-0751-4c8c-805b-39d3c556f5e7" containerName="revoke-keys" Jul 30 23:43:10.815366 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:10.815363 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="323a2ef4-0751-4c8c-805b-39d3c556f5e7" containerName="revoke-keys" Jul 30 23:43:10.815529 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:10.815454 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="323a2ef4-0751-4c8c-805b-39d3c556f5e7" containerName="revoke-keys" Jul 30 23:43:10.818428 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:10.818412 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9" Jul 30 23:43:10.820920 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:10.820899 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52wcc\"" Jul 30 23:43:10.821016 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:10.820945 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 23:43:10.826947 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:10.826923 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9"] Jul 30 23:43:10.856530 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:10.856496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9\" (UID: \"01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9" Jul 30 23:43:10.957679 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:10.957651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9\" (UID: \"01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9" Jul 30 23:43:10.958388 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:10.958359 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9\" (UID: \"01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9" Jul 30 23:43:11.130102 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:11.130067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9" Jul 30 23:43:11.268313 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:11.268285 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9"] Jul 30 23:43:11.270349 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:43:11.270324 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01c1e69a_b98d_49ae_ae78_c82b7b0f9f6b.slice/crio-13d052108a958938d85c475d36badc96052a5a8966876be23559aa111993436d WatchSource:0}: Error finding container 13d052108a958938d85c475d36badc96052a5a8966876be23559aa111993436d: Status 404 returned error can't find the container with id 13d052108a958938d85c475d36badc96052a5a8966876be23559aa111993436d Jul 30 23:43:11.776074 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:11.775983 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9" event={"ID":"01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b","Type":"ContainerStarted","Data":"cd752dcb3a8b4ba4443e7f1e0b4aff1e03b3460d2406c786f64dd7ec40dfbb7d"} Jul 30 23:43:11.776074 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:11.776041 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9" event={"ID":"01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b","Type":"ContainerStarted","Data":"13d052108a958938d85c475d36badc96052a5a8966876be23559aa111993436d"} Jul 30 23:43:11.790003 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:11.789958 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9" podStartSLOduration=1.789942911 podStartE2EDuration="1.789942911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:43:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:43:11.788991868 +0000 UTC m=+3318.992811125" watchObservedRunningTime="2026-07-30 23:43:11.789942911 +0000 UTC m=+3318.993762145" Jul 30 23:43:12.783015 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:12.782982 2576 generic.go:356] "Generic (PLEG): container finished" podID="01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b" containerID="cd752dcb3a8b4ba4443e7f1e0b4aff1e03b3460d2406c786f64dd7ec40dfbb7d" exitCode=0 Jul 30 23:43:12.783411 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:12.783068 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9" event={"ID":"01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b","Type":"ContainerDied","Data":"cd752dcb3a8b4ba4443e7f1e0b4aff1e03b3460d2406c786f64dd7ec40dfbb7d"} Jul 30 23:43:13.926526 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:13.926499 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9" Jul 30 23:43:13.985027 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:13.984995 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b-maas-api-service-ca\") pod \"01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b\" (UID: \"01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b\") " Jul 30 23:43:13.985400 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:13.985370 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b" (UID: "01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:43:14.085792 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:14.085709 2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b-maas-api-service-ca\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:43:14.795380 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:14.795345 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9" event={"ID":"01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b","Type":"ContainerDied","Data":"13d052108a958938d85c475d36badc96052a5a8966876be23559aa111993436d"} Jul 30 23:43:14.795380 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:14.795366 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9" Jul 30 23:43:14.795559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:14.795394 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13d052108a958938d85c475d36badc96052a5a8966876be23559aa111993436d" Jul 30 23:43:26.437482 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.437449 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw"] Jul 30 23:43:26.438094 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.437664 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" podUID="62a15bca-1e4a-4f9f-96ab-8861025ef2ce" containerName="payload-processing" containerID="cri-o://6cabae6bf935fc50f02692b4115a13d7f4a05e802ef0766eae4e0fbe94d0f68a" gracePeriod=30 Jul 30 23:43:26.598676 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.598627 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9"] Jul 30 23:43:26.602426 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.602379 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-05d70d-zggr9"] Jul 30 23:43:26.729342 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.729317 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" Jul 30 23:43:26.805261 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.805217 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nbg2\" (UniqueName: \"kubernetes.io/projected/62a15bca-1e4a-4f9f-96ab-8861025ef2ce-kube-api-access-4nbg2\") pod \"62a15bca-1e4a-4f9f-96ab-8861025ef2ce\" (UID: \"62a15bca-1e4a-4f9f-96ab-8861025ef2ce\") " Jul 30 23:43:26.805444 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.805300 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62a15bca-1e4a-4f9f-96ab-8861025ef2ce-plugins-config-volume\") pod \"62a15bca-1e4a-4f9f-96ab-8861025ef2ce\" (UID: \"62a15bca-1e4a-4f9f-96ab-8861025ef2ce\") " Jul 30 23:43:26.805701 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.805677 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62a15bca-1e4a-4f9f-96ab-8861025ef2ce-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "62a15bca-1e4a-4f9f-96ab-8861025ef2ce" (UID: "62a15bca-1e4a-4f9f-96ab-8861025ef2ce"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:43:26.807290 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.807266 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62a15bca-1e4a-4f9f-96ab-8861025ef2ce-kube-api-access-4nbg2" (OuterVolumeSpecName: "kube-api-access-4nbg2") pod "62a15bca-1e4a-4f9f-96ab-8861025ef2ce" (UID: "62a15bca-1e4a-4f9f-96ab-8861025ef2ce"). InnerVolumeSpecName "kube-api-access-4nbg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:43:26.860593 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.860564 2576 generic.go:356] "Generic (PLEG): container finished" podID="62a15bca-1e4a-4f9f-96ab-8861025ef2ce" containerID="6cabae6bf935fc50f02692b4115a13d7f4a05e802ef0766eae4e0fbe94d0f68a" exitCode=0 Jul 30 23:43:26.860714 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.860608 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" Jul 30 23:43:26.860714 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.860650 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" event={"ID":"62a15bca-1e4a-4f9f-96ab-8861025ef2ce","Type":"ContainerDied","Data":"6cabae6bf935fc50f02692b4115a13d7f4a05e802ef0766eae4e0fbe94d0f68a"} Jul 30 23:43:26.860714 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.860703 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw" event={"ID":"62a15bca-1e4a-4f9f-96ab-8861025ef2ce","Type":"ContainerDied","Data":"183c745e233bedeb2e24b798eac13234d6028650b24befae765707b2a7a5db09"} Jul 30 23:43:26.860815 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.860725 2576 scope.go:117] "RemoveContainer" containerID="6cabae6bf935fc50f02692b4115a13d7f4a05e802ef0766eae4e0fbe94d0f68a" Jul 30 23:43:26.869821 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.869806 2576 scope.go:117] "RemoveContainer" containerID="6cabae6bf935fc50f02692b4115a13d7f4a05e802ef0766eae4e0fbe94d0f68a" Jul 30 23:43:26.870093 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:43:26.870077 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cabae6bf935fc50f02692b4115a13d7f4a05e802ef0766eae4e0fbe94d0f68a\": container with ID starting with 6cabae6bf935fc50f02692b4115a13d7f4a05e802ef0766eae4e0fbe94d0f68a not found: ID does not exist" containerID="6cabae6bf935fc50f02692b4115a13d7f4a05e802ef0766eae4e0fbe94d0f68a" Jul 30 23:43:26.870153 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.870101 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cabae6bf935fc50f02692b4115a13d7f4a05e802ef0766eae4e0fbe94d0f68a"} err="failed to get container status \"6cabae6bf935fc50f02692b4115a13d7f4a05e802ef0766eae4e0fbe94d0f68a\": rpc error: code = NotFound desc = could not find container \"6cabae6bf935fc50f02692b4115a13d7f4a05e802ef0766eae4e0fbe94d0f68a\": container with ID starting with 6cabae6bf935fc50f02692b4115a13d7f4a05e802ef0766eae4e0fbe94d0f68a not found: ID does not exist" Jul 30 23:43:26.881841 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.881822 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw"] Jul 30 23:43:26.885317 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.885296 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-05d70d-7f755b587d-fbhtw"] Jul 30 23:43:26.906499 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.906479 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nbg2\" (UniqueName: \"kubernetes.io/projected/62a15bca-1e4a-4f9f-96ab-8861025ef2ce-kube-api-access-4nbg2\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:43:26.906571 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:26.906499 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62a15bca-1e4a-4f9f-96ab-8861025ef2ce-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:43:27.236878 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:27.236828 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b" path="/var/lib/kubelet/pods/01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b/volumes" Jul 30 23:43:27.237235 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:27.237220 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62a15bca-1e4a-4f9f-96ab-8861025ef2ce" path="/var/lib/kubelet/pods/62a15bca-1e4a-4f9f-96ab-8861025ef2ce/volumes" Jul 30 23:43:54.909417 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:54.909372 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk"] Jul 30 23:43:54.909843 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:43:54.909620 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" podUID="a34766e5-b82c-4950-bab7-c6030ccc158e" containerName="istio-proxy" containerID="cri-o://fec0017776c4cb2b32f646947f5d540a8d0964e6de79b07da8d5298a0eae1835" gracePeriod=30 Jul 30 23:44:00.055030 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.054997 2576 generic.go:356] "Generic (PLEG): container finished" podID="a34766e5-b82c-4950-bab7-c6030ccc158e" containerID="fec0017776c4cb2b32f646947f5d540a8d0964e6de79b07da8d5298a0eae1835" exitCode=0 Jul 30 23:44:00.055447 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.055066 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" event={"ID":"a34766e5-b82c-4950-bab7-c6030ccc158e","Type":"ContainerDied","Data":"fec0017776c4cb2b32f646947f5d540a8d0964e6de79b07da8d5298a0eae1835"} Jul 30 23:44:00.055447 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.055140 2576 scope.go:117] "RemoveContainer" containerID="234191301d17bb254fa55f1df87c2ce00c277246e30c23e9230fdb86f8f25901" Jul 30 23:44:00.168119 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.168094 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:44:00.206461 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.206397 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-podinfo\") pod \"a34766e5-b82c-4950-bab7-c6030ccc158e\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " Jul 30 23:44:00.206461 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.206435 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-data\") pod \"a34766e5-b82c-4950-bab7-c6030ccc158e\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " Jul 30 23:44:00.206461 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.206456 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-token\") pod \"a34766e5-b82c-4950-bab7-c6030ccc158e\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " Jul 30 23:44:00.206720 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.206486 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a34766e5-b82c-4950-bab7-c6030ccc158e-istiod-ca-cert\") pod \"a34766e5-b82c-4950-bab7-c6030ccc158e\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " Jul 30 23:44:00.206720 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.206539 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-workload-socket\") pod \"a34766e5-b82c-4950-bab7-c6030ccc158e\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " Jul 30 23:44:00.206720 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.206591 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-credential-socket\") pod \"a34766e5-b82c-4950-bab7-c6030ccc158e\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " Jul 30 23:44:00.206720 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.206658 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-workload-certs\") pod \"a34766e5-b82c-4950-bab7-c6030ccc158e\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " Jul 30 23:44:00.206720 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.206694 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-envoy\") pod \"a34766e5-b82c-4950-bab7-c6030ccc158e\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " Jul 30 23:44:00.207019 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.206727 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w8zt\" (UniqueName: \"kubernetes.io/projected/a34766e5-b82c-4950-bab7-c6030ccc158e-kube-api-access-2w8zt\") pod \"a34766e5-b82c-4950-bab7-c6030ccc158e\" (UID: \"a34766e5-b82c-4950-bab7-c6030ccc158e\") " Jul 30 23:44:00.207019 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.206920 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a34766e5-b82c-4950-bab7-c6030ccc158e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a34766e5-b82c-4950-bab7-c6030ccc158e" (UID: "a34766e5-b82c-4950-bab7-c6030ccc158e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:44:00.207019 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.206914 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a34766e5-b82c-4950-bab7-c6030ccc158e" (UID: "a34766e5-b82c-4950-bab7-c6030ccc158e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:44:00.207188 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.207016 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a34766e5-b82c-4950-bab7-c6030ccc158e" (UID: "a34766e5-b82c-4950-bab7-c6030ccc158e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:44:00.207188 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.207172 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a34766e5-b82c-4950-bab7-c6030ccc158e-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:00.207188 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.207177 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-data" (OuterVolumeSpecName: "istio-data") pod "a34766e5-b82c-4950-bab7-c6030ccc158e" (UID: "a34766e5-b82c-4950-bab7-c6030ccc158e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:44:00.207358 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.207193 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:00.207358 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.207207 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:00.207358 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.207271 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a34766e5-b82c-4950-bab7-c6030ccc158e" (UID: "a34766e5-b82c-4950-bab7-c6030ccc158e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:44:00.208700 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.208668 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a34766e5-b82c-4950-bab7-c6030ccc158e" (UID: "a34766e5-b82c-4950-bab7-c6030ccc158e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 23:44:00.208884 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.208848 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a34766e5-b82c-4950-bab7-c6030ccc158e" (UID: "a34766e5-b82c-4950-bab7-c6030ccc158e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:44:00.208961 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.208897 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a34766e5-b82c-4950-bab7-c6030ccc158e-kube-api-access-2w8zt" (OuterVolumeSpecName: "kube-api-access-2w8zt") pod "a34766e5-b82c-4950-bab7-c6030ccc158e" (UID: "a34766e5-b82c-4950-bab7-c6030ccc158e"). InnerVolumeSpecName "kube-api-access-2w8zt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:44:00.209110 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.209087 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-token" (OuterVolumeSpecName: "istio-token") pod "a34766e5-b82c-4950-bab7-c6030ccc158e" (UID: "a34766e5-b82c-4950-bab7-c6030ccc158e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:44:00.308006 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.307965 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:00.308006 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.308000 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:00.308178 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.308014 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w8zt\" (UniqueName: \"kubernetes.io/projected/a34766e5-b82c-4950-bab7-c6030ccc158e-kube-api-access-2w8zt\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:00.308178 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.308028 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:00.308178 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.308041 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:00.308178 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:00.308054 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a34766e5-b82c-4950-bab7-c6030ccc158e-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:01.062669 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:01.062634 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" event={"ID":"a34766e5-b82c-4950-bab7-c6030ccc158e","Type":"ContainerDied","Data":"2029e57a4754e6e6e5c4531984e930de66ec40f3f5a4ccff30b15fa4948a12f6"} Jul 30 23:44:01.063142 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:01.062695 2576 scope.go:117] "RemoveContainer" containerID="fec0017776c4cb2b32f646947f5d540a8d0964e6de79b07da8d5298a0eae1835" Jul 30 23:44:01.063142 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:01.062645 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk" Jul 30 23:44:01.084990 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:01.084964 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk"] Jul 30 23:44:01.091573 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:01.091548 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-05d70d-openshift-default-5ff66587b6-z4rmk"] Jul 30 23:44:01.236461 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:01.236430 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a34766e5-b82c-4950-bab7-c6030ccc158e" path="/var/lib/kubelet/pods/a34766e5-b82c-4950-bab7-c6030ccc158e/volumes" Jul 30 23:44:23.183979 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.183946 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h"] Jul 30 23:44:23.184448 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.184194 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" podUID="3cf10e73-cc6f-45d8-a082-65e464cdcb54" containerName="payload-processing" containerID="cri-o://ae85ab5ba2baa04fe53b0e55aca20712083bc4ea78c94a53c41f4254d4b92df4" gracePeriod=30 Jul 30 23:44:23.193348 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.193323 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz"] Jul 30 23:44:23.193664 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.193553 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" podUID="e2120ac9-a7e5-4544-883b-2b09931ff9b2" containerName="payload-pre-processing" containerID="cri-o://dea67317985c4d5d0002b29ce084d3e6f68dc75e5b42e305def9cc91a5ecf5df" gracePeriod=30 Jul 30 23:44:23.456100 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.456079 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" Jul 30 23:44:23.481269 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.481237 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" Jul 30 23:44:23.523599 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.523564 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf10e73-cc6f-45d8-a082-65e464cdcb54-plugins-config-volume\") pod \"3cf10e73-cc6f-45d8-a082-65e464cdcb54\" (UID: \"3cf10e73-cc6f-45d8-a082-65e464cdcb54\") " Jul 30 23:44:23.523779 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.523626 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8gs4\" (UniqueName: \"kubernetes.io/projected/3cf10e73-cc6f-45d8-a082-65e464cdcb54-kube-api-access-w8gs4\") pod \"3cf10e73-cc6f-45d8-a082-65e464cdcb54\" (UID: \"3cf10e73-cc6f-45d8-a082-65e464cdcb54\") " Jul 30 23:44:23.524035 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.524003 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cf10e73-cc6f-45d8-a082-65e464cdcb54-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3cf10e73-cc6f-45d8-a082-65e464cdcb54" (UID: "3cf10e73-cc6f-45d8-a082-65e464cdcb54"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:44:23.525930 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.525906 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf10e73-cc6f-45d8-a082-65e464cdcb54-kube-api-access-w8gs4" (OuterVolumeSpecName: "kube-api-access-w8gs4") pod "3cf10e73-cc6f-45d8-a082-65e464cdcb54" (UID: "3cf10e73-cc6f-45d8-a082-65e464cdcb54"). InnerVolumeSpecName "kube-api-access-w8gs4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:44:23.624643 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.624620 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66fmc\" (UniqueName: \"kubernetes.io/projected/e2120ac9-a7e5-4544-883b-2b09931ff9b2-kube-api-access-66fmc\") pod \"e2120ac9-a7e5-4544-883b-2b09931ff9b2\" (UID: \"e2120ac9-a7e5-4544-883b-2b09931ff9b2\") " Jul 30 23:44:23.624776 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.624722 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2120ac9-a7e5-4544-883b-2b09931ff9b2-plugins-config-volume\") pod \"e2120ac9-a7e5-4544-883b-2b09931ff9b2\" (UID: \"e2120ac9-a7e5-4544-883b-2b09931ff9b2\") " Jul 30 23:44:23.624975 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.624955 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf10e73-cc6f-45d8-a082-65e464cdcb54-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:23.625047 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.624980 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8gs4\" (UniqueName: \"kubernetes.io/projected/3cf10e73-cc6f-45d8-a082-65e464cdcb54-kube-api-access-w8gs4\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:23.625115 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.625098 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2120ac9-a7e5-4544-883b-2b09931ff9b2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e2120ac9-a7e5-4544-883b-2b09931ff9b2" (UID: "e2120ac9-a7e5-4544-883b-2b09931ff9b2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:44:23.626609 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.626585 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2120ac9-a7e5-4544-883b-2b09931ff9b2-kube-api-access-66fmc" (OuterVolumeSpecName: "kube-api-access-66fmc") pod "e2120ac9-a7e5-4544-883b-2b09931ff9b2" (UID: "e2120ac9-a7e5-4544-883b-2b09931ff9b2"). InnerVolumeSpecName "kube-api-access-66fmc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:44:23.725774 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.725708 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66fmc\" (UniqueName: \"kubernetes.io/projected/e2120ac9-a7e5-4544-883b-2b09931ff9b2-kube-api-access-66fmc\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:23.725774 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:23.725730 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2120ac9-a7e5-4544-883b-2b09931ff9b2-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:24.195374 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.195333 2576 generic.go:356] "Generic (PLEG): container finished" podID="e2120ac9-a7e5-4544-883b-2b09931ff9b2" containerID="dea67317985c4d5d0002b29ce084d3e6f68dc75e5b42e305def9cc91a5ecf5df" exitCode=0 Jul 30 23:44:24.195374 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.195380 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" Jul 30 23:44:24.195896 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.195381 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" event={"ID":"e2120ac9-a7e5-4544-883b-2b09931ff9b2","Type":"ContainerDied","Data":"dea67317985c4d5d0002b29ce084d3e6f68dc75e5b42e305def9cc91a5ecf5df"} Jul 30 23:44:24.195896 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.195441 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz" event={"ID":"e2120ac9-a7e5-4544-883b-2b09931ff9b2","Type":"ContainerDied","Data":"bada5518c3126cfd3680d8254ad8df68cd22ec0e76eb7b579b3549a3f37cae1f"} Jul 30 23:44:24.195896 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.195467 2576 scope.go:117] "RemoveContainer" containerID="dea67317985c4d5d0002b29ce084d3e6f68dc75e5b42e305def9cc91a5ecf5df" Jul 30 23:44:24.197013 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.196988 2576 generic.go:356] "Generic (PLEG): container finished" podID="3cf10e73-cc6f-45d8-a082-65e464cdcb54" containerID="ae85ab5ba2baa04fe53b0e55aca20712083bc4ea78c94a53c41f4254d4b92df4" exitCode=0 Jul 30 23:44:24.197134 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.197039 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" Jul 30 23:44:24.197134 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.197053 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" event={"ID":"3cf10e73-cc6f-45d8-a082-65e464cdcb54","Type":"ContainerDied","Data":"ae85ab5ba2baa04fe53b0e55aca20712083bc4ea78c94a53c41f4254d4b92df4"} Jul 30 23:44:24.197134 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.197096 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h" event={"ID":"3cf10e73-cc6f-45d8-a082-65e464cdcb54","Type":"ContainerDied","Data":"b22c0f03174d0c95bad6e26788343097ad69623f8ce64b7e8b2779fa1c9f78f4"} Jul 30 23:44:24.211358 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.211342 2576 scope.go:117] "RemoveContainer" containerID="dea67317985c4d5d0002b29ce084d3e6f68dc75e5b42e305def9cc91a5ecf5df" Jul 30 23:44:24.211589 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:44:24.211573 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dea67317985c4d5d0002b29ce084d3e6f68dc75e5b42e305def9cc91a5ecf5df\": container with ID starting with dea67317985c4d5d0002b29ce084d3e6f68dc75e5b42e305def9cc91a5ecf5df not found: ID does not exist" containerID="dea67317985c4d5d0002b29ce084d3e6f68dc75e5b42e305def9cc91a5ecf5df" Jul 30 23:44:24.211655 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.211595 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea67317985c4d5d0002b29ce084d3e6f68dc75e5b42e305def9cc91a5ecf5df"} err="failed to get container status \"dea67317985c4d5d0002b29ce084d3e6f68dc75e5b42e305def9cc91a5ecf5df\": rpc error: code = NotFound desc = could not find container \"dea67317985c4d5d0002b29ce084d3e6f68dc75e5b42e305def9cc91a5ecf5df\": container with ID starting with dea67317985c4d5d0002b29ce084d3e6f68dc75e5b42e305def9cc91a5ecf5df not found: ID does not exist" Jul 30 23:44:24.211655 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.211611 2576 scope.go:117] "RemoveContainer" containerID="ae85ab5ba2baa04fe53b0e55aca20712083bc4ea78c94a53c41f4254d4b92df4" Jul 30 23:44:24.221450 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.221434 2576 scope.go:117] "RemoveContainer" containerID="ae85ab5ba2baa04fe53b0e55aca20712083bc4ea78c94a53c41f4254d4b92df4" Jul 30 23:44:24.221710 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:44:24.221692 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae85ab5ba2baa04fe53b0e55aca20712083bc4ea78c94a53c41f4254d4b92df4\": container with ID starting with ae85ab5ba2baa04fe53b0e55aca20712083bc4ea78c94a53c41f4254d4b92df4 not found: ID does not exist" containerID="ae85ab5ba2baa04fe53b0e55aca20712083bc4ea78c94a53c41f4254d4b92df4" Jul 30 23:44:24.221776 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.221719 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae85ab5ba2baa04fe53b0e55aca20712083bc4ea78c94a53c41f4254d4b92df4"} err="failed to get container status \"ae85ab5ba2baa04fe53b0e55aca20712083bc4ea78c94a53c41f4254d4b92df4\": rpc error: code = NotFound desc = could not find container \"ae85ab5ba2baa04fe53b0e55aca20712083bc4ea78c94a53c41f4254d4b92df4\": container with ID starting with ae85ab5ba2baa04fe53b0e55aca20712083bc4ea78c94a53c41f4254d4b92df4 not found: ID does not exist" Jul 30 23:44:24.224772 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.224752 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz"] Jul 30 23:44:24.229195 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.229175 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-5049e4-869ff69d68-hf7bz"] Jul 30 23:44:24.239537 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.239515 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h"] Jul 30 23:44:24.241659 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:24.241642 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-5049e4-7fdd684f9d-6s57h"] Jul 30 23:44:25.237978 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:25.237938 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cf10e73-cc6f-45d8-a082-65e464cdcb54" path="/var/lib/kubelet/pods/3cf10e73-cc6f-45d8-a082-65e464cdcb54/volumes" Jul 30 23:44:25.238462 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:25.238422 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2120ac9-a7e5-4544-883b-2b09931ff9b2" path="/var/lib/kubelet/pods/e2120ac9-a7e5-4544-883b-2b09931ff9b2/volumes" Jul 30 23:44:29.845738 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:29.845703 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k"] Jul 30 23:44:29.846251 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:29.845925 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" podUID="f848754d-0b20-4311-b285-c7958edd3c1a" containerName="istio-proxy" containerID="cri-o://e9ba034a3d55d9f9be3a15cb240fbc09fdd3746764a9d794fef5afad997a7778" gracePeriod=30 Jul 30 23:44:35.090255 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.090229 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:44:35.227635 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.227608 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f848754d-0b20-4311-b285-c7958edd3c1a-istiod-ca-cert\") pod \"f848754d-0b20-4311-b285-c7958edd3c1a\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " Jul 30 23:44:35.227797 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.227659 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-credential-socket\") pod \"f848754d-0b20-4311-b285-c7958edd3c1a\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " Jul 30 23:44:35.227797 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.227690 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f848754d-0b20-4311-b285-c7958edd3c1a-istio-podinfo\") pod \"f848754d-0b20-4311-b285-c7958edd3c1a\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " Jul 30 23:44:35.227927 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.227886 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-istio-data\") pod \"f848754d-0b20-4311-b285-c7958edd3c1a\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " Jul 30 23:44:35.227971 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.227949 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c4vh\" (UniqueName: \"kubernetes.io/projected/f848754d-0b20-4311-b285-c7958edd3c1a-kube-api-access-9c4vh\") pod \"f848754d-0b20-4311-b285-c7958edd3c1a\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " Jul 30 23:44:35.228017 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.227991 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-workload-socket\") pod \"f848754d-0b20-4311-b285-c7958edd3c1a\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " Jul 30 23:44:35.228017 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.227997 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f848754d-0b20-4311-b285-c7958edd3c1a" (UID: "f848754d-0b20-4311-b285-c7958edd3c1a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:44:35.228124 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.228017 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-workload-certs\") pod \"f848754d-0b20-4311-b285-c7958edd3c1a\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " Jul 30 23:44:35.228124 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.228049 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-istio-envoy\") pod \"f848754d-0b20-4311-b285-c7958edd3c1a\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " Jul 30 23:44:35.228124 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.228092 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-istio-data" (OuterVolumeSpecName: "istio-data") pod "f848754d-0b20-4311-b285-c7958edd3c1a" (UID: "f848754d-0b20-4311-b285-c7958edd3c1a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:44:35.228289 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.228145 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f848754d-0b20-4311-b285-c7958edd3c1a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f848754d-0b20-4311-b285-c7958edd3c1a" (UID: "f848754d-0b20-4311-b285-c7958edd3c1a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:44:35.228289 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.228156 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f848754d-0b20-4311-b285-c7958edd3c1a-istio-token\") pod \"f848754d-0b20-4311-b285-c7958edd3c1a\" (UID: \"f848754d-0b20-4311-b285-c7958edd3c1a\") " Jul 30 23:44:35.228289 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.228232 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f848754d-0b20-4311-b285-c7958edd3c1a" (UID: "f848754d-0b20-4311-b285-c7958edd3c1a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:44:35.228460 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.228407 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f848754d-0b20-4311-b285-c7958edd3c1a-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:35.228460 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.228425 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:35.228460 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.228440 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:35.228460 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.228437 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f848754d-0b20-4311-b285-c7958edd3c1a" (UID: "f848754d-0b20-4311-b285-c7958edd3c1a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:44:35.228460 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.228454 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:35.229956 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.229933 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f848754d-0b20-4311-b285-c7958edd3c1a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f848754d-0b20-4311-b285-c7958edd3c1a" (UID: "f848754d-0b20-4311-b285-c7958edd3c1a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 23:44:35.230312 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.230281 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f848754d-0b20-4311-b285-c7958edd3c1a" (UID: "f848754d-0b20-4311-b285-c7958edd3c1a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:44:35.230403 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.230310 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f848754d-0b20-4311-b285-c7958edd3c1a-istio-token" (OuterVolumeSpecName: "istio-token") pod "f848754d-0b20-4311-b285-c7958edd3c1a" (UID: "f848754d-0b20-4311-b285-c7958edd3c1a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:44:35.230403 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.230336 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f848754d-0b20-4311-b285-c7958edd3c1a-kube-api-access-9c4vh" (OuterVolumeSpecName: "kube-api-access-9c4vh") pod "f848754d-0b20-4311-b285-c7958edd3c1a" (UID: "f848754d-0b20-4311-b285-c7958edd3c1a"). InnerVolumeSpecName "kube-api-access-9c4vh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:44:35.259640 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.259614 2576 generic.go:356] "Generic (PLEG): container finished" podID="f848754d-0b20-4311-b285-c7958edd3c1a" containerID="e9ba034a3d55d9f9be3a15cb240fbc09fdd3746764a9d794fef5afad997a7778" exitCode=0 Jul 30 23:44:35.259741 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.259648 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" Jul 30 23:44:35.259741 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.259691 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" event={"ID":"f848754d-0b20-4311-b285-c7958edd3c1a","Type":"ContainerDied","Data":"e9ba034a3d55d9f9be3a15cb240fbc09fdd3746764a9d794fef5afad997a7778"} Jul 30 23:44:35.260124 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.259745 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k" event={"ID":"f848754d-0b20-4311-b285-c7958edd3c1a","Type":"ContainerDied","Data":"d14572c3c2ff67bcf9d55672fccf81f0f3e1602e20b394892e6e370c9a942149"} Jul 30 23:44:35.260124 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.259769 2576 scope.go:117] "RemoveContainer" containerID="e9ba034a3d55d9f9be3a15cb240fbc09fdd3746764a9d794fef5afad997a7778" Jul 30 23:44:35.268409 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.268394 2576 scope.go:117] "RemoveContainer" containerID="05d6898a03419ef841543724cebc73b316aba416d7f5cfc4338cf21292953041" Jul 30 23:44:35.276940 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.276926 2576 scope.go:117] "RemoveContainer" containerID="e9ba034a3d55d9f9be3a15cb240fbc09fdd3746764a9d794fef5afad997a7778" Jul 30 23:44:35.277207 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:44:35.277181 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9ba034a3d55d9f9be3a15cb240fbc09fdd3746764a9d794fef5afad997a7778\": container with ID starting with e9ba034a3d55d9f9be3a15cb240fbc09fdd3746764a9d794fef5afad997a7778 not found: ID does not exist" containerID="e9ba034a3d55d9f9be3a15cb240fbc09fdd3746764a9d794fef5afad997a7778" Jul 30 23:44:35.277301 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.277220 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9ba034a3d55d9f9be3a15cb240fbc09fdd3746764a9d794fef5afad997a7778"} err="failed to get container status \"e9ba034a3d55d9f9be3a15cb240fbc09fdd3746764a9d794fef5afad997a7778\": rpc error: code = NotFound desc = could not find container \"e9ba034a3d55d9f9be3a15cb240fbc09fdd3746764a9d794fef5afad997a7778\": container with ID starting with e9ba034a3d55d9f9be3a15cb240fbc09fdd3746764a9d794fef5afad997a7778 not found: ID does not exist" Jul 30 23:44:35.277301 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.277242 2576 scope.go:117] "RemoveContainer" containerID="05d6898a03419ef841543724cebc73b316aba416d7f5cfc4338cf21292953041" Jul 30 23:44:35.277503 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:44:35.277486 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05d6898a03419ef841543724cebc73b316aba416d7f5cfc4338cf21292953041\": container with ID starting with 05d6898a03419ef841543724cebc73b316aba416d7f5cfc4338cf21292953041 not found: ID does not exist" containerID="05d6898a03419ef841543724cebc73b316aba416d7f5cfc4338cf21292953041" Jul 30 23:44:35.277550 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.277510 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d6898a03419ef841543724cebc73b316aba416d7f5cfc4338cf21292953041"} err="failed to get container status \"05d6898a03419ef841543724cebc73b316aba416d7f5cfc4338cf21292953041\": rpc error: code = NotFound desc = could not find container \"05d6898a03419ef841543724cebc73b316aba416d7f5cfc4338cf21292953041\": container with ID starting with 05d6898a03419ef841543724cebc73b316aba416d7f5cfc4338cf21292953041 not found: ID does not exist" Jul 30 23:44:35.278265 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.278246 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k"] Jul 30 23:44:35.283710 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.283691 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-5049e4-openshift-default-79f6bbfcdd-v9k4k"] Jul 30 23:44:35.329938 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.329914 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f848754d-0b20-4311-b285-c7958edd3c1a-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:35.330059 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.329942 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c4vh\" (UniqueName: \"kubernetes.io/projected/f848754d-0b20-4311-b285-c7958edd3c1a-kube-api-access-9c4vh\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:35.330059 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.329956 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:35.330059 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.329970 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f848754d-0b20-4311-b285-c7958edd3c1a-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:35.330059 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:35.329983 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f848754d-0b20-4311-b285-c7958edd3c1a-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:37.235797 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:37.235765 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f848754d-0b20-4311-b285-c7958edd3c1a" path="/var/lib/kubelet/pods/f848754d-0b20-4311-b285-c7958edd3c1a/volumes" Jul 30 23:44:40.664195 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:40.664163 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj"] Jul 30 23:44:40.664662 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:40.664516 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" podUID="4db53d85-9943-4983-b047-45d4a52ebb92" containerName="payload-processing" containerID="cri-o://d51b395e0f118340d03eb85eaa2367b587cbe0b427f4f7274f7a4c5547351bf1" gracePeriod=30 Jul 30 23:44:40.671184 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:40.671106 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97"] Jul 30 23:44:40.671368 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:40.671335 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" podUID="1e9fa7a0-aa15-49f8-8c2f-caf9492e609c" containerName="payload-pre-processing" containerID="cri-o://488cf188c8c2e982b7143a568099077413183c762220463804b8814d22c3f4c1" gracePeriod=30 Jul 30 23:44:40.951492 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:40.951470 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" Jul 30 23:44:40.954336 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:40.954318 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" Jul 30 23:44:41.079232 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.079199 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4db53d85-9943-4983-b047-45d4a52ebb92-plugins-config-volume\") pod \"4db53d85-9943-4983-b047-45d4a52ebb92\" (UID: \"4db53d85-9943-4983-b047-45d4a52ebb92\") " Jul 30 23:44:41.079424 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.079243 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlk68\" (UniqueName: \"kubernetes.io/projected/4db53d85-9943-4983-b047-45d4a52ebb92-kube-api-access-tlk68\") pod \"4db53d85-9943-4983-b047-45d4a52ebb92\" (UID: \"4db53d85-9943-4983-b047-45d4a52ebb92\") " Jul 30 23:44:41.079424 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.079270 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ttxx\" (UniqueName: \"kubernetes.io/projected/1e9fa7a0-aa15-49f8-8c2f-caf9492e609c-kube-api-access-6ttxx\") pod \"1e9fa7a0-aa15-49f8-8c2f-caf9492e609c\" (UID: \"1e9fa7a0-aa15-49f8-8c2f-caf9492e609c\") " Jul 30 23:44:41.079424 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.079286 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e9fa7a0-aa15-49f8-8c2f-caf9492e609c-plugins-config-volume\") pod \"1e9fa7a0-aa15-49f8-8c2f-caf9492e609c\" (UID: \"1e9fa7a0-aa15-49f8-8c2f-caf9492e609c\") " Jul 30 23:44:41.079599 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.079551 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4db53d85-9943-4983-b047-45d4a52ebb92-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4db53d85-9943-4983-b047-45d4a52ebb92" (UID: "4db53d85-9943-4983-b047-45d4a52ebb92"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:44:41.079657 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.079634 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e9fa7a0-aa15-49f8-8c2f-caf9492e609c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1e9fa7a0-aa15-49f8-8c2f-caf9492e609c" (UID: "1e9fa7a0-aa15-49f8-8c2f-caf9492e609c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:44:41.081499 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.081468 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e9fa7a0-aa15-49f8-8c2f-caf9492e609c-kube-api-access-6ttxx" (OuterVolumeSpecName: "kube-api-access-6ttxx") pod "1e9fa7a0-aa15-49f8-8c2f-caf9492e609c" (UID: "1e9fa7a0-aa15-49f8-8c2f-caf9492e609c"). InnerVolumeSpecName "kube-api-access-6ttxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:44:41.081499 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.081482 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4db53d85-9943-4983-b047-45d4a52ebb92-kube-api-access-tlk68" (OuterVolumeSpecName: "kube-api-access-tlk68") pod "4db53d85-9943-4983-b047-45d4a52ebb92" (UID: "4db53d85-9943-4983-b047-45d4a52ebb92"). InnerVolumeSpecName "kube-api-access-tlk68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:44:41.180235 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.180170 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4db53d85-9943-4983-b047-45d4a52ebb92-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:41.180235 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.180202 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlk68\" (UniqueName: \"kubernetes.io/projected/4db53d85-9943-4983-b047-45d4a52ebb92-kube-api-access-tlk68\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:41.180235 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.180212 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ttxx\" (UniqueName: \"kubernetes.io/projected/1e9fa7a0-aa15-49f8-8c2f-caf9492e609c-kube-api-access-6ttxx\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:41.180235 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.180220 2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e9fa7a0-aa15-49f8-8c2f-caf9492e609c-plugins-config-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:41.295784 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.295757 2576 generic.go:356] "Generic (PLEG): container finished" podID="1e9fa7a0-aa15-49f8-8c2f-caf9492e609c" containerID="488cf188c8c2e982b7143a568099077413183c762220463804b8814d22c3f4c1" exitCode=0 Jul 30 23:44:41.295914 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.295818 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" Jul 30 23:44:41.295914 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.295842 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" event={"ID":"1e9fa7a0-aa15-49f8-8c2f-caf9492e609c","Type":"ContainerDied","Data":"488cf188c8c2e982b7143a568099077413183c762220463804b8814d22c3f4c1"} Jul 30 23:44:41.296032 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.295915 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97" event={"ID":"1e9fa7a0-aa15-49f8-8c2f-caf9492e609c","Type":"ContainerDied","Data":"b50216ba21165f0ad7189da667f5c1889320c8c796cd92a519aae3b3af649756"} Jul 30 23:44:41.296032 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.295940 2576 scope.go:117] "RemoveContainer" containerID="488cf188c8c2e982b7143a568099077413183c762220463804b8814d22c3f4c1" Jul 30 23:44:41.297263 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.297242 2576 generic.go:356] "Generic (PLEG): container finished" podID="4db53d85-9943-4983-b047-45d4a52ebb92" containerID="d51b395e0f118340d03eb85eaa2367b587cbe0b427f4f7274f7a4c5547351bf1" exitCode=0 Jul 30 23:44:41.297392 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.297299 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" Jul 30 23:44:41.297392 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.297308 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" event={"ID":"4db53d85-9943-4983-b047-45d4a52ebb92","Type":"ContainerDied","Data":"d51b395e0f118340d03eb85eaa2367b587cbe0b427f4f7274f7a4c5547351bf1"} Jul 30 23:44:41.297392 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.297360 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj" event={"ID":"4db53d85-9943-4983-b047-45d4a52ebb92","Type":"ContainerDied","Data":"a0a42c66667fc599dca5cd36c89395764ec96c11445efbd715aab2feb2a0bc42"} Jul 30 23:44:41.305058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.305041 2576 scope.go:117] "RemoveContainer" containerID="488cf188c8c2e982b7143a568099077413183c762220463804b8814d22c3f4c1" Jul 30 23:44:41.305293 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:44:41.305275 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"488cf188c8c2e982b7143a568099077413183c762220463804b8814d22c3f4c1\": container with ID starting with 488cf188c8c2e982b7143a568099077413183c762220463804b8814d22c3f4c1 not found: ID does not exist" containerID="488cf188c8c2e982b7143a568099077413183c762220463804b8814d22c3f4c1" Jul 30 23:44:41.305368 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.305299 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"488cf188c8c2e982b7143a568099077413183c762220463804b8814d22c3f4c1"} err="failed to get container status \"488cf188c8c2e982b7143a568099077413183c762220463804b8814d22c3f4c1\": rpc error: code = NotFound desc = could not find container \"488cf188c8c2e982b7143a568099077413183c762220463804b8814d22c3f4c1\": container with ID starting with 488cf188c8c2e982b7143a568099077413183c762220463804b8814d22c3f4c1 not found: ID does not exist" Jul 30 23:44:41.305368 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.305318 2576 scope.go:117] "RemoveContainer" containerID="d51b395e0f118340d03eb85eaa2367b587cbe0b427f4f7274f7a4c5547351bf1" Jul 30 23:44:41.312960 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.312943 2576 scope.go:117] "RemoveContainer" containerID="d51b395e0f118340d03eb85eaa2367b587cbe0b427f4f7274f7a4c5547351bf1" Jul 30 23:44:41.313203 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:44:41.313183 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d51b395e0f118340d03eb85eaa2367b587cbe0b427f4f7274f7a4c5547351bf1\": container with ID starting with d51b395e0f118340d03eb85eaa2367b587cbe0b427f4f7274f7a4c5547351bf1 not found: ID does not exist" containerID="d51b395e0f118340d03eb85eaa2367b587cbe0b427f4f7274f7a4c5547351bf1" Jul 30 23:44:41.313265 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.313210 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d51b395e0f118340d03eb85eaa2367b587cbe0b427f4f7274f7a4c5547351bf1"} err="failed to get container status \"d51b395e0f118340d03eb85eaa2367b587cbe0b427f4f7274f7a4c5547351bf1\": rpc error: code = NotFound desc = could not find container \"d51b395e0f118340d03eb85eaa2367b587cbe0b427f4f7274f7a4c5547351bf1\": container with ID starting with d51b395e0f118340d03eb85eaa2367b587cbe0b427f4f7274f7a4c5547351bf1 not found: ID does not exist" Jul 30 23:44:41.318106 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.318087 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj"] Jul 30 23:44:41.325092 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.325070 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-f6f660-575d94bd6b-brnhj"] Jul 30 23:44:41.335318 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.335295 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97"] Jul 30 23:44:41.341077 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:41.341058 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f6f660-64f5d6bcfb-xhf97"] Jul 30 23:44:43.236932 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:43.236902 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e9fa7a0-aa15-49f8-8c2f-caf9492e609c" path="/var/lib/kubelet/pods/1e9fa7a0-aa15-49f8-8c2f-caf9492e609c/volumes" Jul 30 23:44:43.237310 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:43.237257 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4db53d85-9943-4983-b047-45d4a52ebb92" path="/var/lib/kubelet/pods/4db53d85-9943-4983-b047-45d4a52ebb92/volumes" Jul 30 23:44:47.795835 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:47.795799 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg"] Jul 30 23:44:47.796228 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:47.796063 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" podUID="4c3b3478-7944-4f63-ae65-9bd656e0a745" containerName="istio-proxy" containerID="cri-o://c25f42c1beba0ed94e9e89fd8094dafa2524b7760199f6393653bb8352c81629" gracePeriod=30 Jul 30 23:44:53.040206 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.040181 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:44:53.081022 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.080952 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-podinfo\") pod \"4c3b3478-7944-4f63-ae65-9bd656e0a745\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " Jul 30 23:44:53.081022 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.080993 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbj79\" (UniqueName: \"kubernetes.io/projected/4c3b3478-7944-4f63-ae65-9bd656e0a745-kube-api-access-lbj79\") pod \"4c3b3478-7944-4f63-ae65-9bd656e0a745\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " Jul 30 23:44:53.081022 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.081014 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c3b3478-7944-4f63-ae65-9bd656e0a745-istiod-ca-cert\") pod \"4c3b3478-7944-4f63-ae65-9bd656e0a745\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " Jul 30 23:44:53.081274 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.081067 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-envoy\") pod \"4c3b3478-7944-4f63-ae65-9bd656e0a745\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " Jul 30 23:44:53.081274 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.081123 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-workload-socket\") pod \"4c3b3478-7944-4f63-ae65-9bd656e0a745\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " Jul 30 23:44:53.081274 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.081155 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-token\") pod \"4c3b3478-7944-4f63-ae65-9bd656e0a745\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " Jul 30 23:44:53.081274 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.081185 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-workload-certs\") pod \"4c3b3478-7944-4f63-ae65-9bd656e0a745\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " Jul 30 23:44:53.081274 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.081246 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-data\") pod \"4c3b3478-7944-4f63-ae65-9bd656e0a745\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " Jul 30 23:44:53.081552 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.081278 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-credential-socket\") pod \"4c3b3478-7944-4f63-ae65-9bd656e0a745\" (UID: \"4c3b3478-7944-4f63-ae65-9bd656e0a745\") " Jul 30 23:44:53.081552 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.081401 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4c3b3478-7944-4f63-ae65-9bd656e0a745" (UID: "4c3b3478-7944-4f63-ae65-9bd656e0a745"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:44:53.081667 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.081602 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4c3b3478-7944-4f63-ae65-9bd656e0a745" (UID: "4c3b3478-7944-4f63-ae65-9bd656e0a745"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:44:53.081667 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.081632 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:53.081667 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.081632 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4c3b3478-7944-4f63-ae65-9bd656e0a745" (UID: "4c3b3478-7944-4f63-ae65-9bd656e0a745"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:44:53.081667 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.081407 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c3b3478-7944-4f63-ae65-9bd656e0a745-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4c3b3478-7944-4f63-ae65-9bd656e0a745" (UID: "4c3b3478-7944-4f63-ae65-9bd656e0a745"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 23:44:53.081898 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.081782 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-data" (OuterVolumeSpecName: "istio-data") pod "4c3b3478-7944-4f63-ae65-9bd656e0a745" (UID: "4c3b3478-7944-4f63-ae65-9bd656e0a745"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:44:53.083167 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.083138 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4c3b3478-7944-4f63-ae65-9bd656e0a745" (UID: "4c3b3478-7944-4f63-ae65-9bd656e0a745"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 30 23:44:53.083297 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.083265 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c3b3478-7944-4f63-ae65-9bd656e0a745-kube-api-access-lbj79" (OuterVolumeSpecName: "kube-api-access-lbj79") pod "4c3b3478-7944-4f63-ae65-9bd656e0a745" (UID: "4c3b3478-7944-4f63-ae65-9bd656e0a745"). InnerVolumeSpecName "kube-api-access-lbj79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:44:53.083531 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.083508 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4c3b3478-7944-4f63-ae65-9bd656e0a745" (UID: "4c3b3478-7944-4f63-ae65-9bd656e0a745"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 23:44:53.083579 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.083545 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c3b3478-7944-4f63-ae65-9bd656e0a745" (UID: "4c3b3478-7944-4f63-ae65-9bd656e0a745"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 23:44:53.182008 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.181982 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:53.182008 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.182005 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:53.182169 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.182013 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:53.182169 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.182023 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:53.182169 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.182032 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbj79\" (UniqueName: \"kubernetes.io/projected/4c3b3478-7944-4f63-ae65-9bd656e0a745-kube-api-access-lbj79\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:53.182169 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.182040 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c3b3478-7944-4f63-ae65-9bd656e0a745-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:53.182169 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.182048 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:53.182169 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.182055 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c3b3478-7944-4f63-ae65-9bd656e0a745-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\"" Jul 30 23:44:53.360747 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.360655 2576 generic.go:356] "Generic (PLEG): container finished" podID="4c3b3478-7944-4f63-ae65-9bd656e0a745" containerID="c25f42c1beba0ed94e9e89fd8094dafa2524b7760199f6393653bb8352c81629" exitCode=0 Jul 30 23:44:53.360747 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.360707 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" Jul 30 23:44:53.360747 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.360700 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" event={"ID":"4c3b3478-7944-4f63-ae65-9bd656e0a745","Type":"ContainerDied","Data":"c25f42c1beba0ed94e9e89fd8094dafa2524b7760199f6393653bb8352c81629"} Jul 30 23:44:53.361048 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.360772 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg" event={"ID":"4c3b3478-7944-4f63-ae65-9bd656e0a745","Type":"ContainerDied","Data":"d4b4c4f5e6f28aeafd11b4adeeb11e5f948dd6f10ca6978c0f4d4b38264d8d8a"} Jul 30 23:44:53.361048 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.360802 2576 scope.go:117] "RemoveContainer" containerID="c25f42c1beba0ed94e9e89fd8094dafa2524b7760199f6393653bb8352c81629" Jul 30 23:44:53.369930 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.369913 2576 scope.go:117] "RemoveContainer" containerID="2124cc95ce33a5d12978ce6480f9c0c3eeabe45d8a5a724f3bc20fde752f5db5" Jul 30 23:44:53.377755 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.377729 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg"] Jul 30 23:44:53.378984 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.378793 2576 scope.go:117] "RemoveContainer" containerID="c25f42c1beba0ed94e9e89fd8094dafa2524b7760199f6393653bb8352c81629" Jul 30 23:44:53.379116 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:44:53.379098 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c25f42c1beba0ed94e9e89fd8094dafa2524b7760199f6393653bb8352c81629\": container with ID starting with c25f42c1beba0ed94e9e89fd8094dafa2524b7760199f6393653bb8352c81629 not found: ID does not exist" containerID="c25f42c1beba0ed94e9e89fd8094dafa2524b7760199f6393653bb8352c81629" Jul 30 23:44:53.379190 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.379130 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25f42c1beba0ed94e9e89fd8094dafa2524b7760199f6393653bb8352c81629"} err="failed to get container status \"c25f42c1beba0ed94e9e89fd8094dafa2524b7760199f6393653bb8352c81629\": rpc error: code = NotFound desc = could not find container \"c25f42c1beba0ed94e9e89fd8094dafa2524b7760199f6393653bb8352c81629\": container with ID starting with c25f42c1beba0ed94e9e89fd8094dafa2524b7760199f6393653bb8352c81629 not found: ID does not exist" Jul 30 23:44:53.379190 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.379155 2576 scope.go:117] "RemoveContainer" containerID="2124cc95ce33a5d12978ce6480f9c0c3eeabe45d8a5a724f3bc20fde752f5db5" Jul 30 23:44:53.379400 ip-10-0-142-10 kubenswrapper[2576]: E0730 23:44:53.379380 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2124cc95ce33a5d12978ce6480f9c0c3eeabe45d8a5a724f3bc20fde752f5db5\": container with ID starting with 2124cc95ce33a5d12978ce6480f9c0c3eeabe45d8a5a724f3bc20fde752f5db5 not found: ID does not exist" containerID="2124cc95ce33a5d12978ce6480f9c0c3eeabe45d8a5a724f3bc20fde752f5db5" Jul 30 23:44:53.379446 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.379405 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2124cc95ce33a5d12978ce6480f9c0c3eeabe45d8a5a724f3bc20fde752f5db5"} err="failed to get container status \"2124cc95ce33a5d12978ce6480f9c0c3eeabe45d8a5a724f3bc20fde752f5db5\": rpc error: code = NotFound desc = could not find container \"2124cc95ce33a5d12978ce6480f9c0c3eeabe45d8a5a724f3bc20fde752f5db5\": container with ID starting with 2124cc95ce33a5d12978ce6480f9c0c3eeabe45d8a5a724f3bc20fde752f5db5 not found: ID does not exist" Jul 30 23:44:53.381067 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.381048 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-f6f660-openshift-default-74b8dc9db4-ts9jg"] Jul 30 23:44:53.995195 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:53.995169 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-swlkn_d62069f4-023c-41ae-addc-b92d44b1849b/server/0.log" Jul 30 23:44:54.217533 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:54.217507 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c6bb66584-b6zph_9280869d-ea5f-4723-aba9-cbc6ddce34f7/copy-manifests/0.log" Jul 30 23:44:54.224410 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:54.224389 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c6bb66584-b6zph_9280869d-ea5f-4723-aba9-cbc6ddce34f7/manager/0.log" Jul 30 23:44:54.920423 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:54.920401 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757540-gqp9w_21fffb06-bb24-492a-b175-a85e7db1a530/cleanup/0.log" Jul 30 23:44:55.026258 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:55.026230 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757555-s9fpq_2f7a2294-6c22-4e11-9bef-3c987e492873/cleanup/0.log" Jul 30 23:44:55.133539 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:55.133511 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757570-hjdpq_a513fb38-7fb5-4795-a6b1-4fab9317489f/cleanup/0.log" Jul 30 23:44:55.236411 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:55.236312 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c3b3478-7944-4f63-ae65-9bd656e0a745" path="/var/lib/kubelet/pods/4c3b3478-7944-4f63-ae65-9bd656e0a745/volumes" Jul 30 23:44:57.024974 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:57.024942 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz_12461584-a631-45e0-bbb8-9ee438e01758/istio-proxy/0.log" Jul 30 23:44:57.144646 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:57.144620 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-7xxw4_7fd15c56-ef0e-4eb2-8094-c840276d64bf/discovery/0.log" Jul 30 23:44:57.475399 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:57.475365 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fkxvs_4b366a1b-5028-41fa-ac92-b15b8c494863/istio-proxy/1.log" Jul 30 23:44:58.388370 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:44:58.388337 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-f84n5_f97bce20-d4cb-4556-ba08-5954c9c14ae1/main/0.log" Jul 30 23:45:00.156192 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156154 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757585-hv6xp"] Jul 30 23:45:00.156559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156460 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a34766e5-b82c-4950-bab7-c6030ccc158e" containerName="istio-proxy" Jul 30 23:45:00.156559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156471 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a34766e5-b82c-4950-bab7-c6030ccc158e" containerName="istio-proxy" Jul 30 23:45:00.156559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156482 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c3b3478-7944-4f63-ae65-9bd656e0a745" containerName="istio-proxy" Jul 30 23:45:00.156559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156487 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c3b3478-7944-4f63-ae65-9bd656e0a745" containerName="istio-proxy" Jul 30 23:45:00.156559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156495 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b" containerName="revoke-keys" Jul 30 23:45:00.156559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156501 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b" containerName="revoke-keys" Jul 30 23:45:00.156559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156509 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4db53d85-9943-4983-b047-45d4a52ebb92" containerName="payload-processing" Jul 30 23:45:00.156559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156515 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4db53d85-9943-4983-b047-45d4a52ebb92" containerName="payload-processing" Jul 30 23:45:00.156559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156522 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e9fa7a0-aa15-49f8-8c2f-caf9492e609c" containerName="payload-pre-processing" Jul 30 23:45:00.156559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156528 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e9fa7a0-aa15-49f8-8c2f-caf9492e609c" containerName="payload-pre-processing" Jul 30 23:45:00.156559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156538 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf10e73-cc6f-45d8-a082-65e464cdcb54" containerName="payload-processing" Jul 30 23:45:00.156559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156543 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf10e73-cc6f-45d8-a082-65e464cdcb54" containerName="payload-processing" Jul 30 23:45:00.156559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156552 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f848754d-0b20-4311-b285-c7958edd3c1a" containerName="istio-proxy" Jul 30 23:45:00.156559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156557 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f848754d-0b20-4311-b285-c7958edd3c1a" containerName="istio-proxy" Jul 30 23:45:00.156559 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156566 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62a15bca-1e4a-4f9f-96ab-8861025ef2ce" containerName="payload-processing" Jul 30 23:45:00.157058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156572 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="62a15bca-1e4a-4f9f-96ab-8861025ef2ce" containerName="payload-processing" Jul 30 23:45:00.157058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156580 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f848754d-0b20-4311-b285-c7958edd3c1a" containerName="istio-proxy" Jul 30 23:45:00.157058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156585 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f848754d-0b20-4311-b285-c7958edd3c1a" containerName="istio-proxy" Jul 30 23:45:00.157058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156594 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2120ac9-a7e5-4544-883b-2b09931ff9b2" containerName="payload-pre-processing" Jul 30 23:45:00.157058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156599 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2120ac9-a7e5-4544-883b-2b09931ff9b2" containerName="payload-pre-processing" Jul 30 23:45:00.157058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156647 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f848754d-0b20-4311-b285-c7958edd3c1a" containerName="istio-proxy" Jul 30 23:45:00.157058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156653 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="01c1e69a-b98d-49ae-ae78-c82b7b0f9f6b" containerName="revoke-keys" Jul 30 23:45:00.157058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156660 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f848754d-0b20-4311-b285-c7958edd3c1a" containerName="istio-proxy" Jul 30 23:45:00.157058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156666 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a34766e5-b82c-4950-bab7-c6030ccc158e" containerName="istio-proxy" Jul 30 23:45:00.157058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156671 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="62a15bca-1e4a-4f9f-96ab-8861025ef2ce" containerName="payload-processing" Jul 30 23:45:00.157058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156676 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a34766e5-b82c-4950-bab7-c6030ccc158e" containerName="istio-proxy" Jul 30 23:45:00.157058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156681 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2120ac9-a7e5-4544-883b-2b09931ff9b2" containerName="payload-pre-processing" Jul 30 23:45:00.157058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156686 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4db53d85-9943-4983-b047-45d4a52ebb92" containerName="payload-processing" Jul 30 23:45:00.157058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156691 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf10e73-cc6f-45d8-a082-65e464cdcb54" containerName="payload-processing" Jul 30 23:45:00.157058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156696 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e9fa7a0-aa15-49f8-8c2f-caf9492e609c" containerName="payload-pre-processing" Jul 30 23:45:00.157058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156701 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c3b3478-7944-4f63-ae65-9bd656e0a745" containerName="istio-proxy" Jul 30 23:45:00.157058 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.156706 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c3b3478-7944-4f63-ae65-9bd656e0a745" containerName="istio-proxy" Jul 30 23:45:00.161430 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.161412 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757585-hv6xp" Jul 30 23:45:00.164831 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.164809 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52wcc\"" Jul 30 23:45:00.171933 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.171911 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757585-hv6xp"] Jul 30 23:45:00.172730 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.172713 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757585-hv6xp" Jul 30 23:45:00.306153 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.306102 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757585-hv6xp"] Jul 30 23:45:00.308331 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:45:00.308299 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd948e8d_5467_40fd_85cd_382dfac10cfd.slice/crio-cb12618d63b3c595a0e7a5720f532d1e6e097cdb5941e944cb7288bef8c58d1c WatchSource:0}: Error finding container cb12618d63b3c595a0e7a5720f532d1e6e097cdb5941e944cb7288bef8c58d1c: Status 404 returned error can't find the container with id cb12618d63b3c595a0e7a5720f532d1e6e097cdb5941e944cb7288bef8c58d1c Jul 30 23:45:00.401589 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:00.401562 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757585-hv6xp" event={"ID":"bd948e8d-5467-40fd-85cd-382dfac10cfd","Type":"ContainerStarted","Data":"cb12618d63b3c595a0e7a5720f532d1e6e097cdb5941e944cb7288bef8c58d1c"} Jul 30 23:45:01.408149 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:01.408061 2576 generic.go:356] "Generic (PLEG): container finished" podID="bd948e8d-5467-40fd-85cd-382dfac10cfd" containerID="87ff469d40716f3d4f83e9182fd220895454b44e13a1cdb5dc195fc6e8672cf1" exitCode=0 Jul 30 23:45:01.408149 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:01.408114 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757585-hv6xp" event={"ID":"bd948e8d-5467-40fd-85cd-382dfac10cfd","Type":"ContainerDied","Data":"87ff469d40716f3d4f83e9182fd220895454b44e13a1cdb5dc195fc6e8672cf1"} Jul 30 23:45:02.542751 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:02.542727 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757585-hv6xp" Jul 30 23:45:03.419920 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:03.419885 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757585-hv6xp" Jul 30 23:45:03.419920 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:03.419912 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757585-hv6xp" event={"ID":"bd948e8d-5467-40fd-85cd-382dfac10cfd","Type":"ContainerDied","Data":"cb12618d63b3c595a0e7a5720f532d1e6e097cdb5941e944cb7288bef8c58d1c"} Jul 30 23:45:03.420173 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:03.419985 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb12618d63b3c595a0e7a5720f532d1e6e097cdb5941e944cb7288bef8c58d1c" Jul 30 23:45:03.597141 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:03.597049 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757540-gqp9w"] Jul 30 23:45:03.599208 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:03.599183 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757540-gqp9w"] Jul 30 23:45:05.235660 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:05.235626 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21fffb06-bb24-492a-b175-a85e7db1a530" path="/var/lib/kubelet/pods/21fffb06-bb24-492a-b175-a85e7db1a530/volumes" Jul 30 23:45:06.664379 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:06.664346 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r96n6_20eeae26-7b8c-4b13-976f-45be0ec631ff/global-pull-secret-syncer/0.log" Jul 30 23:45:06.797645 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:06.797614 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bk6hf_d304fc21-0e59-4cce-bf8d-880efd5e5ce4/konnectivity-agent/0.log" Jul 30 23:45:06.900292 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:06.900263 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-10.ec2.internal_85fd0607521b56acd9e31e115458dcc6/haproxy/0.log" Jul 30 23:45:14.053806 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:14.053773 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-zgx2f_b8034c8f-7835-47e4-9b0f-e2a40bc9acef/kube-state-metrics/0.log" Jul 30 23:45:14.072203 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:14.072177 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-zgx2f_b8034c8f-7835-47e4-9b0f-e2a40bc9acef/kube-rbac-proxy-main/0.log" Jul 30 23:45:14.093162 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:14.093137 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-zgx2f_b8034c8f-7835-47e4-9b0f-e2a40bc9acef/kube-rbac-proxy-self/0.log" Jul 30 23:45:14.262967 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:14.262939 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fqm7n_2f894415-f174-4b40-8546-014769b398e6/node-exporter/0.log" Jul 30 23:45:14.288671 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:14.288643 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fqm7n_2f894415-f174-4b40-8546-014769b398e6/kube-rbac-proxy/0.log" Jul 30 23:45:14.313129 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:14.313029 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fqm7n_2f894415-f174-4b40-8546-014769b398e6/init-textfile/0.log" Jul 30 23:45:14.433460 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:14.433432 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-hqnk9_fbb39a4a-2163-4900-80a8-1847ceb34a17/kube-rbac-proxy-main/0.log" Jul 30 23:45:14.467159 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:14.467133 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-hqnk9_fbb39a4a-2163-4900-80a8-1847ceb34a17/kube-rbac-proxy-self/0.log" Jul 30 23:45:14.488615 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:14.488592 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-hqnk9_fbb39a4a-2163-4900-80a8-1847ceb34a17/openshift-state-metrics/0.log" Jul 30 23:45:14.861655 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:14.861624 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-xf2nb_7e83836f-ff87-4eec-8903-49d91747e99c/prometheus-operator-admission-webhook/0.log" Jul 30 23:45:14.896771 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:14.896743 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-859974687f-9n895_2c82d714-549f-4d1f-8770-30da50a594a7/telemeter-client/0.log" Jul 30 23:45:14.934912 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:14.934889 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-859974687f-9n895_2c82d714-549f-4d1f-8770-30da50a594a7/reload/0.log" Jul 30 23:45:14.955836 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:14.955809 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-859974687f-9n895_2c82d714-549f-4d1f-8770-30da50a594a7/kube-rbac-proxy/0.log" Jul 30 23:45:17.542486 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.542455 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2"] Jul 30 23:45:17.542900 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.542793 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a34766e5-b82c-4950-bab7-c6030ccc158e" containerName="istio-proxy" Jul 30 23:45:17.542900 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.542805 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a34766e5-b82c-4950-bab7-c6030ccc158e" containerName="istio-proxy" Jul 30 23:45:17.542900 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.542815 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c3b3478-7944-4f63-ae65-9bd656e0a745" containerName="istio-proxy" Jul 30 23:45:17.542900 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.542821 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c3b3478-7944-4f63-ae65-9bd656e0a745" containerName="istio-proxy" Jul 30 23:45:17.542900 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.542840 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd948e8d-5467-40fd-85cd-382dfac10cfd" containerName="cleanup" Jul 30 23:45:17.542900 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.542847 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd948e8d-5467-40fd-85cd-382dfac10cfd" containerName="cleanup" Jul 30 23:45:17.543107 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.542913 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd948e8d-5467-40fd-85cd-382dfac10cfd" containerName="cleanup" Jul 30 23:45:17.545933 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.545918 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:17.548343 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.548318 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b87wl\"/\"kube-root-ca.crt\"" Jul 30 23:45:17.548489 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.548469 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b87wl\"/\"default-dockercfg-m4wrr\"" Jul 30 23:45:17.549448 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.549433 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b87wl\"/\"openshift-service-ca.crt\"" Jul 30 23:45:17.558412 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.558388 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2"] Jul 30 23:45:17.679597 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.679563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46rgd\" (UniqueName: \"kubernetes.io/projected/47642260-5658-4fde-a8f7-b46081981f67-kube-api-access-46rgd\") pod \"perf-node-gather-daemonset-k9gb2\" (UID: \"47642260-5658-4fde-a8f7-b46081981f67\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:17.679597 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.679600 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47642260-5658-4fde-a8f7-b46081981f67-sys\") pod \"perf-node-gather-daemonset-k9gb2\" (UID: \"47642260-5658-4fde-a8f7-b46081981f67\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:17.679836 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.679619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/47642260-5658-4fde-a8f7-b46081981f67-proc\") pod \"perf-node-gather-daemonset-k9gb2\" (UID: \"47642260-5658-4fde-a8f7-b46081981f67\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:17.679836 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.679729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47642260-5658-4fde-a8f7-b46081981f67-lib-modules\") pod \"perf-node-gather-daemonset-k9gb2\" (UID: \"47642260-5658-4fde-a8f7-b46081981f67\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:17.679836 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.679786 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/47642260-5658-4fde-a8f7-b46081981f67-podres\") pod \"perf-node-gather-daemonset-k9gb2\" (UID: \"47642260-5658-4fde-a8f7-b46081981f67\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:17.729759 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.729721 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8476b4c5df-nmv8r_1da78400-ee64-43b0-ad1d-1347a53c0ab0/console/0.log" Jul 30 23:45:17.781086 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.781043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/47642260-5658-4fde-a8f7-b46081981f67-podres\") pod \"perf-node-gather-daemonset-k9gb2\" (UID: \"47642260-5658-4fde-a8f7-b46081981f67\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:17.781086 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.781091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46rgd\" (UniqueName: \"kubernetes.io/projected/47642260-5658-4fde-a8f7-b46081981f67-kube-api-access-46rgd\") pod \"perf-node-gather-daemonset-k9gb2\" (UID: \"47642260-5658-4fde-a8f7-b46081981f67\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:17.781358 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.781118 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47642260-5658-4fde-a8f7-b46081981f67-sys\") pod \"perf-node-gather-daemonset-k9gb2\" (UID: \"47642260-5658-4fde-a8f7-b46081981f67\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:17.781358 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.781139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/47642260-5658-4fde-a8f7-b46081981f67-proc\") pod \"perf-node-gather-daemonset-k9gb2\" (UID: \"47642260-5658-4fde-a8f7-b46081981f67\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:17.781358 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.781204 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/47642260-5658-4fde-a8f7-b46081981f67-podres\") pod \"perf-node-gather-daemonset-k9gb2\" (UID: \"47642260-5658-4fde-a8f7-b46081981f67\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:17.781358 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.781215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47642260-5658-4fde-a8f7-b46081981f67-lib-modules\") pod \"perf-node-gather-daemonset-k9gb2\" (UID: \"47642260-5658-4fde-a8f7-b46081981f67\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:17.781358 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.781235 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47642260-5658-4fde-a8f7-b46081981f67-sys\") pod \"perf-node-gather-daemonset-k9gb2\" (UID: \"47642260-5658-4fde-a8f7-b46081981f67\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:17.781358 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.781288 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/47642260-5658-4fde-a8f7-b46081981f67-proc\") pod \"perf-node-gather-daemonset-k9gb2\" (UID: \"47642260-5658-4fde-a8f7-b46081981f67\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:17.781358 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.781320 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47642260-5658-4fde-a8f7-b46081981f67-lib-modules\") pod \"perf-node-gather-daemonset-k9gb2\" (UID: \"47642260-5658-4fde-a8f7-b46081981f67\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:17.789249 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.789225 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46rgd\" (UniqueName: \"kubernetes.io/projected/47642260-5658-4fde-a8f7-b46081981f67-kube-api-access-46rgd\") pod \"perf-node-gather-daemonset-k9gb2\" (UID: \"47642260-5658-4fde-a8f7-b46081981f67\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:17.855332 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.855248 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:17.986526 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:17.986502 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2"] Jul 30 23:45:17.987817 ip-10-0-142-10 kubenswrapper[2576]: W0730 23:45:17.987788 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod47642260_5658_4fde_a8f7_b46081981f67.slice/crio-c3cd67e564ad833531f69fb57b7e104afc366fa984cca297cb00240343fa950e WatchSource:0}: Error finding container c3cd67e564ad833531f69fb57b7e104afc366fa984cca297cb00240343fa950e: Status 404 returned error can't find the container with id c3cd67e564ad833531f69fb57b7e104afc366fa984cca297cb00240343fa950e Jul 30 23:45:18.500745 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:18.500707 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" event={"ID":"47642260-5658-4fde-a8f7-b46081981f67","Type":"ContainerStarted","Data":"429ac30cbdc6d2a7c5f08c9b468a33b7957e5b3cf9493ba9373abf7aa9e99f82"} Jul 30 23:45:18.500934 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:18.500765 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" event={"ID":"47642260-5658-4fde-a8f7-b46081981f67","Type":"ContainerStarted","Data":"c3cd67e564ad833531f69fb57b7e104afc366fa984cca297cb00240343fa950e"} Jul 30 23:45:18.500934 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:18.500825 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:18.517607 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:18.517561 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" podStartSLOduration=1.5175468909999998 podStartE2EDuration="1.517546891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 23:45:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:45:18.515700434 +0000 UTC m=+3445.719519667" watchObservedRunningTime="2026-07-30 23:45:18.517546891 +0000 UTC m=+3445.721366126" Jul 30 23:45:19.569823 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:19.569794 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2xj2r_60aa8c35-1f16-4ac0-8923-659f5cbfb56a/dns/0.log" Jul 30 23:45:19.591233 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:19.591210 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2xj2r_60aa8c35-1f16-4ac0-8923-659f5cbfb56a/kube-rbac-proxy/0.log" Jul 30 23:45:19.716122 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:19.716097 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ctblf_b8f4f25a-2e4b-4ce2-a8cc-cfe94a097f26/dns-node-resolver/0.log" Jul 30 23:45:20.296443 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:20.296413 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6d98d88b4f-rbnfd_f2b8d98f-be8b-49ff-88a1-0cee4fbc4244/registry/0.log" Jul 30 23:45:20.368426 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:20.368404 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kdwq6_f2cb5e16-6273-4726-b8d1-ab09e229d0c8/node-ca/0.log" Jul 30 23:45:21.290229 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:21.290196 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz_12461584-a631-45e0-bbb8-9ee438e01758/istio-proxy/0.log" Jul 30 23:45:21.456344 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:21.456312 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-7xxw4_7fd15c56-ef0e-4eb2-8094-c840276d64bf/discovery/0.log" Jul 30 23:45:21.530475 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:21.530444 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fkxvs_4b366a1b-5028-41fa-ac92-b15b8c494863/istio-proxy/0.log" Jul 30 23:45:21.537268 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:21.537251 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fkxvs_4b366a1b-5028-41fa-ac92-b15b8c494863/istio-proxy/1.log" Jul 30 23:45:22.425354 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:22.425325 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d47jw_13ed87f8-efb7-42b3-b630-8ed4c86ea19d/serve-healthcheck-canary/0.log" Jul 30 23:45:23.030036 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:23.030010 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d4d7l_cc460f34-9567-42f0-9b21-d75ec3db45c7/kube-rbac-proxy/0.log" Jul 30 23:45:23.049792 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:23.049764 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d4d7l_cc460f34-9567-42f0-9b21-d75ec3db45c7/exporter/0.log" Jul 30 23:45:23.070129 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:23.070103 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d4d7l_cc460f34-9567-42f0-9b21-d75ec3db45c7/extractor/0.log" Jul 30 23:45:24.515462 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:24.515433 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-k9gb2" Jul 30 23:45:25.694363 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:25.694334 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-swlkn_d62069f4-023c-41ae-addc-b92d44b1849b/server/0.log" Jul 30 23:45:25.787094 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:25.787061 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c6bb66584-b6zph_9280869d-ea5f-4723-aba9-cbc6ddce34f7/manager/0.log" Jul 30 23:45:25.806533 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:25.806502 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c6bb66584-b6zph_9280869d-ea5f-4723-aba9-cbc6ddce34f7/copy-manifests/0.log" Jul 30 23:45:27.402566 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:27.402540 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-78d44f567c-lcdtv_c5424165-20ba-4f37-848e-f2085c461bef/manager/0.log" Jul 30 23:45:27.433050 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:27.433025 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-xk5x2_b9bb6b0a-b522-4e83-9dc2-b98328ec356b/openshift-lws-operator/0.log" Jul 30 23:45:28.187524 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:28.187496 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz_12461584-a631-45e0-bbb8-9ee438e01758/istio-proxy/0.log" Jul 30 23:45:28.341072 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:28.341044 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-7xxw4_7fd15c56-ef0e-4eb2-8094-c840276d64bf/discovery/0.log" Jul 30 23:45:28.388337 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:28.388311 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fkxvs_4b366a1b-5028-41fa-ac92-b15b8c494863/istio-proxy/0.log" Jul 30 23:45:28.394431 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:28.394412 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fkxvs_4b366a1b-5028-41fa-ac92-b15b8c494863/istio-proxy/1.log" Jul 30 23:45:29.898133 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:29.898100 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-cbxlz_12461584-a631-45e0-bbb8-9ee438e01758/istio-proxy/0.log" Jul 30 23:45:30.063128 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:30.063094 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-7xxw4_7fd15c56-ef0e-4eb2-8094-c840276d64bf/discovery/0.log" Jul 30 23:45:30.117730 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:30.117705 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fkxvs_4b366a1b-5028-41fa-ac92-b15b8c494863/istio-proxy/0.log" Jul 30 23:45:30.123980 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:30.123956 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fkxvs_4b366a1b-5028-41fa-ac92-b15b8c494863/istio-proxy/1.log" Jul 30 23:45:34.166095 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:34.166065 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsjdm_d541cd49-d536-4578-b699-eb53c81b1ad8/kube-multus-additional-cni-plugins/0.log" Jul 30 23:45:34.186154 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:34.186126 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsjdm_d541cd49-d536-4578-b699-eb53c81b1ad8/egress-router-binary-copy/0.log" Jul 30 23:45:34.206473 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:34.206451 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsjdm_d541cd49-d536-4578-b699-eb53c81b1ad8/cni-plugins/0.log" Jul 30 23:45:34.226964 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:34.226922 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsjdm_d541cd49-d536-4578-b699-eb53c81b1ad8/bond-cni-plugin/0.log" Jul 30 23:45:34.248474 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:34.248451 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsjdm_d541cd49-d536-4578-b699-eb53c81b1ad8/routeoverride-cni/0.log" Jul 30 23:45:34.268611 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:34.268590 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsjdm_d541cd49-d536-4578-b699-eb53c81b1ad8/whereabouts-cni-bincopy/0.log" Jul 30 23:45:34.289230 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:34.289210 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zsjdm_d541cd49-d536-4578-b699-eb53c81b1ad8/whereabouts-cni/0.log" Jul 30 23:45:34.360390 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:34.360361 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t9b54_039c09b9-d19e-480b-a820-fce0e4b7dfca/kube-multus/0.log" Jul 30 23:45:34.522774 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:34.522698 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j8q5t_ee4984a2-9082-4730-a056-597f24a92af7/network-metrics-daemon/0.log" Jul 30 23:45:34.544934 ip-10-0-142-10 kubenswrapper[2576]: I0730 23:45:34.544912 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j8q5t_ee4984a2-9082-4730-a056-597f24a92af7/kube-rbac-proxy/0.log"