Jul 27 17:18:52.438452 ip-10-0-128-74 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 27 17:18:52.438465 ip-10-0-128-74 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 27 17:18:52.438472 ip-10-0-128-74 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 27 17:18:52.438724 ip-10-0-128-74 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 27 17:19:02.686066 ip-10-0-128-74 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 27 17:19:02.686087 ip-10-0-128-74 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 56b7cb5ccf924a6787a9e2641f1a0e55 --
Jul 27 17:20:56.354700 ip-10-0-128-74 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 17:20:56.747554 ip-10-0-128-74 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 17:20:56.747554 ip-10-0-128-74 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 17:20:56.747554 ip-10-0-128-74 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 17:20:56.747554 ip-10-0-128-74 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 17:20:56.747554 ip-10-0-128-74 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 17:20:56.748501 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.748372    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 17:20:56.755324 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755305    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:20:56.755324 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755323    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755328    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755332    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755335    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755338    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755341    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755344    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755347    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755349    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755353    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755356    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755359    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755361    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755365    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755369    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755372    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755375    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755378    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755380    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:20:56.755396 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755383    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755385    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755389    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755391    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755394    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755397    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755400    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755402    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755405    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755408    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755410    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755413    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755426    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755429    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755432    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755434    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755437    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755439    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755442    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755444    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:20:56.755867 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755447    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755449    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755452    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755455    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755458    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755460    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755463    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755465    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755469    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755471    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755474    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755477    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755479    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755482    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755485    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755488    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755490    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755493    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755495    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755498    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:20:56.756354 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755500    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755502    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755505    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755508    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755510    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755513    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755515    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755518    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755522    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755525    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755529    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755532    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755535    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755539    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755543    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755546    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755549    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755551    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755554    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:20:56.756866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755556    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755558    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755561    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755563    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755566    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755568    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755571    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755574    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755577    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755579    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755582    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755585    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755587    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755590    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755592    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755595    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755598    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755600    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755602    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.755605    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:20:56.757333 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756337    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756343    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756346    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756349    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756351    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756354    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756358    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756361    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756364    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756372    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756374    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756377    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756379    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756382    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756384    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756387    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756389    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756392    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756394    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756397    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:20:56.757868 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756400    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756403    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756405    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756408    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756410    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756413    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756430    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756432    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756435    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756437    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756440    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756442    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756445    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756447    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756450    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756452    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756455    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756457    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756460    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756462    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:20:56.758367 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756465    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756467    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756474    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756478    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756482    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756485    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756487    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756490    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756493    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756495    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756498    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756502    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756504    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756507    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756509    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756512    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756514    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756517    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756522    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:20:56.758877 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756525    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756529    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756531    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756534    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756537    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756539    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756547    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756550    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756552    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756555    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756557    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756560    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756562    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756565    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756567    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756570    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756573    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756575    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756578    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:20:56.759339 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756580    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756583    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756586    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756589    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756591    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756594    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756597    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756599    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756602    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756604    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756607    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756609    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756611    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756614    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756616    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756619    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756622    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756625    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756629    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756632    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:20:56.759851 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.756634    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757080    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757090    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757093    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757096    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757098    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757101    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757104    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757106    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757114    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757117    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757119    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757122    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757125    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757127    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757131    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757135    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757138    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757140    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:20:56.760350 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757143    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757146    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757149    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757152    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757154    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757157    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757159    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757161    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757164    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757170    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757172    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757175    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757177    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757180    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757182    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757184    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757187    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757189    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757191    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757194    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:20:56.760847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757196    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757199    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757201    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757204    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757207    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757209    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757212    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757215    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757217    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757220    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757222    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757225    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757227    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757230    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757232    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757235    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757238    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757240    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757243    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757245    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:20:56.761362 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757248    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757251    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757254    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757256    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757259    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757261    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757264    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757266    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757270    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757273    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757275    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757278    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757280    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757283    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757285    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757288    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757291    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757293    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757297    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:20:56.761879 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757299    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757302    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757304    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757307    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757309    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757311    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757316    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757319    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757322    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757324    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757326    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757329    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757331    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757334    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757338    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757341    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757343    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757346    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757348    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757351    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:20:56.762366 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757353    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.757356    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757441    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757453    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757462    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757469    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757475    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757480    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757486    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757491    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757495    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757499    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757503    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757506    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757509    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757511    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757514    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757517    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757520    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757522    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757526    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757529    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757532    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757535    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 17:20:56.762861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757538    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757542    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757547    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757550    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757553    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757556    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757559    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757561    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757564    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757567    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757571    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757574    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757577    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757580    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757582    2579 flags.go:64] FLAG: --enable-server="true"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757585    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757591    2579 flags.go:64] FLAG: --event-burst="100"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757594    2579 flags.go:64] FLAG: --event-qps="50"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757597    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757609    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757613    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757616    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757619    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757622    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757625    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 27 17:20:56.763459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757627    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757630    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757633    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757636    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757639    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757641    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757644    2579 flags.go:64] FLAG: --feature-gates=""
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757648    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757651    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757655    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757658    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757661    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757664    2579 flags.go:64] FLAG: --help="false"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757667    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-128-74.ec2.internal"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757670    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757673    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757676    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757679    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757682    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757684    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757687    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757690    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757692    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 17:20:56.764090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757701    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757704    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757706    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757711    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757716    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757719    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757722    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757725    2579 flags.go:64] FLAG: --lock-file=""
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757727    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757730    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757733    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757739    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757741    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757744    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757747    2579 flags.go:64] FLAG: --logging-format="text"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757750    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757753    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757755    2579 flags.go:64] FLAG: --manifest-url=""
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757759    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757766    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757769    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757773    2579 flags.go:64] FLAG: --max-pods="110"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757775    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757778    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757781    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 17:20:56.764781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757796    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757800    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757803    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757806    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757814    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757817    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757820    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757823    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757825    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757831    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757833    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757837    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757841    2579 flags.go:64] FLAG: --port="10250"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757843    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757846    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08f12a2f81e7c28c7"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757850    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757852    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757855    2579 flags.go:64] FLAG: --register-node="true"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757858    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757861    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757864    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757867    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757869    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757873    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757876    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 17:20:56.765764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757880    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757883    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757886    2579 flags.go:64] FLAG: --runonce="false"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757888    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757891    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757894    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757897    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757900    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757902    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757905    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757908    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757911    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757914    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757916    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757919    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757922    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757925    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757927    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757933    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757936    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757939    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757943    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757945    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757948    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757950    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 17:20:56.766796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757953    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757956    2579 flags.go:64] FLAG: --v="2"
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757959    2579 flags.go:64] FLAG: --version="false"
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757963    2579 flags.go:64] FLAG: --vmodule=""
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757967    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.757970    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758118    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758124    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758127    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758130    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758132    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758135    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758138    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758141    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758143    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758146    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758149    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758151    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758154    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758156    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758159    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:20:56.767554 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758161    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758164    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758166    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758169    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758172    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758174    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758176    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758184    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758187    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758190    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758192    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758195    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758197    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758200    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758202    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758205    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758207    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758210    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758213    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:20:56.768089 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758216    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758218    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758220    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758224    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758227    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758230    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758233    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758236    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758239    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758242    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758245    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758248    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758250    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758252    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758255    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758257    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758261    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758264    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758267    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:20:56.768775 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758269    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758272    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758281    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758284    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758286    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758288    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758291    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758293    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758296    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758298    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758300    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758303    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758306    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758309    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758311    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758314    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758316    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758319    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758321    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758329    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:20:56.769624 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758331    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758334    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758336    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758338    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758341    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758343    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758345    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758348    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758350    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758352    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758355    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758357    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758359    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758362    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758364    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758372    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758375    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758377    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758380    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758382    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:20:56.770232 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758384    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:20:56.771006 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758387    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:20:56.771006 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758389    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:20:56.771006 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758393    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:20:56.771006 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758397    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:20:56.771006 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.758400    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:20:56.771006 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.759022    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 17:20:56.771006 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.767001    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 17:20:56.771006 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.767022    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 17:20:56.771006 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.768327    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 17:20:56.771006 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.768347    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 17:20:56.771006 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768460    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:20:56.771006 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768469    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:20:56.771006 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768474    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:20:56.771006 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768478    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768485    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768489    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768492    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768497    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768501    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768509    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768514    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768519    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768524    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768529    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768534    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768538    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768542    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768547    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768551    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768556    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768560    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768564    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768568    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:20:56.771365 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768573    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768577    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768582    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768586    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768590    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768594    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768599    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768603    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768608    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768614    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768620    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768624    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768628    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768632    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768636    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768640    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768644    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768648    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768652    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768657    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:20:56.772078 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768661    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768665    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768669    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768673    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768678    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768682    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768687    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768691    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768695    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768699    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768703    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768707    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768712    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768716    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768720    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768724    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768728    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768732    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768737    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768742    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:20:56.772898 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768746    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768751    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768755    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768759    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768763    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768767    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768771    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768775    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768779    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768783    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768787    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768791    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768795    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768800    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768804    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768808    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768814    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768818    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768823    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:20:56.773565 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768827    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:20:56.774080 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768831    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:20:56.774080 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768835    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:20:56.774080 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768839    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:20:56.774080 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768843    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:20:56.774080 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768847    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:20:56.774080 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768851    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:20:56.774080 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768855    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:20:56.774080 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768862    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:20:56.774080 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768867    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:20:56.774080 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768872    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:20:56.774080 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768877    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:20:56.774080 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768882    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:20:56.774080 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768886    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:20:56.774080 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768891    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:20:56.774080 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768896    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:20:56.774080 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.768900    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:20:56.774499 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.768908    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 17:20:56.774499 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769106    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 17:20:56.774499 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769115    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 17:20:56.774499 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769120    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 17:20:56.774499 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769124    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 17:20:56.774499 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769128    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 17:20:56.774499 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769132    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 17:20:56.774499 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769137    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 17:20:56.774499 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769142    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 17:20:56.774499 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769146    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 17:20:56.774499 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769151    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 17:20:56.774499 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769155    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 17:20:56.774499 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769159    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 17:20:56.774499 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769165    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 17:20:56.774499 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769169    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769173    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769177    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769181    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769185    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769189    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769193    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769197    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769201    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769206    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769209    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769214    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769218    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769223    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769227    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769231    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769237    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769243    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769248    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769252    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 17:20:56.774866 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769256    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769260    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769264    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769268    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769273    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769277    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769281    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769285    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769290    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769294    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769298    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769305    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769312    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769319    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769324    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769330    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769335    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769339    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769344    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 17:20:56.775346 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769348    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769352    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769357    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769361    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769365    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769369    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769373    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769377    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769382    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769386    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769390    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769394    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769399    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769403    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769407    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769411    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769434    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769439    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769443    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769446    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 17:20:56.776023 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769450    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769454    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769458    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769462    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769467    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769471    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769477    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769481    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769485    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769489    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769493    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769498    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769502    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769506    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769511    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769515    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769519    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769523    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769528    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 17:20:56.776605 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769532    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 17:20:56.777064 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769536    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 17:20:56.777064 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769540    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 17:20:56.777064 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769545    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 17:20:56.777064 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769548    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 17:20:56.777064 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769552    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 17:20:56.777064 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769556    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 17:20:56.777064 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:56.769560    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 17:20:56.777064 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.769568    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 17:20:56.777064 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.769748    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 17:20:56.777064 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.773333    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 17:20:56.777064 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.775432    2579 server.go:1019] "Starting client certificate rotation"
Jul 27 17:20:56.777064 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.775534    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 17:20:56.777064 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.775570    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 17:20:56.778236 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.778217    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 17:20:56.783554 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.783531    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 17:20:56.796457 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.796437    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 27 17:20:56.799142 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.799119    2579 log.go:25] "Validated CRI v1 image API"
Jul 27 17:20:56.800095 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.800067    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 17:20:56.802549 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.802526    2579 fs.go:135] Filesystem UUIDs: map[673c5953-d425-4fdb-9fe8-965bbad0dc01:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7b762fa3-175d-43a5-8353-7d1dd1a81d90:/dev/nvme0n1p4]
Jul 27 17:20:56.802627 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.802547    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 17:20:56.808352 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.808327    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 17:20:56.809111 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.808748    2579 manager.go:216] Machine: {Timestamp:2026-07-27 17:20:56.807131042 +0000 UTC m=+0.338882042 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3142665 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c6c6cbbf9106ae21d3c53c2493846 SystemUUID:ec2c6c6c-bbf9-106a-e21d-3c53c2493846 BootID:56b7cb5c-cf92-4a67-87a9-e2641f1a0e55 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:08:c8:15:e8:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:08:c8:15:e8:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:1e:06:63:7a:2c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 17:20:56.809111 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.809107    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 17:20:56.809267 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.809254    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 17:20:56.812147 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.812112    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 17:20:56.812283 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.812150    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-74.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 17:20:56.813245 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.813234    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 17:20:56.813278 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.813247    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 17:20:56.813278 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.813255    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 17:20:56.813940 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.813930    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 17:20:56.814502 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.814492    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 17:20:56.817131 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.817120    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 17:20:56.817286 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.817277    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 17:20:56.817317 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.817308    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 17:20:56.817352 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.817318    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 17:20:56.817352 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.817329    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 17:20:56.817352 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.817338    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 27 17:20:56.817352 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.817352    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 17:20:56.817762 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.817746    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 17:20:56.817830 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.817768    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 17:20:56.820588 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.820572    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 17:20:56.822324 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.822310    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 17:20:56.822385 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.822341    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 17:20:56.823568 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.823556    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 17:20:56.823606 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.823577    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 17:20:56.823606 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.823585    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 17:20:56.823606 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.823593    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 17:20:56.823606 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.823601    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 17:20:56.823606 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.823607    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 17:20:56.823736 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.823615    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 17:20:56.823736 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.823621    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 17:20:56.823736 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.823627    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 17:20:56.823736 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.823633    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 17:20:56.823736 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.823641    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 17:20:56.823736 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.823646    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 17:20:56.824579 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.824569    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 17:20:56.824579 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.824579    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 17:20:56.827175 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.827157    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-74.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 17:20:56.827469 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:56.827435    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-74.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 17:20:56.827469 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:56.827438    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 17:20:56.827928 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.827907    2579 server.go:1268] "Started kubelet"
Jul 27 17:20:56.828026 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.827972    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 17:20:56.828292 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.827994    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 17:20:56.828383 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.828323    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 17:20:56.828796 ip-10-0-128-74 systemd[1]: Started Kubernetes Kubelet.
Jul 27 17:20:56.829831 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.829816    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 17:20:56.830154 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.830140    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 17:20:56.832769 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:56.832748    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 17:20:56.835537 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.835523    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 17:20:56.835613 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.835564    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 17:20:56.835832 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:56.834631    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-74.ec2.internal.18c6354149e51998  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-74.ec2.internal,UID:ip-10-0-128-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-74.ec2.internal,},FirstTimestamp:2026-07-27 17:20:56.827877784 +0000 UTC m=+0.359628760,LastTimestamp:2026-07-27 17:20:56.827877784 +0000 UTC m=+0.359628760,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-74.ec2.internal,}"
Jul 27 17:20:56.836050 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:56.835928    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found"
Jul 27 17:20:56.836388 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.836362    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 17:20:56.836501 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.836391    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 17:20:56.836501 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.836447    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 17:20:56.836610 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.836562    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 17:20:56.836610 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.836575    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 17:20:56.836992 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.836974    2579 factory.go:153] Registering CRI-O factory
Jul 27 17:20:56.836992 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.836993    2579 factory.go:223] Registration of the crio container factory successfully
Jul 27 17:20:56.837107 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.837040    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 17:20:56.837107 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.837047    2579 factory.go:55] Registering systemd factory
Jul 27 17:20:56.837107 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.837052    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 27 17:20:56.837107 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.837073    2579 factory.go:103] Registering Raw factory
Jul 27 17:20:56.837107 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.837089    2579 manager.go:1196] Started watching for new ooms in manager
Jul 27 17:20:56.837684 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.837666    2579 manager.go:349] Starting recovery of all containers
Jul 27 17:20:56.838586 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:56.838563    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-74.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 17:20:56.838792 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:56.838772    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 17:20:56.849487 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.849349    2579 manager.go:354] Recovery completed
Jul 27 17:20:56.853923 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.853911    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:20:56.855664 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.855645    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:20:56.855754 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.855683    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:20:56.855754 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.855699    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:20:56.856241 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.856224    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 17:20:56.856290 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.856242    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 17:20:56.856290 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.856263    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 17:20:56.856290 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.856282    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:20:56.856975 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.856958    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:20:56.857056 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.856983    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:20:56.857056 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.856994    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:20:56.857593 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:56.857522    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-74.ec2.internal.18c635414b8d1abd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-74.ec2.internal,UID:ip-10-0-128-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-74.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-74.ec2.internal,},FirstTimestamp:2026-07-27 17:20:56.855665341 +0000 UTC m=+0.387416326,LastTimestamp:2026-07-27 17:20:56.855665341 +0000 UTC m=+0.387416326,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-74.ec2.internal,}"
Jul 27 17:20:56.858947 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.858935    2579 policy_none.go:49] "None policy: Start"
Jul 27 17:20:56.859001 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.858951    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 17:20:56.859001 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.858961    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 17:20:56.861078 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.861051    2579 policy_none.go:47] "Start"
Jul 27 17:20:56.867568 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:56.867486    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-74.ec2.internal.18c635414b8d7a26  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-74.ec2.internal,UID:ip-10-0-128-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-74.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-74.ec2.internal,},FirstTimestamp:2026-07-27 17:20:56.855689766 +0000 UTC m=+0.387440744,LastTimestamp:2026-07-27 17:20:56.855689766 +0000 UTC m=+0.387440744,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-74.ec2.internal,}"
Jul 27 17:20:56.879522 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:56.879452    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-74.ec2.internal.18c635414b8db25d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-74.ec2.internal,UID:ip-10-0-128-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-74.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-74.ec2.internal,},FirstTimestamp:2026-07-27 17:20:56.855704157 +0000 UTC m=+0.387455136,LastTimestamp:2026-07-27 17:20:56.855704157 +0000 UTC m=+0.387455136,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-74.ec2.internal,}"
Jul 27 17:20:56.883603 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.883583    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2kbnf"
Jul 27 17:20:56.887097 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:56.887032    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-74.ec2.internal.18c635414b8d1abd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-74.ec2.internal.18c635414b8d1abd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-74.ec2.internal,UID:ip-10-0-128-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-74.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-74.ec2.internal,},FirstTimestamp:2026-07-27 17:20:56.855665341 +0000 UTC m=+0.387416326,LastTimestamp:2026-07-27 17:20:56.856971361 +0000 UTC m=+0.388722338,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-74.ec2.internal,}"
Jul 27 17:20:56.892300 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.892283    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2kbnf"
Jul 27 17:20:56.897007 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.896994    2579 manager.go:337] "Starting Device Plugin manager"
Jul 27 17:20:56.897066 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:56.897025    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 17:20:56.897066 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.897037    2579 server.go:87] "Starting device plugin registration server"
Jul 27 17:20:56.897296 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.897285    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 17:20:56.897672 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:56.897591    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-74.ec2.internal.18c635414b8d7a26\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-74.ec2.internal.18c635414b8d7a26  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-74.ec2.internal,UID:ip-10-0-128-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-74.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-74.ec2.internal,},FirstTimestamp:2026-07-27 17:20:56.855689766 +0000 UTC m=+0.387440744,LastTimestamp:2026-07-27 17:20:56.856987972 +0000 UTC m=+0.388738949,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-74.ec2.internal,}"
Jul 27 17:20:56.897796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.897768    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 17:20:56.897970 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.897864    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 17:20:56.897970 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.897967    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 17:20:56.898078 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.897976    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 17:20:56.898493 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:56.898472    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 17:20:56.898578 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:56.898518    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-74.ec2.internal\" not found"
Jul 27 17:20:56.985244 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.985207    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 17:20:56.987380 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.986539    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 17:20:56.987380 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.986573    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 17:20:56.987380 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.986597    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 17:20:56.987380 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:56.986638    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 17:20:56.989487 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.989466    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:20:56.998742 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.998689    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:20:56.999464 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.999447    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:20:56.999528 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.999484    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:20:56.999528 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.999499    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:20:56.999528 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:56.999524    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-74.ec2.internal"
Jul 27 17:20:57.008169 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.008155    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-74.ec2.internal"
Jul 27 17:20:57.008223 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:57.008175    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-74.ec2.internal\": node \"ip-10-0-128-74.ec2.internal\" not found"
Jul 27 17:20:57.058551 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:57.058528    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found"
Jul 27 17:20:57.087535 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.087509    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal"]
Jul 27 17:20:57.087608 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.087575    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:20:57.088498 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.088483    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:20:57.088579 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.088511    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:20:57.088579 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.088529    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:20:57.090784 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.090772    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:20:57.090909 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.090896    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal"
Jul 27 17:20:57.090946 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.090925    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:20:57.091524 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.091508    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:20:57.091606 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.091524    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:20:57.091606 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.091540    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:20:57.091606 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.091544    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:20:57.091606 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.091554    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:20:57.091780 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.091554    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:20:57.093772 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.093755    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal"
Jul 27 17:20:57.093855 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.093785    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:20:57.094472 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.094455    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:20:57.094472 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.094482    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:20:57.094636 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.094493    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:20:57.113005 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:57.112977    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-74.ec2.internal\" not found" node="ip-10-0-128-74.ec2.internal"
Jul 27 17:20:57.116357 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:57.116340    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-74.ec2.internal\" not found" node="ip-10-0-128-74.ec2.internal"
Jul 27 17:20:57.138043 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.138025    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0c3c3e6cc40a8e9ec18fa8af08b36f88-config\") pod \"kube-apiserver-proxy-ip-10-0-128-74.ec2.internal\" (UID: \"0c3c3e6cc40a8e9ec18fa8af08b36f88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal"
Jul 27 17:20:57.138114 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.138048    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dd105fb28bdc196289212f0eb76d77d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal\" (UID: \"dd105fb28bdc196289212f0eb76d77d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal"
Jul 27 17:20:57.138114 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.138066    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd105fb28bdc196289212f0eb76d77d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal\" (UID: \"dd105fb28bdc196289212f0eb76d77d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal"
Jul 27 17:20:57.158975 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:57.158953    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found"
Jul 27 17:20:57.238908 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.238877    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dd105fb28bdc196289212f0eb76d77d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal\" (UID: \"dd105fb28bdc196289212f0eb76d77d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal"
Jul 27 17:20:57.238908 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.238909    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd105fb28bdc196289212f0eb76d77d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal\" (UID: \"dd105fb28bdc196289212f0eb76d77d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal"
Jul 27 17:20:57.239104 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.238937    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0c3c3e6cc40a8e9ec18fa8af08b36f88-config\") pod \"kube-apiserver-proxy-ip-10-0-128-74.ec2.internal\" (UID: \"0c3c3e6cc40a8e9ec18fa8af08b36f88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal"
Jul 27 17:20:57.239104 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.238983    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0c3c3e6cc40a8e9ec18fa8af08b36f88-config\") pod \"kube-apiserver-proxy-ip-10-0-128-74.ec2.internal\" (UID: \"0c3c3e6cc40a8e9ec18fa8af08b36f88\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal"
Jul 27 17:20:57.239104 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.238999    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dd105fb28bdc196289212f0eb76d77d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal\" (UID: \"dd105fb28bdc196289212f0eb76d77d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal"
Jul 27 17:20:57.239104 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.239033    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd105fb28bdc196289212f0eb76d77d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal\" (UID: \"dd105fb28bdc196289212f0eb76d77d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal"
Jul 27 17:20:57.260031 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:57.259976    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found"
Jul 27 17:20:57.360825 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:57.360792    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found"
Jul 27 17:20:57.416003 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.415975    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal"
Jul 27 17:20:57.419264 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.419246    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal"
Jul 27 17:20:57.461596 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:57.461571    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found"
Jul 27 17:20:57.562483 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:57.562453    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found"
Jul 27 17:20:57.664004 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:57.663948    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found"
Jul 27 17:20:57.764519 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:57.764488    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found"
Jul 27 17:20:57.774376 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.774322    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 17:20:57.774512 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.774492    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 17:20:57.865029 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:57.864983    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found"
Jul 27 17:20:57.873640 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.873616    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:20:57.897540 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.897503    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 17:15:57 +0000 UTC" deadline="2028-01-09 02:09:02.800541414 +0000 UTC"
Jul 27 17:20:57.897540 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.897531    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12728h48m4.90301262s"
Jul 27 17:20:57.906410 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:57.906393    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:20:57.965189 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:57.965149    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found"
Jul 27 17:20:58.017995 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.017969    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 17:20:58.019369 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.019344    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 17:20:58.019528 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.019387    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 17:20:58.019528 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.019404    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeHasSufficientPID"
Jul 27 17:20:58.065626 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:58.065542    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found"
Jul 27 17:20:58.093234 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:58.093200    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd105fb28bdc196289212f0eb76d77d6.slice/crio-99872dca82ef4bd2984f7494763d7f1ba255dad984aad1eb72a7a278ab3da2ef WatchSource:0}: Error finding container 99872dca82ef4bd2984f7494763d7f1ba255dad984aad1eb72a7a278ab3da2ef: Status 404 returned error can't find the container with id 99872dca82ef4bd2984f7494763d7f1ba255dad984aad1eb72a7a278ab3da2ef
Jul 27 17:20:58.099610 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.099589    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:20:58.106022 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:58.105995    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3c3e6cc40a8e9ec18fa8af08b36f88.slice/crio-f89d5ab53b054e4d2b4803ff92cb91f7fe57de447aea1a6cbf5a1aac543dd08f WatchSource:0}: Error finding container f89d5ab53b054e4d2b4803ff92cb91f7fe57de447aea1a6cbf5a1aac543dd08f: Status 404 returned error can't find the container with id f89d5ab53b054e4d2b4803ff92cb91f7fe57de447aea1a6cbf5a1aac543dd08f
Jul 27 17:20:58.166634 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:58.166584    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found"
Jul 27 17:20:58.267765 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:58.267725    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-74.ec2.internal\" not found"
Jul 27 17:20:58.289727 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.289707    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:20:58.337060 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.337000    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal"
Jul 27 17:20:58.348154 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.348134    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 17:20:58.349332 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.349318    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal"
Jul 27 17:20:58.358264 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.358244    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 17:20:58.775046 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.774963    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 17:20:58.819168 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.819136    2579 apiserver.go:52] "Watching apiserver"
Jul 27 17:20:58.824953 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.824929    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 17:20:58.825379 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.825352    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-nl5s4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s","openshift-cluster-node-tuning-operator/tuned-mk665","openshift-dns/node-resolver-7wtxl","openshift-image-registry/node-ca-vvdfm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal","openshift-multus/multus-additional-cni-plugins-kv4hm","openshift-multus/multus-qc22j","kube-system/global-pull-secret-syncer-lx499","kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal","openshift-multus/network-metrics-daemon-qdbml","openshift-network-diagnostics/network-check-target-gnx7q","openshift-network-operator/iptables-alerter-865dp","openshift-ovn-kubernetes/ovnkube-node-g962t"]
Jul 27 17:20:58.828132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.828108    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.830192 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.830173    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 17:20:58.830342 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.830322    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 17:20:58.830532 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.830514    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 17:20:58.830678 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.830662    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 17:20:58.830751 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.830701    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 17:20:58.830894 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.830876    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-865dp"
Jul 27 17:20:58.831011 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.830990    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pxtmn\""
Jul 27 17:20:58.832789 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.832767    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:20:58.833172 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.833146    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tgcgh\""
Jul 27 17:20:58.833380 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.833365    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 17:20:58.833563 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.833548    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 17:20:58.833738 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.833725    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.835843 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.835819    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 17:20:58.836110 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.836088    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:20:58.836176 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.836131    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 17:20:58.836176 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.836146    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xp4lh\""
Jul 27 17:20:58.836968 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.836603    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7wtxl"
Jul 27 17:20:58.838226 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.838205    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vvdfm"
Jul 27 17:20:58.839006 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.838988    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 17:20:58.839092 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.839008    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pjdbj\""
Jul 27 17:20:58.839092 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.839066    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 17:20:58.840134 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.840112    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 17:20:58.840232 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.840213    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 17:20:58.840731 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.840689    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vl4wk\""
Jul 27 17:20:58.840731 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.840687    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 17:20:58.841675 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.841644    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.843684 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.843663    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 17:20:58.843784 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.843694    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 17:20:58.843856 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.843663    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qg782\""
Jul 27 17:20:58.843856 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.843814    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 17:20:58.844039 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.844018    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 17:20:58.844105 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.844022    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 17:20:58.844765 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.844361    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 17:20:58.844765 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.844620    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:20:58.844765 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:58.844679    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:20:58.845501 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.845449    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 17:20:58.846700 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.846679    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-sysconfig\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.846807 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.846715    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-run\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.846807 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.846739    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-host\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.846807 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.846764    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h6v5\" (UniqueName: \"kubernetes.io/projected/a76aeaf9-9094-4328-b194-8c10eeb2a8c7-kube-api-access-4h6v5\") pod \"node-ca-vvdfm\" (UID: \"a76aeaf9-9094-4328-b194-8c10eeb2a8c7\") " pod="openshift-image-registry/node-ca-vvdfm"
Jul 27 17:20:58.846974 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.846809    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tlpq\" (UniqueName: \"kubernetes.io/projected/aefa7f7d-16e7-4697-9270-85fadc4f836e-kube-api-access-9tlpq\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.846974 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.846840    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/169d7b69-b4ab-445e-ac5d-18928540a11f-iptables-alerter-script\") pod \"iptables-alerter-865dp\" (UID: \"169d7b69-b4ab-445e-ac5d-18928540a11f\") " pod="openshift-network-operator/iptables-alerter-865dp"
Jul 27 17:20:58.846974 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.846872    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg5cj\" (UniqueName: \"kubernetes.io/projected/169d7b69-b4ab-445e-ac5d-18928540a11f-kube-api-access-fg5cj\") pod \"iptables-alerter-865dp\" (UID: \"169d7b69-b4ab-445e-ac5d-18928540a11f\") " pod="openshift-network-operator/iptables-alerter-865dp"
Jul 27 17:20:58.846974 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.846900    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a76aeaf9-9094-4328-b194-8c10eeb2a8c7-host\") pod \"node-ca-vvdfm\" (UID: \"a76aeaf9-9094-4328-b194-8c10eeb2a8c7\") " pod="openshift-image-registry/node-ca-vvdfm"
Jul 27 17:20:58.846974 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.846924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6362be28-866c-43b9-8b11-912ee59f184c-tmp\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.846974 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.846948    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tx7x\" (UniqueName: \"kubernetes.io/projected/6362be28-866c-43b9-8b11-912ee59f184c-kube-api-access-9tx7x\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.847254 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.846990    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nl5s4"
Jul 27 17:20:58.847254 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.846991    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aefa7f7d-16e7-4697-9270-85fadc4f836e-system-cni-dir\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.847254 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847025    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aefa7f7d-16e7-4697-9270-85fadc4f836e-os-release\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.847254 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aefa7f7d-16e7-4697-9270-85fadc4f836e-cni-binary-copy\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.847254 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847088    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aefa7f7d-16e7-4697-9270-85fadc4f836e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.847254 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847117    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-kubernetes\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.847254 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847140    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-sysctl-d\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.847254 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847163    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aefa7f7d-16e7-4697-9270-85fadc4f836e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.847254 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847185    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/169d7b69-b4ab-445e-ac5d-18928540a11f-host-slash\") pod \"iptables-alerter-865dp\" (UID: \"169d7b69-b4ab-445e-ac5d-18928540a11f\") " pod="openshift-network-operator/iptables-alerter-865dp"
Jul 27 17:20:58.847254 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847206    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-modprobe-d\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.847254 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847237    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-systemd\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.847885 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847279    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-var-lib-kubelet\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.847885 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/93f3cc59-b8f9-413e-9c63-917f1dada6e5-hosts-file\") pod \"node-resolver-7wtxl\" (UID: \"93f3cc59-b8f9-413e-9c63-917f1dada6e5\") " pod="openshift-dns/node-resolver-7wtxl"
Jul 27 17:20:58.847885 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93f3cc59-b8f9-413e-9c63-917f1dada6e5-tmp-dir\") pod \"node-resolver-7wtxl\" (UID: \"93f3cc59-b8f9-413e-9c63-917f1dada6e5\") " pod="openshift-dns/node-resolver-7wtxl"
Jul 27 17:20:58.847885 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847349    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfstn\" (UniqueName: \"kubernetes.io/projected/93f3cc59-b8f9-413e-9c63-917f1dada6e5-kube-api-access-jfstn\") pod \"node-resolver-7wtxl\" (UID: \"93f3cc59-b8f9-413e-9c63-917f1dada6e5\") " pod="openshift-dns/node-resolver-7wtxl"
Jul 27 17:20:58.847885 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847374    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6362be28-866c-43b9-8b11-912ee59f184c-etc-tuned\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.847885 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847401    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a76aeaf9-9094-4328-b194-8c10eeb2a8c7-serviceca\") pod \"node-ca-vvdfm\" (UID: \"a76aeaf9-9094-4328-b194-8c10eeb2a8c7\") " pod="openshift-image-registry/node-ca-vvdfm"
Jul 27 17:20:58.847885 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847421    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-sys\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.847885 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847448    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-lib-modules\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.847885 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847471    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aefa7f7d-16e7-4697-9270-85fadc4f836e-cnibin\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.847885 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847509    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aefa7f7d-16e7-4697-9270-85fadc4f836e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.847885 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.847540    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-sysctl-conf\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.848971 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.848951    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9j5fv\""
Jul 27 17:20:58.848971 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.848963    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 17:20:58.849127 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.849009    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 17:20:58.849619 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.849589    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:58.851822 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.851802    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 17:20:58.852366 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.851991    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.852366 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.852201    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d6chq\""
Jul 27 17:20:58.852480 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.852419    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 17:20:58.852679 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.852658    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 17:20:58.854089 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.854069    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 17:20:58.854204 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.854187    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wpb8l\""
Jul 27 17:20:58.854609 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.854587    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:20:58.854702 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:58.854667    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:20:58.857119 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.857103    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:20:58.857206 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:58.857157    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:20:58.875419 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.875394    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-djm4m"
Jul 27 17:20:58.884633 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.884563    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-djm4m"
Jul 27 17:20:58.938507 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.938472    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 17:20:58.948535 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948502    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-var-lib-cni-bin\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.948671 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-hostroot\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.948671 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948600    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6362be28-866c-43b9-8b11-912ee59f184c-etc-tuned\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.948671 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a76aeaf9-9094-4328-b194-8c10eeb2a8c7-serviceca\") pod \"node-ca-vvdfm\" (UID: \"a76aeaf9-9094-4328-b194-8c10eeb2a8c7\") " pod="openshift-image-registry/node-ca-vvdfm"
Jul 27 17:20:58.948671 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948653    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-log-socket\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.948878 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e949f3f4-9aba-4f97-93b1-911bb441f8a8-konnectivity-ca\") pod \"konnectivity-agent-nl5s4\" (UID: \"e949f3f4-9aba-4f97-93b1-911bb441f8a8\") " pod="kube-system/konnectivity-agent-nl5s4"
Jul 27 17:20:58.948878 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948713    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-socket-dir\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:58.948878 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-multus-cni-dir\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.948878 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948766    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-os-release\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.948878 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948814    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-lib-modules\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.948878 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aefa7f7d-16e7-4697-9270-85fadc4f836e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.948878 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948863    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-sysctl-conf\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948889    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-run-systemd\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948914    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-var-lib-openvswitch\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-sysconfig\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948962    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-run\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948985    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-host\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.948998    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-slash\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949022    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aefa7f7d-16e7-4697-9270-85fadc4f836e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949035    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b603923-c0d1-40b0-8524-4caadba97b2d-ovnkube-config\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949053    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-sysconfig\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949063    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-etc-openvswitch\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949000    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-lib-modules\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949088    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-sysctl-conf\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949101    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-host\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949162    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njwfl\" (UniqueName: \"kubernetes.io/projected/5b603923-c0d1-40b0-8524-4caadba97b2d-kube-api-access-njwfl\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949190    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a76aeaf9-9094-4328-b194-8c10eeb2a8c7-serviceca\") pod \"node-ca-vvdfm\" (UID: \"a76aeaf9-9094-4328-b194-8c10eeb2a8c7\") " pod="openshift-image-registry/node-ca-vvdfm"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949207    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-run\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.949234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949203    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-device-dir\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:58.950137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949239    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-sys-fs\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:58.950137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949275    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/509006d0-5205-42b6-91e8-eb9ac5ac3c33-cni-binary-copy\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.950137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949307    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a76aeaf9-9094-4328-b194-8c10eeb2a8c7-host\") pod \"node-ca-vvdfm\" (UID: \"a76aeaf9-9094-4328-b194-8c10eeb2a8c7\") " pod="openshift-image-registry/node-ca-vvdfm"
Jul 27 17:20:58.950137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949325    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-run-openvswitch\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.950137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949348    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-node-log\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.950137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949371    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-run-ovn-kubernetes\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.950137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949387    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-system-cni-dir\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.950137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949403    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a76aeaf9-9094-4328-b194-8c10eeb2a8c7-host\") pod \"node-ca-vvdfm\" (UID: \"a76aeaf9-9094-4328-b194-8c10eeb2a8c7\") " pod="openshift-image-registry/node-ca-vvdfm"
Jul 27 17:20:58.950137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-cnibin\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.950137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-run-multus-certs\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.950137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949484    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-etc-kubernetes\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.950137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949501    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6362be28-866c-43b9-8b11-912ee59f184c-tmp\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.950137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949528    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tx7x\" (UniqueName: \"kubernetes.io/projected/6362be28-866c-43b9-8b11-912ee59f184c-kube-api-access-9tx7x\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.950137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949571    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aefa7f7d-16e7-4697-9270-85fadc4f836e-system-cni-dir\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.950137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949599    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aefa7f7d-16e7-4697-9270-85fadc4f836e-os-release\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.950137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949627    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aefa7f7d-16e7-4697-9270-85fadc4f836e-cni-binary-copy\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.950137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-kubernetes\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.951048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949687    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-systemd\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.951048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/93f3cc59-b8f9-413e-9c63-917f1dada6e5-hosts-file\") pod \"node-resolver-7wtxl\" (UID: \"93f3cc59-b8f9-413e-9c63-917f1dada6e5\") " pod="openshift-dns/node-resolver-7wtxl"
Jul 27 17:20:58.951048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.949735    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aefa7f7d-16e7-4697-9270-85fadc4f836e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.951048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950043    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-modprobe-d\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.951048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950221    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-run-netns\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.951048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950237    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-systemd\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.951048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950249    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-modprobe-d\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.951048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950279    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-run-ovn\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.951048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950315    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/60a2b76f-7c85-4e78-89f2-56d0556836d2-dbus\") pod \"global-pull-secret-syncer-lx499\" (UID: \"60a2b76f-7c85-4e78-89f2-56d0556836d2\") " pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:20:58.951048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950345    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e949f3f4-9aba-4f97-93b1-911bb441f8a8-agent-certs\") pod \"konnectivity-agent-nl5s4\" (UID: \"e949f3f4-9aba-4f97-93b1-911bb441f8a8\") " pod="kube-system/konnectivity-agent-nl5s4"
Jul 27 17:20:58.951048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950357    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-kubernetes\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.951048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-kubelet-dir\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:58.951048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mznk6\" (UniqueName: \"kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6\") pod \"network-check-target-gnx7q\" (UID: \"19b8b02a-b424-4457-99d7-27434924db05\") " pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:20:58.951048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950424    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aefa7f7d-16e7-4697-9270-85fadc4f836e-os-release\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.951048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950438    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b603923-c0d1-40b0-8524-4caadba97b2d-env-overrides\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.951048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950507    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b603923-c0d1-40b0-8524-4caadba97b2d-ovnkube-script-lib\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.951048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950583    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-var-lib-kubelet\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.952132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950611    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs\") pod \"network-metrics-daemon-qdbml\" (UID: \"d28f5e0f-9c2d-40ba-9733-e4d66a23b602\") " pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:20:58.952132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950706    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/93f3cc59-b8f9-413e-9c63-917f1dada6e5-hosts-file\") pod \"node-resolver-7wtxl\" (UID: \"93f3cc59-b8f9-413e-9c63-917f1dada6e5\") " pod="openshift-dns/node-resolver-7wtxl"
Jul 27 17:20:58.952132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950773    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aefa7f7d-16e7-4697-9270-85fadc4f836e-system-cni-dir\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.952132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950885    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5wwx\" (UniqueName: \"kubernetes.io/projected/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-kube-api-access-k5wwx\") pod \"network-metrics-daemon-qdbml\" (UID: \"d28f5e0f-9c2d-40ba-9733-e4d66a23b602\") " pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:20:58.952132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950919    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aefa7f7d-16e7-4697-9270-85fadc4f836e-cni-binary-copy\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.952132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950922    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-sys\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.952132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950972    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-sys\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.952132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.950980    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-multus-conf-dir\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.952132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.951017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aefa7f7d-16e7-4697-9270-85fadc4f836e-cnibin\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.952132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.951052    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-kubelet\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.952132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.951060    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aefa7f7d-16e7-4697-9270-85fadc4f836e-cnibin\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.952132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.951057    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aefa7f7d-16e7-4697-9270-85fadc4f836e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.952132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.951088    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.952132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.951161    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/60a2b76f-7c85-4e78-89f2-56d0556836d2-kubelet-config\") pod \"global-pull-secret-syncer-lx499\" (UID: \"60a2b76f-7c85-4e78-89f2-56d0556836d2\") " pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:20:58.952132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.951203    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret\") pod \"global-pull-secret-syncer-lx499\" (UID: \"60a2b76f-7c85-4e78-89f2-56d0556836d2\") " pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:20:58.952132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.951229    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-run-k8s-cni-cncf-io\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.952971 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.952837    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6362be28-866c-43b9-8b11-912ee59f184c-etc-tuned\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.955749 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.953578    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-var-lib-cni-multus\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.955749 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.953642    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h6v5\" (UniqueName: \"kubernetes.io/projected/a76aeaf9-9094-4328-b194-8c10eeb2a8c7-kube-api-access-4h6v5\") pod \"node-ca-vvdfm\" (UID: \"a76aeaf9-9094-4328-b194-8c10eeb2a8c7\") " pod="openshift-image-registry/node-ca-vvdfm"
Jul 27 17:20:58.955749 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.953676    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2zpw\" (UniqueName: \"kubernetes.io/projected/4376a23d-e8f9-45b4-a475-b571014db151-kube-api-access-h2zpw\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:58.955749 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.953690    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6362be28-866c-43b9-8b11-912ee59f184c-tmp\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.955749 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.953702    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tlpq\" (UniqueName: \"kubernetes.io/projected/aefa7f7d-16e7-4697-9270-85fadc4f836e-kube-api-access-9tlpq\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.955749 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.953735    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-cni-bin\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.955749 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.953765    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-cni-netd\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.955749 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.953795    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b603923-c0d1-40b0-8524-4caadba97b2d-ovn-node-metrics-cert\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.955749 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.953827    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/509006d0-5205-42b6-91e8-eb9ac5ac3c33-multus-daemon-config\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.955749 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.953854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/169d7b69-b4ab-445e-ac5d-18928540a11f-iptables-alerter-script\") pod \"iptables-alerter-865dp\" (UID: \"169d7b69-b4ab-445e-ac5d-18928540a11f\") " pod="openshift-network-operator/iptables-alerter-865dp"
Jul 27 17:20:58.955749 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.953886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg5cj\" (UniqueName: \"kubernetes.io/projected/169d7b69-b4ab-445e-ac5d-18928540a11f-kube-api-access-fg5cj\") pod \"iptables-alerter-865dp\" (UID: \"169d7b69-b4ab-445e-ac5d-18928540a11f\") " pod="openshift-network-operator/iptables-alerter-865dp"
Jul 27 17:20:58.955749 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.953915    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-systemd-units\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:58.955749 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.953947    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aefa7f7d-16e7-4697-9270-85fadc4f836e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.955749 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.953979    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-sysctl-d\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.955749 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.954008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93f3cc59-b8f9-413e-9c63-917f1dada6e5-tmp-dir\") pod \"node-resolver-7wtxl\" (UID: \"93f3cc59-b8f9-413e-9c63-917f1dada6e5\") " pod="openshift-dns/node-resolver-7wtxl"
Jul 27 17:20:58.955749 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.954299    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93f3cc59-b8f9-413e-9c63-917f1dada6e5-tmp-dir\") pod \"node-resolver-7wtxl\" (UID: \"93f3cc59-b8f9-413e-9c63-917f1dada6e5\") " pod="openshift-dns/node-resolver-7wtxl"
Jul 27 17:20:58.955749 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.954349    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfstn\" (UniqueName: \"kubernetes.io/projected/93f3cc59-b8f9-413e-9c63-917f1dada6e5-kube-api-access-jfstn\") pod \"node-resolver-7wtxl\" (UID: \"93f3cc59-b8f9-413e-9c63-917f1dada6e5\") " pod="openshift-dns/node-resolver-7wtxl"
Jul 27 17:20:58.956567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.954389    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-etc-selinux\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:58.956567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.954422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-multus-socket-dir-parent\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.956567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.954455    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-run-netns\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.956567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.954518    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clbls\" (UniqueName: \"kubernetes.io/projected/509006d0-5205-42b6-91e8-eb9ac5ac3c33-kube-api-access-clbls\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:58.956567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.954547    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/169d7b69-b4ab-445e-ac5d-18928540a11f-host-slash\") pod \"iptables-alerter-865dp\" (UID: \"169d7b69-b4ab-445e-ac5d-18928540a11f\") " pod="openshift-network-operator/iptables-alerter-865dp"
Jul 27 17:20:58.956567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.954583    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-var-lib-kubelet\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.956567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.954613    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/169d7b69-b4ab-445e-ac5d-18928540a11f-iptables-alerter-script\") pod \"iptables-alerter-865dp\" (UID: \"169d7b69-b4ab-445e-ac5d-18928540a11f\") " pod="openshift-network-operator/iptables-alerter-865dp"
Jul 27 17:20:58.956567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.954622    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-registration-dir\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:58.956567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.954796    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-etc-sysctl-d\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.956567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.954851    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/169d7b69-b4ab-445e-ac5d-18928540a11f-host-slash\") pod \"iptables-alerter-865dp\" (UID: \"169d7b69-b4ab-445e-ac5d-18928540a11f\") " pod="openshift-network-operator/iptables-alerter-865dp"
Jul 27 17:20:58.956567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.954860    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6362be28-866c-43b9-8b11-912ee59f184c-var-lib-kubelet\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.956567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.955317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aefa7f7d-16e7-4697-9270-85fadc4f836e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.974516 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.974493    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tx7x\" (UniqueName: \"kubernetes.io/projected/6362be28-866c-43b9-8b11-912ee59f184c-kube-api-access-9tx7x\") pod \"tuned-mk665\" (UID: \"6362be28-866c-43b9-8b11-912ee59f184c\") " pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:58.974643 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.974541    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h6v5\" (UniqueName: \"kubernetes.io/projected/a76aeaf9-9094-4328-b194-8c10eeb2a8c7-kube-api-access-4h6v5\") pod \"node-ca-vvdfm\" (UID: \"a76aeaf9-9094-4328-b194-8c10eeb2a8c7\") " pod="openshift-image-registry/node-ca-vvdfm"
Jul 27 17:20:58.982149 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.982119    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg5cj\" (UniqueName: \"kubernetes.io/projected/169d7b69-b4ab-445e-ac5d-18928540a11f-kube-api-access-fg5cj\") pod \"iptables-alerter-865dp\" (UID: \"169d7b69-b4ab-445e-ac5d-18928540a11f\") " pod="openshift-network-operator/iptables-alerter-865dp"
Jul 27 17:20:58.982299 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.982173    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfstn\" (UniqueName: \"kubernetes.io/projected/93f3cc59-b8f9-413e-9c63-917f1dada6e5-kube-api-access-jfstn\") pod \"node-resolver-7wtxl\" (UID: \"93f3cc59-b8f9-413e-9c63-917f1dada6e5\") " pod="openshift-dns/node-resolver-7wtxl"
Jul 27 17:20:58.982299 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.982280    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tlpq\" (UniqueName: \"kubernetes.io/projected/aefa7f7d-16e7-4697-9270-85fadc4f836e-kube-api-access-9tlpq\") pod \"multus-additional-cni-plugins-kv4hm\" (UID: \"aefa7f7d-16e7-4697-9270-85fadc4f836e\") " pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:58.992054 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.991998    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal" event={"ID":"0c3c3e6cc40a8e9ec18fa8af08b36f88","Type":"ContainerStarted","Data":"f89d5ab53b054e4d2b4803ff92cb91f7fe57de447aea1a6cbf5a1aac543dd08f"}
Jul 27 17:20:58.993239 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:58.993210    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal" event={"ID":"dd105fb28bdc196289212f0eb76d77d6","Type":"ContainerStarted","Data":"99872dca82ef4bd2984f7494763d7f1ba255dad984aad1eb72a7a278ab3da2ef"}
Jul 27 17:20:59.055747 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055662    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-systemd-units\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.055747 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055706    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-etc-selinux\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:59.055747 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055733    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-multus-socket-dir-parent\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.056043 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055756    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-run-netns\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.056043 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clbls\" (UniqueName: \"kubernetes.io/projected/509006d0-5205-42b6-91e8-eb9ac5ac3c33-kube-api-access-clbls\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.056043 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-registration-dir\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:59.056043 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055797    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-systemd-units\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.056043 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055812    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-var-lib-cni-bin\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.056043 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055827    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-hostroot\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.056043 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055834    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-multus-socket-dir-parent\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.056043 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-log-socket\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.056043 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055875    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-etc-selinux\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:59.056043 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055890    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-log-socket\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.056043 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e949f3f4-9aba-4f97-93b1-911bb441f8a8-konnectivity-ca\") pod \"konnectivity-agent-nl5s4\" (UID: \"e949f3f4-9aba-4f97-93b1-911bb441f8a8\") " pod="kube-system/konnectivity-agent-nl5s4"
Jul 27 17:20:59.056043 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055917    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-socket-dir\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:59.056043 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055942    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-multus-cni-dir\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.056043 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-os-release\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.056043 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.055997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-run-systemd\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056063    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-var-lib-openvswitch\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056088    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-socket-dir\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-slash\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056117    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-multus-cni-dir\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b603923-c0d1-40b0-8524-4caadba97b2d-ovnkube-config\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056162    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-var-lib-openvswitch\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056170    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-etc-openvswitch\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056130    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-run-systemd\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056194    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-slash\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njwfl\" (UniqueName: \"kubernetes.io/projected/5b603923-c0d1-40b0-8524-4caadba97b2d-kube-api-access-njwfl\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056174    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-os-release\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-device-dir\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056264    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-etc-openvswitch\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-var-lib-cni-bin\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056306    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-device-dir\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056311    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-run-netns\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-sys-fs\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:59.056852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056340    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-hostroot\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056362    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-registration-dir\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056366    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/509006d0-5205-42b6-91e8-eb9ac5ac3c33-cni-binary-copy\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056373    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e949f3f4-9aba-4f97-93b1-911bb441f8a8-konnectivity-ca\") pod \"konnectivity-agent-nl5s4\" (UID: \"e949f3f4-9aba-4f97-93b1-911bb441f8a8\") " pod="kube-system/konnectivity-agent-nl5s4"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056456    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-sys-fs\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056489    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-run-openvswitch\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056535    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-node-log\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056555    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-run-ovn-kubernetes\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056578    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-system-cni-dir\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056602    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-cnibin\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056606    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-run-openvswitch\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056615    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-node-log\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056624    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-run-ovn-kubernetes\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056628    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-run-multus-certs\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056667    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-system-cni-dir\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056677    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-etc-kubernetes\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056683    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-cnibin\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056695    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-run-multus-certs\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.057864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056721    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-run-netns\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.058647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056750    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b603923-c0d1-40b0-8524-4caadba97b2d-ovnkube-config\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.058647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-run-ovn\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.058647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056753    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-run-netns\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.058647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056721    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-etc-kubernetes\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.058647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056797    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/60a2b76f-7c85-4e78-89f2-56d0556836d2-dbus\") pod \"global-pull-secret-syncer-lx499\" (UID: \"60a2b76f-7c85-4e78-89f2-56d0556836d2\") " pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:20:59.058647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056819    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e949f3f4-9aba-4f97-93b1-911bb441f8a8-agent-certs\") pod \"konnectivity-agent-nl5s4\" (UID: \"e949f3f4-9aba-4f97-93b1-911bb441f8a8\") " pod="kube-system/konnectivity-agent-nl5s4"
Jul 27 17:20:59.058647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056819    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-run-ovn\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.058647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056845    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-kubelet-dir\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:59.058647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mznk6\" (UniqueName: \"kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6\") pod \"network-check-target-gnx7q\" (UID: \"19b8b02a-b424-4457-99d7-27434924db05\") " pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:20:59.058647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b603923-c0d1-40b0-8524-4caadba97b2d-env-overrides\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.058647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056906    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/60a2b76f-7c85-4e78-89f2-56d0556836d2-dbus\") pod \"global-pull-secret-syncer-lx499\" (UID: \"60a2b76f-7c85-4e78-89f2-56d0556836d2\") " pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:20:59.058647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056922    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4376a23d-e8f9-45b4-a475-b571014db151-kubelet-dir\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:59.058647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056906    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/509006d0-5205-42b6-91e8-eb9ac5ac3c33-cni-binary-copy\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.058647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056947    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b603923-c0d1-40b0-8524-4caadba97b2d-ovnkube-script-lib\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.058647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.056981    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-var-lib-kubelet\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.058647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs\") pod \"network-metrics-daemon-qdbml\" (UID: \"d28f5e0f-9c2d-40ba-9733-e4d66a23b602\") " pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:20:59.058647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5wwx\" (UniqueName: \"kubernetes.io/projected/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-kube-api-access-k5wwx\") pod \"network-metrics-daemon-qdbml\" (UID: \"d28f5e0f-9c2d-40ba-9733-e4d66a23b602\") " pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:20:59.059257 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057068    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-var-lib-kubelet\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.059257 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-multus-conf-dir\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.059257 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057101    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-multus-conf-dir\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.059257 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-kubelet\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.059257 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.059257 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057167    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/60a2b76f-7c85-4e78-89f2-56d0556836d2-kubelet-config\") pod \"global-pull-secret-syncer-lx499\" (UID: \"60a2b76f-7c85-4e78-89f2-56d0556836d2\") " pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:20:59.059257 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:59.057177    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:20:59.059257 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret\") pod \"global-pull-secret-syncer-lx499\" (UID: \"60a2b76f-7c85-4e78-89f2-56d0556836d2\") " pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:20:59.059257 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057215    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-kubelet\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.059257 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057222    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-run-k8s-cni-cncf-io\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.059257 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057257    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-run-k8s-cni-cncf-io\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.059257 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:59.057262    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs podName:d28f5e0f-9c2d-40ba-9733-e4d66a23b602 nodeName:}" failed. No retries permitted until 2026-07-27 17:20:59.557240655 +0000 UTC m=+3.088991624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs") pod "network-metrics-daemon-qdbml" (UID: "d28f5e0f-9c2d-40ba-9733-e4d66a23b602") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:20:59.059257 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057295    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/60a2b76f-7c85-4e78-89f2-56d0556836d2-kubelet-config\") pod \"global-pull-secret-syncer-lx499\" (UID: \"60a2b76f-7c85-4e78-89f2-56d0556836d2\") " pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:20:59.059257 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057346    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-var-lib-cni-multus\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.059257 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057369    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2zpw\" (UniqueName: \"kubernetes.io/projected/4376a23d-e8f9-45b4-a475-b571014db151-kube-api-access-h2zpw\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:59.059257 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-cni-bin\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.059257 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:59.057401    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:20:59.059975 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-cni-netd\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.059975 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057343    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.059975 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057446    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b603923-c0d1-40b0-8524-4caadba97b2d-ovn-node-metrics-cert\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.059975 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057451    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-cni-bin\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.059975 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:59.057491    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret podName:60a2b76f-7c85-4e78-89f2-56d0556836d2 nodeName:}" failed. No retries permitted until 2026-07-27 17:20:59.557470397 +0000 UTC m=+3.089221380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret") pod "global-pull-secret-syncer-lx499" (UID: "60a2b76f-7c85-4e78-89f2-56d0556836d2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:20:59.059975 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057471    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/509006d0-5205-42b6-91e8-eb9ac5ac3c33-multus-daemon-config\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.059975 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057506    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b603923-c0d1-40b0-8524-4caadba97b2d-host-cni-netd\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.059975 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057486    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/509006d0-5205-42b6-91e8-eb9ac5ac3c33-host-var-lib-cni-multus\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.059975 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057511    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b603923-c0d1-40b0-8524-4caadba97b2d-env-overrides\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.059975 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.057470    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b603923-c0d1-40b0-8524-4caadba97b2d-ovnkube-script-lib\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.059975 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.058739    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/509006d0-5205-42b6-91e8-eb9ac5ac3c33-multus-daemon-config\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.059975 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.059895    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e949f3f4-9aba-4f97-93b1-911bb441f8a8-agent-certs\") pod \"konnectivity-agent-nl5s4\" (UID: \"e949f3f4-9aba-4f97-93b1-911bb441f8a8\") " pod="kube-system/konnectivity-agent-nl5s4"
Jul 27 17:20:59.060471 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.060221    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b603923-c0d1-40b0-8524-4caadba97b2d-ovn-node-metrics-cert\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.064972 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:59.064950    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:20:59.064972 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:59.064973    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:20:59.065153 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:59.064988    2579 projected.go:196] Error preparing data for projected volume kube-api-access-mznk6 for pod openshift-network-diagnostics/network-check-target-gnx7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:20:59.065153 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:59.065054    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6 podName:19b8b02a-b424-4457-99d7-27434924db05 nodeName:}" failed. No retries permitted until 2026-07-27 17:20:59.565037311 +0000 UTC m=+3.096788301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mznk6" (UniqueName: "kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6") pod "network-check-target-gnx7q" (UID: "19b8b02a-b424-4457-99d7-27434924db05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:20:59.067538 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.067513    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clbls\" (UniqueName: \"kubernetes.io/projected/509006d0-5205-42b6-91e8-eb9ac5ac3c33-kube-api-access-clbls\") pod \"multus-qc22j\" (UID: \"509006d0-5205-42b6-91e8-eb9ac5ac3c33\") " pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.067731 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.067706    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5wwx\" (UniqueName: \"kubernetes.io/projected/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-kube-api-access-k5wwx\") pod \"network-metrics-daemon-qdbml\" (UID: \"d28f5e0f-9c2d-40ba-9733-e4d66a23b602\") " pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:20:59.068391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.068366    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2zpw\" (UniqueName: \"kubernetes.io/projected/4376a23d-e8f9-45b4-a475-b571014db151-kube-api-access-h2zpw\") pod \"aws-ebs-csi-driver-node-whr8s\" (UID: \"4376a23d-e8f9-45b4-a475-b571014db151\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:59.068481 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.068432    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njwfl\" (UniqueName: \"kubernetes.io/projected/5b603923-c0d1-40b0-8524-4caadba97b2d-kube-api-access-njwfl\") pod \"ovnkube-node-g962t\" (UID: \"5b603923-c0d1-40b0-8524-4caadba97b2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.142798 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.142762    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kv4hm"
Jul 27 17:20:59.151985 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.151962    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-865dp"
Jul 27 17:20:59.155532 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:59.155506    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaefa7f7d_16e7_4697_9270_85fadc4f836e.slice/crio-8ebd9faab79cd82b20dea220707a09c52e52534dfd15a7e0e9aaeb81bfd0282c WatchSource:0}: Error finding container 8ebd9faab79cd82b20dea220707a09c52e52534dfd15a7e0e9aaeb81bfd0282c: Status 404 returned error can't find the container with id 8ebd9faab79cd82b20dea220707a09c52e52534dfd15a7e0e9aaeb81bfd0282c
Jul 27 17:20:59.160668 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.160644    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mk665"
Jul 27 17:20:59.161821 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:59.161793    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod169d7b69_b4ab_445e_ac5d_18928540a11f.slice/crio-a0fda8d6af67cd95344d84b7ae9505aee9d18cbe9eb84fd2a01a2b24227fa585 WatchSource:0}: Error finding container a0fda8d6af67cd95344d84b7ae9505aee9d18cbe9eb84fd2a01a2b24227fa585: Status 404 returned error can't find the container with id a0fda8d6af67cd95344d84b7ae9505aee9d18cbe9eb84fd2a01a2b24227fa585
Jul 27 17:20:59.166783 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.166765    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7wtxl"
Jul 27 17:20:59.171940 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:59.171913    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6362be28_866c_43b9_8b11_912ee59f184c.slice/crio-8e3b2a619ed5af4312ee7b2768872b230e8b439524ba346376ad870e6c941e24 WatchSource:0}: Error finding container 8e3b2a619ed5af4312ee7b2768872b230e8b439524ba346376ad870e6c941e24: Status 404 returned error can't find the container with id 8e3b2a619ed5af4312ee7b2768872b230e8b439524ba346376ad870e6c941e24
Jul 27 17:20:59.173425 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.173407    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vvdfm"
Jul 27 17:20:59.177696 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:59.177670    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f3cc59_b8f9_413e_9c63_917f1dada6e5.slice/crio-5004907df5af4f4e85905884075b1e87f9e98bf116449a7984a1d9ff6f167b34 WatchSource:0}: Error finding container 5004907df5af4f4e85905884075b1e87f9e98bf116449a7984a1d9ff6f167b34: Status 404 returned error can't find the container with id 5004907df5af4f4e85905884075b1e87f9e98bf116449a7984a1d9ff6f167b34
Jul 27 17:20:59.180923 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.180850    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:20:59.182401 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:59.182379    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76aeaf9_9094_4328_b194_8c10eeb2a8c7.slice/crio-7fd107e5d2a748b63d7148f1ce3a80cf6f23603083c0269b9f84e453fd30e6cd WatchSource:0}: Error finding container 7fd107e5d2a748b63d7148f1ce3a80cf6f23603083c0269b9f84e453fd30e6cd: Status 404 returned error can't find the container with id 7fd107e5d2a748b63d7148f1ce3a80cf6f23603083c0269b9f84e453fd30e6cd
Jul 27 17:20:59.188618 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.188579    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nl5s4"
Jul 27 17:20:59.196019 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.195995    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s"
Jul 27 17:20:59.203242 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.203221    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qc22j"
Jul 27 17:20:59.530335 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:59.530306    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4376a23d_e8f9_45b4_a475_b571014db151.slice/crio-50d10f25d7516f2d01e694ea94dd587fbaf5d16dfe9208357cbd1bdf9ae14890 WatchSource:0}: Error finding container 50d10f25d7516f2d01e694ea94dd587fbaf5d16dfe9208357cbd1bdf9ae14890: Status 404 returned error can't find the container with id 50d10f25d7516f2d01e694ea94dd587fbaf5d16dfe9208357cbd1bdf9ae14890
Jul 27 17:20:59.530862 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:59.530826    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod509006d0_5205_42b6_91e8_eb9ac5ac3c33.slice/crio-3a18bdefa80982d816d1b9be423c322c5803c1010756b7cd093cc365cd667842 WatchSource:0}: Error finding container 3a18bdefa80982d816d1b9be423c322c5803c1010756b7cd093cc365cd667842: Status 404 returned error can't find the container with id 3a18bdefa80982d816d1b9be423c322c5803c1010756b7cd093cc365cd667842
Jul 27 17:20:59.531708 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:59.531679    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode949f3f4_9aba_4f97_93b1_911bb441f8a8.slice/crio-f6d697fd96686edb032eb4840e3b110c957821dd34d74098939642e5c524fead WatchSource:0}: Error finding container f6d697fd96686edb032eb4840e3b110c957821dd34d74098939642e5c524fead: Status 404 returned error can't find the container with id f6d697fd96686edb032eb4840e3b110c957821dd34d74098939642e5c524fead
Jul 27 17:20:59.532328 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:20:59.532306    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b603923_c0d1_40b0_8524_4caadba97b2d.slice/crio-b2b10373833fc691753a180440b89eb782e49cea830d63da101e79197047cecf WatchSource:0}: Error finding container b2b10373833fc691753a180440b89eb782e49cea830d63da101e79197047cecf: Status 404 returned error can't find the container with id b2b10373833fc691753a180440b89eb782e49cea830d63da101e79197047cecf
Jul 27 17:20:59.560961 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.560922    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs\") pod \"network-metrics-daemon-qdbml\" (UID: \"d28f5e0f-9c2d-40ba-9733-e4d66a23b602\") " pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:20:59.561113 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.560980    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret\") pod \"global-pull-secret-syncer-lx499\" (UID: \"60a2b76f-7c85-4e78-89f2-56d0556836d2\") " pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:20:59.561113 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:59.561060    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:20:59.561113 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:59.561090    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:20:59.561218 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:59.561132    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs podName:d28f5e0f-9c2d-40ba-9733-e4d66a23b602 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:00.56111022 +0000 UTC m=+4.092861207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs") pod "network-metrics-daemon-qdbml" (UID: "d28f5e0f-9c2d-40ba-9733-e4d66a23b602") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:20:59.561218 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:59.561157    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret podName:60a2b76f-7c85-4e78-89f2-56d0556836d2 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:00.561141448 +0000 UTC m=+4.092892414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret") pod "global-pull-secret-syncer-lx499" (UID: "60a2b76f-7c85-4e78-89f2-56d0556836d2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:20:59.661385 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.661341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mznk6\" (UniqueName: \"kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6\") pod \"network-check-target-gnx7q\" (UID: \"19b8b02a-b424-4457-99d7-27434924db05\") " pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:20:59.661573 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:59.661513    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:20:59.661573 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:59.661543    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:20:59.661573 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:59.661558    2579 projected.go:196] Error preparing data for projected volume kube-api-access-mznk6 for pod openshift-network-diagnostics/network-check-target-gnx7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:20:59.661715 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:59.661638    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6 podName:19b8b02a-b424-4457-99d7-27434924db05 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:00.661617234 +0000 UTC m=+4.193368231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mznk6" (UniqueName: "kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6") pod "network-check-target-gnx7q" (UID: "19b8b02a-b424-4457-99d7-27434924db05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:20:59.888093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.887895    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 17:15:59 +0000 UTC" deadline="2028-02-26 10:56:32.080366529 +0000 UTC"
Jul 27 17:20:59.888093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.888097    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13889h35m32.192274073s"
Jul 27 17:20:59.988208 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.987617    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:20:59.988208 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:20:59.987758    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:20:59.996948 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.996803    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-865dp" event={"ID":"169d7b69-b4ab-445e-ac5d-18928540a11f","Type":"ContainerStarted","Data":"a0fda8d6af67cd95344d84b7ae9505aee9d18cbe9eb84fd2a01a2b24227fa585"}
Jul 27 17:20:59.998491 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:20:59.998458    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kv4hm" event={"ID":"aefa7f7d-16e7-4697-9270-85fadc4f836e","Type":"ContainerStarted","Data":"8ebd9faab79cd82b20dea220707a09c52e52534dfd15a7e0e9aaeb81bfd0282c"}
Jul 27 17:21:00.002234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:00.002206    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qc22j" event={"ID":"509006d0-5205-42b6-91e8-eb9ac5ac3c33","Type":"ContainerStarted","Data":"3a18bdefa80982d816d1b9be423c322c5803c1010756b7cd093cc365cd667842"}
Jul 27 17:21:00.004600 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:00.004452    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vvdfm" event={"ID":"a76aeaf9-9094-4328-b194-8c10eeb2a8c7","Type":"ContainerStarted","Data":"7fd107e5d2a748b63d7148f1ce3a80cf6f23603083c0269b9f84e453fd30e6cd"}
Jul 27 17:21:00.006271 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:00.006226    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7wtxl" event={"ID":"93f3cc59-b8f9-413e-9c63-917f1dada6e5","Type":"ContainerStarted","Data":"5004907df5af4f4e85905884075b1e87f9e98bf116449a7984a1d9ff6f167b34"}
Jul 27 17:21:00.007791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:00.007764    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mk665" event={"ID":"6362be28-866c-43b9-8b11-912ee59f184c","Type":"ContainerStarted","Data":"8e3b2a619ed5af4312ee7b2768872b230e8b439524ba346376ad870e6c941e24"}
Jul 27 17:21:00.011748 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:00.011616    2579 generic.go:356] "Generic (PLEG): container finished" podID="dd105fb28bdc196289212f0eb76d77d6" containerID="6dccdc51ad169bdc7745f79bc58e5416520cc5f97de1210206f35c60d81f57ec" exitCode=0
Jul 27 17:21:00.011748 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:00.011701    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal" event={"ID":"dd105fb28bdc196289212f0eb76d77d6","Type":"ContainerDied","Data":"6dccdc51ad169bdc7745f79bc58e5416520cc5f97de1210206f35c60d81f57ec"}
Jul 27 17:21:00.014301 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:00.014270    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g962t" event={"ID":"5b603923-c0d1-40b0-8524-4caadba97b2d","Type":"ContainerStarted","Data":"b2b10373833fc691753a180440b89eb782e49cea830d63da101e79197047cecf"}
Jul 27 17:21:00.015784 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:00.015714    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nl5s4" event={"ID":"e949f3f4-9aba-4f97-93b1-911bb441f8a8","Type":"ContainerStarted","Data":"f6d697fd96686edb032eb4840e3b110c957821dd34d74098939642e5c524fead"}
Jul 27 17:21:00.018693 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:00.018667    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s" event={"ID":"4376a23d-e8f9-45b4-a475-b571014db151","Type":"ContainerStarted","Data":"50d10f25d7516f2d01e694ea94dd587fbaf5d16dfe9208357cbd1bdf9ae14890"}
Jul 27 17:21:00.570723 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:00.569804    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs\") pod \"network-metrics-daemon-qdbml\" (UID: \"d28f5e0f-9c2d-40ba-9733-e4d66a23b602\") " pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:00.570723 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:00.569863    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret\") pod \"global-pull-secret-syncer-lx499\" (UID: \"60a2b76f-7c85-4e78-89f2-56d0556836d2\") " pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:00.570723 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:00.570036    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:21:00.570723 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:00.570105    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret podName:60a2b76f-7c85-4e78-89f2-56d0556836d2 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:02.570082412 +0000 UTC m=+6.101833386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret") pod "global-pull-secret-syncer-lx499" (UID: "60a2b76f-7c85-4e78-89f2-56d0556836d2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:21:00.570723 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:00.570579    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:21:00.570723 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:00.570641    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs podName:d28f5e0f-9c2d-40ba-9733-e4d66a23b602 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:02.570620783 +0000 UTC m=+6.102371769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs") pod "network-metrics-daemon-qdbml" (UID: "d28f5e0f-9c2d-40ba-9733-e4d66a23b602") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:21:00.671539 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:00.670860    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mznk6\" (UniqueName: \"kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6\") pod \"network-check-target-gnx7q\" (UID: \"19b8b02a-b424-4457-99d7-27434924db05\") " pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:00.671539 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:00.671049    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:21:00.671539 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:00.671071    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:21:00.671539 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:00.671083    2579 projected.go:196] Error preparing data for projected volume kube-api-access-mznk6 for pod openshift-network-diagnostics/network-check-target-gnx7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:21:00.671539 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:00.671145    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6 podName:19b8b02a-b424-4457-99d7-27434924db05 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:02.671125747 +0000 UTC m=+6.202876742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mznk6" (UniqueName: "kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6") pod "network-check-target-gnx7q" (UID: "19b8b02a-b424-4457-99d7-27434924db05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:21:00.888904 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:00.888643    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 17:15:59 +0000 UTC" deadline="2028-03-06 05:22:07.332449915 +0000 UTC"
Jul 27 17:21:00.888904 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:00.888682    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14100h1m6.443773854s"
Jul 27 17:21:00.987638 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:00.987605    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:00.987833 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:00.987764    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:21:00.989159 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:00.989002    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:00.989159 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:00.989109    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:21:01.049589 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:01.049549    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal" event={"ID":"dd105fb28bdc196289212f0eb76d77d6","Type":"ContainerStarted","Data":"8c761b0070f9e46f417998b3ae1ba696f6dbcf470ed64e18f7639b46de189f2d"}
Jul 27 17:21:01.987557 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:01.987513    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:01.988038 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:01.987657    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:21:02.590442 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:02.590363    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs\") pod \"network-metrics-daemon-qdbml\" (UID: \"d28f5e0f-9c2d-40ba-9733-e4d66a23b602\") " pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:02.590442 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:02.590421    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret\") pod \"global-pull-secret-syncer-lx499\" (UID: \"60a2b76f-7c85-4e78-89f2-56d0556836d2\") " pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:02.590720 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:02.590587    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:21:02.590720 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:02.590651    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret podName:60a2b76f-7c85-4e78-89f2-56d0556836d2 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:06.590631321 +0000 UTC m=+10.122382306 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret") pod "global-pull-secret-syncer-lx499" (UID: "60a2b76f-7c85-4e78-89f2-56d0556836d2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:21:02.590720 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:02.590721    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:21:02.590898 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:02.590755    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs podName:d28f5e0f-9c2d-40ba-9733-e4d66a23b602 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:06.590742759 +0000 UTC m=+10.122493731 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs") pod "network-metrics-daemon-qdbml" (UID: "d28f5e0f-9c2d-40ba-9733-e4d66a23b602") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:21:02.691059 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:02.691020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mznk6\" (UniqueName: \"kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6\") pod \"network-check-target-gnx7q\" (UID: \"19b8b02a-b424-4457-99d7-27434924db05\") " pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:02.691239 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:02.691221    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:21:02.691330 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:02.691245    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:21:02.691330 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:02.691267    2579 projected.go:196] Error preparing data for projected volume kube-api-access-mznk6 for pod openshift-network-diagnostics/network-check-target-gnx7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:21:02.691440 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:02.691329    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6 podName:19b8b02a-b424-4457-99d7-27434924db05 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:06.691308417 +0000 UTC m=+10.223059388 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mznk6" (UniqueName: "kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6") pod "network-check-target-gnx7q" (UID: "19b8b02a-b424-4457-99d7-27434924db05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:21:02.989784 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:02.988815    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:02.989784 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:02.988985    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:21:02.990479 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:02.990448    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:02.990931 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:02.990641    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:21:03.987035 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:03.986995    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:03.987259 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:03.987149    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:21:04.987588 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:04.987558    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:04.988040 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:04.987705    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:21:04.988095 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:04.988078    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:04.988197 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:04.988173    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:21:05.987304 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:05.987248    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:05.987521 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:05.987356    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:21:06.624349 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:06.624058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs\") pod \"network-metrics-daemon-qdbml\" (UID: \"d28f5e0f-9c2d-40ba-9733-e4d66a23b602\") " pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:06.624349 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:06.624115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret\") pod \"global-pull-secret-syncer-lx499\" (UID: \"60a2b76f-7c85-4e78-89f2-56d0556836d2\") " pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:06.624349 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:06.624220    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:21:06.624349 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:06.624267    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:21:06.624349 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:06.624301    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs podName:d28f5e0f-9c2d-40ba-9733-e4d66a23b602 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:14.624280473 +0000 UTC m=+18.156031438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs") pod "network-metrics-daemon-qdbml" (UID: "d28f5e0f-9c2d-40ba-9733-e4d66a23b602") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:21:06.624349 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:06.624326    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret podName:60a2b76f-7c85-4e78-89f2-56d0556836d2 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:14.624309031 +0000 UTC m=+18.156060003 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret") pod "global-pull-secret-syncer-lx499" (UID: "60a2b76f-7c85-4e78-89f2-56d0556836d2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:21:06.725346 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:06.725314    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mznk6\" (UniqueName: \"kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6\") pod \"network-check-target-gnx7q\" (UID: \"19b8b02a-b424-4457-99d7-27434924db05\") " pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:06.725563 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:06.725540    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:21:06.725651 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:06.725574    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:21:06.725651 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:06.725587    2579 projected.go:196] Error preparing data for projected volume kube-api-access-mznk6 for pod openshift-network-diagnostics/network-check-target-gnx7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:21:06.725762 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:06.725651    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6 podName:19b8b02a-b424-4457-99d7-27434924db05 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:14.725632079 +0000 UTC m=+18.257383046 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mznk6" (UniqueName: "kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6") pod "network-check-target-gnx7q" (UID: "19b8b02a-b424-4457-99d7-27434924db05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:21:06.987997 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:06.987919    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:06.988150 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:06.988044    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:21:06.988510 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:06.988492    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:06.988650 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:06.988604    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:21:07.989528 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:07.989493    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:07.989980 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:07.989662    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:21:08.987966 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:08.987456    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:08.987966 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:08.987593    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:21:08.988216 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:08.988051    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:08.988216 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:08.988139    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:21:09.987259 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:09.987227    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:09.987671 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:09.987371    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:21:10.987646 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:10.987606    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:10.988047 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:10.987653    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:10.988047 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:10.987737    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:21:10.988047 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:10.987839    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:21:11.987585 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:11.987511    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:11.987734 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:11.987629    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:21:12.987154 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:12.987119    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:12.987343 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:12.987254    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:21:12.987343 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:12.987304    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:12.987486 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:12.987380    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:21:13.987557 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:13.987521    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:13.988040 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:13.987664    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:21:14.687286 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:14.687249    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs\") pod \"network-metrics-daemon-qdbml\" (UID: \"d28f5e0f-9c2d-40ba-9733-e4d66a23b602\") " pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:14.687555 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:14.687296    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret\") pod \"global-pull-secret-syncer-lx499\" (UID: \"60a2b76f-7c85-4e78-89f2-56d0556836d2\") " pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:14.687555 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:14.687414    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:21:14.687555 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:14.687436    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:21:14.687555 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:14.687498    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret podName:60a2b76f-7c85-4e78-89f2-56d0556836d2 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:30.687480173 +0000 UTC m=+34.219231137 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret") pod "global-pull-secret-syncer-lx499" (UID: "60a2b76f-7c85-4e78-89f2-56d0556836d2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:21:14.687555 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:14.687517    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs podName:d28f5e0f-9c2d-40ba-9733-e4d66a23b602 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:30.68750776 +0000 UTC m=+34.219258724 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs") pod "network-metrics-daemon-qdbml" (UID: "d28f5e0f-9c2d-40ba-9733-e4d66a23b602") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:21:14.788340 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:14.788298    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mznk6\" (UniqueName: \"kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6\") pod \"network-check-target-gnx7q\" (UID: \"19b8b02a-b424-4457-99d7-27434924db05\") " pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:14.788547 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:14.788523    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:21:14.788597 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:14.788557    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:21:14.788597 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:14.788571    2579 projected.go:196] Error preparing data for projected volume kube-api-access-mznk6 for pod openshift-network-diagnostics/network-check-target-gnx7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:21:14.788665 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:14.788639    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6 podName:19b8b02a-b424-4457-99d7-27434924db05 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:30.788620392 +0000 UTC m=+34.320371372 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mznk6" (UniqueName: "kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6") pod "network-check-target-gnx7q" (UID: "19b8b02a-b424-4457-99d7-27434924db05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:21:14.987639 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:14.987555    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:14.987639 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:14.987599    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:14.988112 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:14.987713    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:21:14.988112 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:14.987775    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:21:15.986952 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:15.986918    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:15.987131 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:15.987043    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:21:16.988692 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:16.988658    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:16.989136 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:16.988791    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:21:16.989136 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:16.988847    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:16.989136 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:16.988958    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:21:17.987574 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:17.987543    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:17.987734 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:17.987643    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:21:18.987773 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:18.987726    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:18.987773 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:18.987742    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:18.988373 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:18.987874    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:21:18.988373 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:18.988286    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:21:19.987131 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:19.986857    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:19.987233 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:19.987215    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:21:20.091384 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.091341    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal" event={"ID":"0c3c3e6cc40a8e9ec18fa8af08b36f88","Type":"ContainerStarted","Data":"a2fe7145608341a0df193342d173ad2b43a6b8d4f24ad253a3afdbef49b9c9a1"}
Jul 27 17:21:20.094112 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.094081    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g962t" event={"ID":"5b603923-c0d1-40b0-8524-4caadba97b2d","Type":"ContainerStarted","Data":"0c16793b70a222583912507fce5120207a6ce8b6ef8584a76f9c5b69db8ed168"}
Jul 27 17:21:20.094244 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.094157    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g962t" event={"ID":"5b603923-c0d1-40b0-8524-4caadba97b2d","Type":"ContainerStarted","Data":"87488452414dd065c9106f0ea83cc20b1bae6eed0373abb660968cafff8420db"}
Jul 27 17:21:20.094244 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.094194    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g962t" event={"ID":"5b603923-c0d1-40b0-8524-4caadba97b2d","Type":"ContainerStarted","Data":"88e8c556a4095f77db7d8f4cd7d0bf3519a7f094c8a66c7d4583c845fc906473"}
Jul 27 17:21:20.094244 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.094223    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g962t" event={"ID":"5b603923-c0d1-40b0-8524-4caadba97b2d","Type":"ContainerStarted","Data":"e17b489ec32d860b8d3ff311e509a1693b2d0df9ce08c975e38ff58f128cb821"}
Jul 27 17:21:20.094363 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.094264    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g962t" event={"ID":"5b603923-c0d1-40b0-8524-4caadba97b2d","Type":"ContainerStarted","Data":"e7ba815d2dccf6b1c92fb71e1973a83e745b3a8a5c09fd4ee5a4b753fa054135"}
Jul 27 17:21:20.094363 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.094297    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g962t" event={"ID":"5b603923-c0d1-40b0-8524-4caadba97b2d","Type":"ContainerStarted","Data":"6c9a01584bc5e665c44f4d5a0b8f1a4a93299daa0e1b31744eaa3f8444df1e06"}
Jul 27 17:21:20.095564 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.095527    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nl5s4" event={"ID":"e949f3f4-9aba-4f97-93b1-911bb441f8a8","Type":"ContainerStarted","Data":"3a16816783a58d9a246039e22bb90de842ee580656cc8f2fb8f5cc41c934a51f"}
Jul 27 17:21:20.096890 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.096872    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s" event={"ID":"4376a23d-e8f9-45b4-a475-b571014db151","Type":"ContainerStarted","Data":"030c40af6a90861b9b5c969dfc83db0bfde2f21eeb4db939dd876418cc30f259"}
Jul 27 17:21:20.098344 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.098315    2579 generic.go:356] "Generic (PLEG): container finished" podID="aefa7f7d-16e7-4697-9270-85fadc4f836e" containerID="5f097c17605d1ebc4c655b7c1ccab079d74d5952bc9145e0be7285ecdbeb9292" exitCode=0
Jul 27 17:21:20.098451 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.098386    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kv4hm" event={"ID":"aefa7f7d-16e7-4697-9270-85fadc4f836e","Type":"ContainerDied","Data":"5f097c17605d1ebc4c655b7c1ccab079d74d5952bc9145e0be7285ecdbeb9292"}
Jul 27 17:21:20.099998 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.099969    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qc22j" event={"ID":"509006d0-5205-42b6-91e8-eb9ac5ac3c33","Type":"ContainerStarted","Data":"ff7bfb58c4efae71d050b2ef70b096f9440cfe18268f808d12ff303c0053f74c"}
Jul 27 17:21:20.101360 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.101339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vvdfm" event={"ID":"a76aeaf9-9094-4328-b194-8c10eeb2a8c7","Type":"ContainerStarted","Data":"6a16020b966658ea38714450f048162fd4ccdae3dae4f71a07e0eb4ea507c2d7"}
Jul 27 17:21:20.102855 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.102831    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7wtxl" event={"ID":"93f3cc59-b8f9-413e-9c63-917f1dada6e5","Type":"ContainerStarted","Data":"040d672bb3315a24133a3effcf6caee7ea22c3f2f7f27f1164f08913f84b211e"}
Jul 27 17:21:20.104241 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.104220    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mk665" event={"ID":"6362be28-866c-43b9-8b11-912ee59f184c","Type":"ContainerStarted","Data":"903ff113708596aa87e01ba88e87cbd58dd660946f720ddf1b9528c11e4be62a"}
Jul 27 17:21:20.108799 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.108750    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-74.ec2.internal" podStartSLOduration=22.108732497 podStartE2EDuration="22.108732497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:20:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:21:01.067042794 +0000 UTC m=+4.598793785" watchObservedRunningTime="2026-07-27 17:21:20.108732497 +0000 UTC m=+23.640483485"
Jul 27 17:21:20.109118 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.109085    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-74.ec2.internal" podStartSLOduration=22.10907781 podStartE2EDuration="22.10907781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:20:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:21:20.108465372 +0000 UTC m=+23.640216374" watchObservedRunningTime="2026-07-27 17:21:20.10907781 +0000 UTC m=+23.640828797"
Jul 27 17:21:20.122740 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.122695    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nl5s4" podStartSLOduration=3.281926895 podStartE2EDuration="23.122678881s" totalImagesPullingTime="19.840751986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:21:20.122264536 +0000 UTC m=+23.654015521" watchObservedRunningTime="2026-07-27 17:21:20.122678881 +0000 UTC m=+23.654429870"
Jul 27 17:21:20.137708 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.137670    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mk665" podStartSLOduration=2.9266324409999998 podStartE2EDuration="23.137656354s" totalImagesPullingTime="20.211023913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:21:20.137464943 +0000 UTC m=+23.669215928" watchObservedRunningTime="2026-07-27 17:21:20.137656354 +0000 UTC m=+23.669407339"
Jul 27 17:21:20.151980 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.151949    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7wtxl" podStartSLOduration=2.928119113 podStartE2EDuration="23.151937577s" totalImagesPullingTime="20.223818464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:21:20.151486818 +0000 UTC m=+23.683237805" watchObservedRunningTime="2026-07-27 17:21:20.151937577 +0000 UTC m=+23.683688562"
Jul 27 17:21:20.171558 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.171476    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qc22j" podStartSLOduration=3.242136495 podStartE2EDuration="23.171463566s" totalImagesPullingTime="19.929327071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:21:20.170545397 +0000 UTC m=+23.702296383" watchObservedRunningTime="2026-07-27 17:21:20.171463566 +0000 UTC m=+23.703214553"
Jul 27 17:21:20.206410 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.206369    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vvdfm" podStartSLOduration=2.989107349 podStartE2EDuration="23.206357617s" totalImagesPullingTime="20.217250268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:21:20.205927175 +0000 UTC m=+23.737678161" watchObservedRunningTime="2026-07-27 17:21:20.206357617 +0000 UTC m=+23.738108603"
Jul 27 17:21:20.315031 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.315000    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl5s4_e949f3f4-9aba-4f97-93b1-911bb441f8a8/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:20.377923 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.377895    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl5s4_e949f3f4-9aba-4f97-93b1-911bb441f8a8/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:20.544956 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.544923    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl5s4_e949f3f4-9aba-4f97-93b1-911bb441f8a8/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:20.604574 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.604542    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl5s4_e949f3f4-9aba-4f97-93b1-911bb441f8a8/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:20.680358 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.680277    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nl5s4"
Jul 27 17:21:20.680973 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.680950    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nl5s4"
Jul 27 17:21:20.987160 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.987075    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:20.987405 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:20.987075    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:20.987405 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:20.987227    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:21:20.987405 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:20.987273    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:21:21.110243 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:21.110208    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-865dp" event={"ID":"169d7b69-b4ab-445e-ac5d-18928540a11f","Type":"ContainerStarted","Data":"6900fe7c7de2c26a23f04bc24d3940164a0c67ee40afe4e1e72df82c9570999d"}
Jul 27 17:21:21.110671 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:21.110261    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nl5s4"
Jul 27 17:21:21.110868 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:21.110848    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nl5s4"
Jul 27 17:21:21.125712 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:21.125669    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-865dp" podStartSLOduration=3.902443965 podStartE2EDuration="24.125654094s" totalImagesPullingTime="20.223210129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:21:21.125265133 +0000 UTC m=+24.657016118" watchObservedRunningTime="2026-07-27 17:21:21.125654094 +0000 UTC m=+24.657405079"
Jul 27 17:21:21.704554 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:21.704530    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 17:21:21.910664 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:21.910531    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T17:21:21.704551008Z","UUID":"aafec15f-c851-445e-8d45-650dde3847f9","Handler":null,"Name":"","Endpoint":""}
Jul 27 17:21:21.911845 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:21.911829    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 17:21:21.911960 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:21.911861    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 17:21:21.987704 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:21.987673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:21.987888 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:21.987779    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:21:21.989339 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:21.989315    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl5s4_e949f3f4-9aba-4f97-93b1-911bb441f8a8/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:22.090375 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:22.090347    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl5s4_e949f3f4-9aba-4f97-93b1-911bb441f8a8/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:22.113410 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:22.113371    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s" event={"ID":"4376a23d-e8f9-45b4-a475-b571014db151","Type":"ContainerStarted","Data":"3a745554cceaea4ef721e8c36feba68d3f107920d2fb955a6f9ea7a44b83620e"}
Jul 27 17:21:22.987930 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:22.987451    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:22.987930 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:22.987461    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:22.987930 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:22.987580    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:21:22.987930 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:22.987691    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:21:23.119348 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:23.119311    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g962t" event={"ID":"5b603923-c0d1-40b0-8524-4caadba97b2d","Type":"ContainerStarted","Data":"e414e07f17a27ab62fae95d73d88b9e3a27cc45263bfbf41a00e25daf4dfb3cf"}
Jul 27 17:21:23.226899 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:23.226865    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl5s4_e949f3f4-9aba-4f97-93b1-911bb441f8a8/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:23.299849 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:23.299819    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nl5s4_e949f3f4-9aba-4f97-93b1-911bb441f8a8/konnectivity-agent/0.log" limit=1024
Jul 27 17:21:23.987900 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:23.987730    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:23.988070 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:23.987994    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:21:24.987730 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:24.987653    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:24.988409 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:24.987655    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:24.988409 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:24.987773    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:21:24.988409 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:24.987856    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:21:25.125683 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:25.125456    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s" event={"ID":"4376a23d-e8f9-45b4-a475-b571014db151","Type":"ContainerStarted","Data":"0bd08581c6d7f2e47f0bd948981afc9da246ab08dba24deec8262d83b30f1211"}
Jul 27 17:21:25.127222 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:25.127198    2579 generic.go:356] "Generic (PLEG): container finished" podID="aefa7f7d-16e7-4697-9270-85fadc4f836e" containerID="ddf7a6450d3b4617795a0c1c4656bbc1a26149ef6601650eb9a01e437c787c41" exitCode=0
Jul 27 17:21:25.127346 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:25.127277    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kv4hm" event={"ID":"aefa7f7d-16e7-4697-9270-85fadc4f836e","Type":"ContainerDied","Data":"ddf7a6450d3b4617795a0c1c4656bbc1a26149ef6601650eb9a01e437c787c41"}
Jul 27 17:21:25.131153 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:25.131133    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g962t" event={"ID":"5b603923-c0d1-40b0-8524-4caadba97b2d","Type":"ContainerStarted","Data":"cae294343ec7162200ae217b3a5e6c571cc6b0326e3bdf87f8a307f97e2d3dd0"}
Jul 27 17:21:25.131463 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:25.131446    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:21:25.131556 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:25.131502    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:21:25.131556 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:25.131542    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:21:25.147107 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:25.147060    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-whr8s" podStartSLOduration=3.5449468729999998 podStartE2EDuration="28.147044839s" totalImagesPullingTime="24.602097966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:20:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:21:25.147030439 +0000 UTC m=+28.678781450" watchObservedRunningTime="2026-07-27 17:21:25.147044839 +0000 UTC m=+28.678795821"
Jul 27 17:21:25.148046 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:25.148026    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:21:25.148169 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:25.148156    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:21:25.181660 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:25.181617    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g962t" podStartSLOduration=8.260079654 podStartE2EDuration="28.18160311s" totalImagesPullingTime="19.921523456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:21:25.18113941 +0000 UTC m=+28.712890407" watchObservedRunningTime="2026-07-27 17:21:25.18160311 +0000 UTC m=+28.713354095"
Jul 27 17:21:25.987155 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:25.987124    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:25.987355 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:25.987233    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:21:26.520957 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:26.520937    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qdbml"]
Jul 27 17:21:26.521387 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:26.521055    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:26.521387 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:26.521173    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:21:26.521555 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:26.521537    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gnx7q"]
Jul 27 17:21:26.521750 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:26.521624    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:26.521750 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:26.521710    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:21:26.522103 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:26.522077    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lx499"]
Jul 27 17:21:26.522227 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:26.522150    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:26.522227 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:26.522219    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:21:27.138145 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:27.138105    2579 generic.go:356] "Generic (PLEG): container finished" podID="aefa7f7d-16e7-4697-9270-85fadc4f836e" containerID="7033bf25b0cca9b9256d9c201d3c481ff7d7892c6fa6110ebbeb9695a1ab0639" exitCode=0
Jul 27 17:21:27.138389 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:27.138214    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kv4hm" event={"ID":"aefa7f7d-16e7-4697-9270-85fadc4f836e","Type":"ContainerDied","Data":"7033bf25b0cca9b9256d9c201d3c481ff7d7892c6fa6110ebbeb9695a1ab0639"}
Jul 27 17:21:27.986801 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:27.986765    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:27.986801 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:27.986803    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:27.987189 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:27.986887    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:21:27.987189 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:27.986939    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:27.987189 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:27.987032    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:21:27.987189 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:27.987103    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:21:29.144985 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:29.144806    2579 generic.go:356] "Generic (PLEG): container finished" podID="aefa7f7d-16e7-4697-9270-85fadc4f836e" containerID="50a5e03a169e87f31a3848d1da5f226b0e75795080a9612b0efbe03b235e611f" exitCode=0
Jul 27 17:21:29.145536 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:29.144887    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kv4hm" event={"ID":"aefa7f7d-16e7-4697-9270-85fadc4f836e","Type":"ContainerDied","Data":"50a5e03a169e87f31a3848d1da5f226b0e75795080a9612b0efbe03b235e611f"}
Jul 27 17:21:29.987143 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:29.987109    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:29.987143 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:29.987138    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:29.987374 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:29.987110    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:29.987374 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:29.987242    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:21:29.987374 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:29.987327    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:21:29.987551 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:29.987406    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:21:30.705053 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:30.705020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs\") pod \"network-metrics-daemon-qdbml\" (UID: \"d28f5e0f-9c2d-40ba-9733-e4d66a23b602\") " pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:30.705053 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:30.705066    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret\") pod \"global-pull-secret-syncer-lx499\" (UID: \"60a2b76f-7c85-4e78-89f2-56d0556836d2\") " pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:30.705547 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:30.705174    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 17:21:30.705547 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:30.705238    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret podName:60a2b76f-7c85-4e78-89f2-56d0556836d2 nodeName:}" failed. No retries permitted until 2026-07-27 17:22:02.705220317 +0000 UTC m=+66.236971282 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret") pod "global-pull-secret-syncer-lx499" (UID: "60a2b76f-7c85-4e78-89f2-56d0556836d2") : object "kube-system"/"original-pull-secret" not registered
Jul 27 17:21:30.705547 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:30.705233    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:21:30.705547 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:30.705351    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs podName:d28f5e0f-9c2d-40ba-9733-e4d66a23b602 nodeName:}" failed. No retries permitted until 2026-07-27 17:22:02.705328748 +0000 UTC m=+66.237079726 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs") pod "network-metrics-daemon-qdbml" (UID: "d28f5e0f-9c2d-40ba-9733-e4d66a23b602") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 17:21:30.806664 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:30.806624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mznk6\" (UniqueName: \"kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6\") pod \"network-check-target-gnx7q\" (UID: \"19b8b02a-b424-4457-99d7-27434924db05\") " pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:30.806832 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:30.806806    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 17:21:30.806832 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:30.806826    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 17:21:30.806923 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:30.806837    2579 projected.go:196] Error preparing data for projected volume kube-api-access-mznk6 for pod openshift-network-diagnostics/network-check-target-gnx7q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:21:30.806923 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:30.806883    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6 podName:19b8b02a-b424-4457-99d7-27434924db05 nodeName:}" failed. No retries permitted until 2026-07-27 17:22:02.806866855 +0000 UTC m=+66.338617835 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mznk6" (UniqueName: "kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6") pod "network-check-target-gnx7q" (UID: "19b8b02a-b424-4457-99d7-27434924db05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 17:21:31.130710 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:31.130683    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7wtxl_93f3cc59-b8f9-413e-9c63-917f1dada6e5/dns-node-resolver/0.log"
Jul 27 17:21:31.987662 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:31.987580    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:31.988138 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:31.987693    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:31.988138 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:31.987800    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gnx7q" podUID="19b8b02a-b424-4457-99d7-27434924db05"
Jul 27 17:21:31.988138 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:31.987692    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lx499" podUID="60a2b76f-7c85-4e78-89f2-56d0556836d2"
Jul 27 17:21:31.988138 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:31.987699    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:31.988138 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:31.987925    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qdbml" podUID="d28f5e0f-9c2d-40ba-9733-e4d66a23b602"
Jul 27 17:21:32.301777 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.301746    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-74.ec2.internal" event="NodeReady"
Jul 27 17:21:32.301957 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.301905    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 17:21:32.329894 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.329865    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vvdfm_a76aeaf9-9094-4328-b194-8c10eeb2a8c7/node-ca/0.log"
Jul 27 17:21:32.364860 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.364011    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7875856454-b5jw7"]
Jul 27 17:21:32.366783 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.366759    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.369463 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.369435    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 17:21:32.370317 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.369709    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 17:21:32.370317 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.369814    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 17:21:32.371297 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.371278    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rtxtk\""
Jul 27 17:21:32.375505 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.375488    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 17:21:32.384278 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.384253    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dlv8m"]
Jul 27 17:21:32.385973 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.385958    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4wpt9"]
Jul 27 17:21:32.386126 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.386097    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dlv8m"
Jul 27 17:21:32.387509 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.387490    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:32.389116 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.389099    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 17:21:32.389463 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.389444    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 17:21:32.389713 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.389695    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 17:21:32.389713 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.389718    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 17:21:32.389872 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.389853    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 17:21:32.389932 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.389854    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2k848\""
Jul 27 17:21:32.390174 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.390155    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bgcdf\""
Jul 27 17:21:32.395448 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.394698    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7875856454-b5jw7"]
Jul 27 17:21:32.400326 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.400304    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dlv8m"]
Jul 27 17:21:32.402668 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.402644    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4wpt9"]
Jul 27 17:21:32.408021 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.408001    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-stqvq"]
Jul 27 17:21:32.410240 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.410224    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:32.413043 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.413027    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 17:21:32.413366 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.413347    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 17:21:32.413466 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.413352    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 17:21:32.413616 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.413602    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bfsxf\""
Jul 27 17:21:32.413717 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.413694    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 17:21:32.429946 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.429920    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-stqvq"]
Jul 27 17:21:32.519164 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-installation-pull-secrets\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.519164 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519165    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa222af2-57f7-4cf8-b773-1af5e3bde69e-data-volume\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:32.519405 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519187    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqm9v\" (UniqueName: \"kubernetes.io/projected/aa222af2-57f7-4cf8-b773-1af5e3bde69e-kube-api-access-gqm9v\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:32.519405 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519254    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/152482d3-38ae-4cb2-a613-629c044074dc-cert\") pod \"ingress-canary-dlv8m\" (UID: \"152482d3-38ae-4cb2-a613-629c044074dc\") " pod="openshift-ingress-canary/ingress-canary-dlv8m"
Jul 27 17:21:32.519405 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519289    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cpjv\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-kube-api-access-4cpjv\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.519405 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519336    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-ca-trust-extracted\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.519405 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519374    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa222af2-57f7-4cf8-b773-1af5e3bde69e-crio-socket\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:32.519405 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519403    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:32.519683 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519438    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/406f1a28-2ffe-433e-ac46-6af95cbe6b15-config-volume\") pod \"dns-default-4wpt9\" (UID: \"406f1a28-2ffe-433e-ac46-6af95cbe6b15\") " pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:32.519683 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519463    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-bound-sa-token\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.519683 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519494    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw7w6\" (UniqueName: \"kubernetes.io/projected/406f1a28-2ffe-433e-ac46-6af95cbe6b15-kube-api-access-sw7w6\") pod \"dns-default-4wpt9\" (UID: \"406f1a28-2ffe-433e-ac46-6af95cbe6b15\") " pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:32.519683 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519547    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rngwg\" (UniqueName: \"kubernetes.io/projected/152482d3-38ae-4cb2-a613-629c044074dc-kube-api-access-rngwg\") pod \"ingress-canary-dlv8m\" (UID: \"152482d3-38ae-4cb2-a613-629c044074dc\") " pod="openshift-ingress-canary/ingress-canary-dlv8m"
Jul 27 17:21:32.519683 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519594    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-certificates\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.519683 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.519683 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519678    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-trusted-ca\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.519935 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519726    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/406f1a28-2ffe-433e-ac46-6af95cbe6b15-tmp-dir\") pod \"dns-default-4wpt9\" (UID: \"406f1a28-2ffe-433e-ac46-6af95cbe6b15\") " pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:32.519935 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519746    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa222af2-57f7-4cf8-b773-1af5e3bde69e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:32.519935 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519761    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-image-registry-private-configuration\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.519935 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.519787    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls\") pod \"dns-default-4wpt9\" (UID: \"406f1a28-2ffe-433e-ac46-6af95cbe6b15\") " pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:32.620531 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.620438    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-trusted-ca\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.620531 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.620484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/406f1a28-2ffe-433e-ac46-6af95cbe6b15-tmp-dir\") pod \"dns-default-4wpt9\" (UID: \"406f1a28-2ffe-433e-ac46-6af95cbe6b15\") " pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:32.620531 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.620507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa222af2-57f7-4cf8-b773-1af5e3bde69e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:32.620531 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.620530    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-image-registry-private-configuration\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.620831 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:32.620599    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:21:32.620831 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:32.620681    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa222af2-57f7-4cf8-b773-1af5e3bde69e-kube-rbac-proxy-cm podName:aa222af2-57f7-4cf8-b773-1af5e3bde69e nodeName:}" failed. No retries permitted until 2026-07-27 17:21:33.120657931 +0000 UTC m=+36.652408909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa222af2-57f7-4cf8-b773-1af5e3bde69e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stqvq" (UID: "aa222af2-57f7-4cf8-b773-1af5e3bde69e") : configmap "kube-rbac-proxy" not found
Jul 27 17:21:32.620831 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.620714    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls\") pod \"dns-default-4wpt9\" (UID: \"406f1a28-2ffe-433e-ac46-6af95cbe6b15\") " pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:32.620831 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.620775    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-installation-pull-secrets\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.620831 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.620808    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa222af2-57f7-4cf8-b773-1af5e3bde69e-data-volume\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:32.620831 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.620827    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/406f1a28-2ffe-433e-ac46-6af95cbe6b15-tmp-dir\") pod \"dns-default-4wpt9\" (UID: \"406f1a28-2ffe-433e-ac46-6af95cbe6b15\") " pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:32.621113 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:32.620853    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:21:32.621113 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.620835    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqm9v\" (UniqueName: \"kubernetes.io/projected/aa222af2-57f7-4cf8-b773-1af5e3bde69e-kube-api-access-gqm9v\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:32.621113 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.620912    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/152482d3-38ae-4cb2-a613-629c044074dc-cert\") pod \"ingress-canary-dlv8m\" (UID: \"152482d3-38ae-4cb2-a613-629c044074dc\") " pod="openshift-ingress-canary/ingress-canary-dlv8m"
Jul 27 17:21:32.621113 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:32.620925    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls podName:406f1a28-2ffe-433e-ac46-6af95cbe6b15 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:33.120906529 +0000 UTC m=+36.652657493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls") pod "dns-default-4wpt9" (UID: "406f1a28-2ffe-433e-ac46-6af95cbe6b15") : secret "dns-default-metrics-tls" not found
Jul 27 17:21:32.621113 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.620959    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cpjv\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-kube-api-access-4cpjv\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.621113 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.620991    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-ca-trust-extracted\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.621113 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.621032    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa222af2-57f7-4cf8-b773-1af5e3bde69e-crio-socket\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:32.621113 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.621055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:32.621113 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.621077    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/406f1a28-2ffe-433e-ac46-6af95cbe6b15-config-volume\") pod \"dns-default-4wpt9\" (UID: \"406f1a28-2ffe-433e-ac46-6af95cbe6b15\") " pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:32.621113 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.621110    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-bound-sa-token\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.621580 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.621132    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw7w6\" (UniqueName: \"kubernetes.io/projected/406f1a28-2ffe-433e-ac46-6af95cbe6b15-kube-api-access-sw7w6\") pod \"dns-default-4wpt9\" (UID: \"406f1a28-2ffe-433e-ac46-6af95cbe6b15\") " pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:32.621580 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.621158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rngwg\" (UniqueName: \"kubernetes.io/projected/152482d3-38ae-4cb2-a613-629c044074dc-kube-api-access-rngwg\") pod \"ingress-canary-dlv8m\" (UID: \"152482d3-38ae-4cb2-a613-629c044074dc\") " pod="openshift-ingress-canary/ingress-canary-dlv8m"
Jul 27 17:21:32.621580 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.621182    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-certificates\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.621580 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.621076    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa222af2-57f7-4cf8-b773-1af5e3bde69e-data-volume\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:32.621580 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.621220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.621580 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:32.621290    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:21:32.621580 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:32.621302    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7875856454-b5jw7: secret "image-registry-tls" not found
Jul 27 17:21:32.621580 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.621317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-ca-trust-extracted\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.621580 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:32.621340    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls podName:10dc96d7-5b49-4b9d-a265-62c0dcce56c3 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:33.121326741 +0000 UTC m=+36.653077705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls") pod "image-registry-7875856454-b5jw7" (UID: "10dc96d7-5b49-4b9d-a265-62c0dcce56c3") : secret "image-registry-tls" not found
Jul 27 17:21:32.621580 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.621506    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa222af2-57f7-4cf8-b773-1af5e3bde69e-crio-socket\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:32.621580 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.621535    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-trusted-ca\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.621981 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:32.621608    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:21:32.621981 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:32.621657    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls podName:aa222af2-57f7-4cf8-b773-1af5e3bde69e nodeName:}" failed. No retries permitted until 2026-07-27 17:21:33.121636021 +0000 UTC m=+36.653386999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stqvq" (UID: "aa222af2-57f7-4cf8-b773-1af5e3bde69e") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:21:32.622047 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.622000    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/406f1a28-2ffe-433e-ac46-6af95cbe6b15-config-volume\") pod \"dns-default-4wpt9\" (UID: \"406f1a28-2ffe-433e-ac46-6af95cbe6b15\") " pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:32.622099 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.622048    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-certificates\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.625039 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.625018    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-image-registry-private-configuration\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.625164 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.625071    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-installation-pull-secrets\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.625225 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.625165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/152482d3-38ae-4cb2-a613-629c044074dc-cert\") pod \"ingress-canary-dlv8m\" (UID: \"152482d3-38ae-4cb2-a613-629c044074dc\") " pod="openshift-ingress-canary/ingress-canary-dlv8m"
Jul 27 17:21:32.633451 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.633392    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rngwg\" (UniqueName: \"kubernetes.io/projected/152482d3-38ae-4cb2-a613-629c044074dc-kube-api-access-rngwg\") pod \"ingress-canary-dlv8m\" (UID: \"152482d3-38ae-4cb2-a613-629c044074dc\") " pod="openshift-ingress-canary/ingress-canary-dlv8m"
Jul 27 17:21:32.634116 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.634087    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-bound-sa-token\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.634841 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.634815    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqm9v\" (UniqueName: \"kubernetes.io/projected/aa222af2-57f7-4cf8-b773-1af5e3bde69e-kube-api-access-gqm9v\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:32.635342 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.635298    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw7w6\" (UniqueName: \"kubernetes.io/projected/406f1a28-2ffe-433e-ac46-6af95cbe6b15-kube-api-access-sw7w6\") pod \"dns-default-4wpt9\" (UID: \"406f1a28-2ffe-433e-ac46-6af95cbe6b15\") " pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:32.635489 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.635400    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cpjv\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-kube-api-access-4cpjv\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:32.701784 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:32.701751    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dlv8m"
Jul 27 17:21:33.125786 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.125744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:33.125786 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.125793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:33.126550 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.125838    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa222af2-57f7-4cf8-b773-1af5e3bde69e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:33.126550 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.125864    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls\") pod \"dns-default-4wpt9\" (UID: \"406f1a28-2ffe-433e-ac46-6af95cbe6b15\") " pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:33.126550 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:33.125898    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:21:33.126550 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:33.125931    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 17:21:33.126550 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:33.125964    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:21:33.126550 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:33.125966    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:21:33.126550 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:33.125989    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7875856454-b5jw7: secret "image-registry-tls" not found
Jul 27 17:21:33.126550 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:33.125994    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls podName:aa222af2-57f7-4cf8-b773-1af5e3bde69e nodeName:}" failed. No retries permitted until 2026-07-27 17:21:34.125974057 +0000 UTC m=+37.657725022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stqvq" (UID: "aa222af2-57f7-4cf8-b773-1af5e3bde69e") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:21:33.126550 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:33.126017    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls podName:406f1a28-2ffe-433e-ac46-6af95cbe6b15 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:34.126002032 +0000 UTC m=+37.657752996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls") pod "dns-default-4wpt9" (UID: "406f1a28-2ffe-433e-ac46-6af95cbe6b15") : secret "dns-default-metrics-tls" not found
Jul 27 17:21:33.126550 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:33.126035    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aa222af2-57f7-4cf8-b773-1af5e3bde69e-kube-rbac-proxy-cm podName:aa222af2-57f7-4cf8-b773-1af5e3bde69e nodeName:}" failed. No retries permitted until 2026-07-27 17:21:34.12602523 +0000 UTC m=+37.657776195 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aa222af2-57f7-4cf8-b773-1af5e3bde69e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-stqvq" (UID: "aa222af2-57f7-4cf8-b773-1af5e3bde69e") : configmap "kube-rbac-proxy" not found
Jul 27 17:21:33.126550 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:33.126047    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls podName:10dc96d7-5b49-4b9d-a265-62c0dcce56c3 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:34.126041803 +0000 UTC m=+37.657792767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls") pod "image-registry-7875856454-b5jw7" (UID: "10dc96d7-5b49-4b9d-a265-62c0dcce56c3") : secret "image-registry-tls" not found
Jul 27 17:21:33.220152 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.220015    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-8w4sc"]
Jul 27 17:21:33.222409 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.222391    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-8w4sc"
Jul 27 17:21:33.224645 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.224614    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 27 17:21:33.224748 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.224688    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 27 17:21:33.225438 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.225389    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 27 17:21:33.225438 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.225405    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 27 17:21:33.225572 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.225443    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-z62wr\""
Jul 27 17:21:33.235873 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.235850    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-8w4sc"]
Jul 27 17:21:33.239244 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.239224    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dlv8m"]
Jul 27 17:21:33.243199 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:21:33.243177    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod152482d3_38ae_4cb2_a613_629c044074dc.slice/crio-2233be7315269efbf4288d78cf8c92abb59f71c56c55e5d2bd8f9564dbafee09 WatchSource:0}: Error finding container 2233be7315269efbf4288d78cf8c92abb59f71c56c55e5d2bd8f9564dbafee09: Status 404 returned error can't find the container with id 2233be7315269efbf4288d78cf8c92abb59f71c56c55e5d2bd8f9564dbafee09
Jul 27 17:21:33.326731 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.326702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/176836b0-26f8-422b-8057-3cabb80ed339-signing-cabundle\") pod \"service-ca-658d7b7c78-8w4sc\" (UID: \"176836b0-26f8-422b-8057-3cabb80ed339\") " pod="openshift-service-ca/service-ca-658d7b7c78-8w4sc"
Jul 27 17:21:33.326927 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.326746    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/176836b0-26f8-422b-8057-3cabb80ed339-signing-key\") pod \"service-ca-658d7b7c78-8w4sc\" (UID: \"176836b0-26f8-422b-8057-3cabb80ed339\") " pod="openshift-service-ca/service-ca-658d7b7c78-8w4sc"
Jul 27 17:21:33.326927 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.326774    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psrn2\" (UniqueName: \"kubernetes.io/projected/176836b0-26f8-422b-8057-3cabb80ed339-kube-api-access-psrn2\") pod \"service-ca-658d7b7c78-8w4sc\" (UID: \"176836b0-26f8-422b-8057-3cabb80ed339\") " pod="openshift-service-ca/service-ca-658d7b7c78-8w4sc"
Jul 27 17:21:33.427689 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.427582    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/176836b0-26f8-422b-8057-3cabb80ed339-signing-cabundle\") pod \"service-ca-658d7b7c78-8w4sc\" (UID: \"176836b0-26f8-422b-8057-3cabb80ed339\") " pod="openshift-service-ca/service-ca-658d7b7c78-8w4sc"
Jul 27 17:21:33.427689 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.427626    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/176836b0-26f8-422b-8057-3cabb80ed339-signing-key\") pod \"service-ca-658d7b7c78-8w4sc\" (UID: \"176836b0-26f8-422b-8057-3cabb80ed339\") " pod="openshift-service-ca/service-ca-658d7b7c78-8w4sc"
Jul 27 17:21:33.427689 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.427644    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psrn2\" (UniqueName: \"kubernetes.io/projected/176836b0-26f8-422b-8057-3cabb80ed339-kube-api-access-psrn2\") pod \"service-ca-658d7b7c78-8w4sc\" (UID: \"176836b0-26f8-422b-8057-3cabb80ed339\") " pod="openshift-service-ca/service-ca-658d7b7c78-8w4sc"
Jul 27 17:21:33.428229 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.428209    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/176836b0-26f8-422b-8057-3cabb80ed339-signing-cabundle\") pod \"service-ca-658d7b7c78-8w4sc\" (UID: \"176836b0-26f8-422b-8057-3cabb80ed339\") " pod="openshift-service-ca/service-ca-658d7b7c78-8w4sc"
Jul 27 17:21:33.430781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.430765    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/176836b0-26f8-422b-8057-3cabb80ed339-signing-key\") pod \"service-ca-658d7b7c78-8w4sc\" (UID: \"176836b0-26f8-422b-8057-3cabb80ed339\") " pod="openshift-service-ca/service-ca-658d7b7c78-8w4sc"
Jul 27 17:21:33.435000 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.434980    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psrn2\" (UniqueName: \"kubernetes.io/projected/176836b0-26f8-422b-8057-3cabb80ed339-kube-api-access-psrn2\") pod \"service-ca-658d7b7c78-8w4sc\" (UID: \"176836b0-26f8-422b-8057-3cabb80ed339\") " pod="openshift-service-ca/service-ca-658d7b7c78-8w4sc"
Jul 27 17:21:33.531530 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.531502    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-8w4sc"
Jul 27 17:21:33.661503 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.661471    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-8w4sc"]
Jul 27 17:21:33.665461 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:21:33.665430    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod176836b0_26f8_422b_8057_3cabb80ed339.slice/crio-6dc28b8394598b5367ea9c50cddae9e0a680dd71c5d376ea05489cc18bad8e7a WatchSource:0}: Error finding container 6dc28b8394598b5367ea9c50cddae9e0a680dd71c5d376ea05489cc18bad8e7a: Status 404 returned error can't find the container with id 6dc28b8394598b5367ea9c50cddae9e0a680dd71c5d376ea05489cc18bad8e7a
Jul 27 17:21:33.987339 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.987307    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:21:33.987539 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.987426    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:21:33.987539 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.987315    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:21:33.989919 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.989899    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 17:21:33.990046 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.989973    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 17:21:33.990046 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.989973    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 17:21:33.990400 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.990387    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 17:21:33.990481 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.990389    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dgczs\""
Jul 27 17:21:33.990481 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:33.990457    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fmfvk\""
Jul 27 17:21:34.134497 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:34.134462    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:34.134970 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:34.134700    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:21:34.134970 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:34.134722    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7875856454-b5jw7: secret "image-registry-tls" not found
Jul 27 17:21:34.134970 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:34.134703    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa222af2-57f7-4cf8-b773-1af5e3bde69e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:34.134970 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:34.134788    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls podName:10dc96d7-5b49-4b9d-a265-62c0dcce56c3 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:36.134767429 +0000 UTC m=+39.666518412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls") pod "image-registry-7875856454-b5jw7" (UID: "10dc96d7-5b49-4b9d-a265-62c0dcce56c3") : secret "image-registry-tls" not found
Jul 27 17:21:34.134970 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:34.134827    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls\") pod \"dns-default-4wpt9\" (UID: \"406f1a28-2ffe-433e-ac46-6af95cbe6b15\") " pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:34.134970 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:34.134907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:34.134970 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:34.134959    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:21:34.135288 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:34.135003    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:21:34.135288 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:34.135007    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls podName:406f1a28-2ffe-433e-ac46-6af95cbe6b15 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:36.134991333 +0000 UTC m=+39.666742318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls") pod "dns-default-4wpt9" (UID: "406f1a28-2ffe-433e-ac46-6af95cbe6b15") : secret "dns-default-metrics-tls" not found
Jul 27 17:21:34.135288 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:34.135039    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls podName:aa222af2-57f7-4cf8-b773-1af5e3bde69e nodeName:}" failed. No retries permitted until 2026-07-27 17:21:36.135027024 +0000 UTC m=+39.666777990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stqvq" (UID: "aa222af2-57f7-4cf8-b773-1af5e3bde69e") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:21:34.135288 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:34.135280    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa222af2-57f7-4cf8-b773-1af5e3bde69e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:34.163904 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:34.163870    2579 generic.go:356] "Generic (PLEG): container finished" podID="aefa7f7d-16e7-4697-9270-85fadc4f836e" containerID="aa643585992f4bf67a0c530b2e061f78c5b2dbc82b7f5f3e5966d24ad6af24e5" exitCode=0
Jul 27 17:21:34.164052 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:34.163962    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kv4hm" event={"ID":"aefa7f7d-16e7-4697-9270-85fadc4f836e","Type":"ContainerDied","Data":"aa643585992f4bf67a0c530b2e061f78c5b2dbc82b7f5f3e5966d24ad6af24e5"}
Jul 27 17:21:34.166065 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:34.166036    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-8w4sc" event={"ID":"176836b0-26f8-422b-8057-3cabb80ed339","Type":"ContainerStarted","Data":"6dc28b8394598b5367ea9c50cddae9e0a680dd71c5d376ea05489cc18bad8e7a"}
Jul 27 17:21:34.167391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:34.167360    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dlv8m" event={"ID":"152482d3-38ae-4cb2-a613-629c044074dc","Type":"ContainerStarted","Data":"2233be7315269efbf4288d78cf8c92abb59f71c56c55e5d2bd8f9564dbafee09"}
Jul 27 17:21:35.174718 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:35.174550    2579 generic.go:356] "Generic (PLEG): container finished" podID="aefa7f7d-16e7-4697-9270-85fadc4f836e" containerID="d54ff171e8d44c97612f44cab9aa20517b90ca3c3c1f6286f67fd0fa1140f499" exitCode=0
Jul 27 17:21:35.175138 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:35.174750    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kv4hm" event={"ID":"aefa7f7d-16e7-4697-9270-85fadc4f836e","Type":"ContainerDied","Data":"d54ff171e8d44c97612f44cab9aa20517b90ca3c3c1f6286f67fd0fa1140f499"}
Jul 27 17:21:36.154478 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:36.154441    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:36.154669 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:36.154533    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls\") pod \"dns-default-4wpt9\" (UID: \"406f1a28-2ffe-433e-ac46-6af95cbe6b15\") " pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:36.154669 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:36.154587    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:36.154669 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:36.154612    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:21:36.154669 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:36.154632    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7875856454-b5jw7: secret "image-registry-tls" not found
Jul 27 17:21:36.154810 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:36.154688    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls podName:10dc96d7-5b49-4b9d-a265-62c0dcce56c3 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:40.154672089 +0000 UTC m=+43.686423056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls") pod "image-registry-7875856454-b5jw7" (UID: "10dc96d7-5b49-4b9d-a265-62c0dcce56c3") : secret "image-registry-tls" not found
Jul 27 17:21:36.154810 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:36.154708    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:21:36.154810 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:36.154774    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls podName:406f1a28-2ffe-433e-ac46-6af95cbe6b15 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:40.154754264 +0000 UTC m=+43.686505247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls") pod "dns-default-4wpt9" (UID: "406f1a28-2ffe-433e-ac46-6af95cbe6b15") : secret "dns-default-metrics-tls" not found
Jul 27 17:21:36.154810 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:36.154711    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:21:36.154810 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:36.154809    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls podName:aa222af2-57f7-4cf8-b773-1af5e3bde69e nodeName:}" failed. No retries permitted until 2026-07-27 17:21:40.154801943 +0000 UTC m=+43.686552906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stqvq" (UID: "aa222af2-57f7-4cf8-b773-1af5e3bde69e") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:21:36.181268 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:36.181233    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kv4hm" event={"ID":"aefa7f7d-16e7-4697-9270-85fadc4f836e","Type":"ContainerStarted","Data":"e1f7acd2311448d054a4c710056ce5c6017a33cd57229c71b08c67a6289bcd4d"}
Jul 27 17:21:36.209296 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:36.208878    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kv4hm" podStartSLOduration=8.408002756 podStartE2EDuration="39.208859552s" totalImagesPullingTime="30.800856796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:20:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:21:36.207466209 +0000 UTC m=+39.739217197" watchObservedRunningTime="2026-07-27 17:21:36.208859552 +0000 UTC m=+39.740610537"
Jul 27 17:21:38.188821 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:38.188785    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-8w4sc" event={"ID":"176836b0-26f8-422b-8057-3cabb80ed339","Type":"ContainerStarted","Data":"97746e25668e2865ae3ce077e6a2ceafdf0cec65f7ce563d7ef18dc1445d5213"}
Jul 27 17:21:38.191652 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:38.191626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dlv8m" event={"ID":"152482d3-38ae-4cb2-a613-629c044074dc","Type":"ContainerStarted","Data":"82ff779138cb97dbb3745f7b233b5b77552a5742caeba10c120f002e0773f4be"}
Jul 27 17:21:38.243865 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:38.243811    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-8w4sc" podStartSLOduration=1.78848525 podStartE2EDuration="5.243791992s" totalImagesPullingTime="3.455306742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:21:38.243265599 +0000 UTC m=+41.775016586" watchObservedRunningTime="2026-07-27 17:21:38.243791992 +0000 UTC m=+41.775542971"
Jul 27 17:21:38.280726 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:38.280665    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dlv8m" podStartSLOduration=2.407874091 podStartE2EDuration="6.280644934s" totalImagesPullingTime="3.872770843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:21:38.276654739 +0000 UTC m=+41.808405782" watchObservedRunningTime="2026-07-27 17:21:38.280644934 +0000 UTC m=+41.812395923"
Jul 27 17:21:40.187021 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:40.186984    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:40.187511 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:40.187043    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:40.187511 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:40.187104    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls\") pod \"dns-default-4wpt9\" (UID: \"406f1a28-2ffe-433e-ac46-6af95cbe6b15\") " pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:40.187511 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:40.187149    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 17:21:40.187511 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:40.187210    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 17:21:40.187511 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:40.187220    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls podName:aa222af2-57f7-4cf8-b773-1af5e3bde69e nodeName:}" failed. No retries permitted until 2026-07-27 17:21:48.187200595 +0000 UTC m=+51.718951561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-stqvq" (UID: "aa222af2-57f7-4cf8-b773-1af5e3bde69e") : secret "insights-runtime-extractor-tls" not found
Jul 27 17:21:40.187511 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:40.187224    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 17:21:40.187511 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:40.187228    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7875856454-b5jw7: secret "image-registry-tls" not found
Jul 27 17:21:40.187511 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:40.187273    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls podName:406f1a28-2ffe-433e-ac46-6af95cbe6b15 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:48.187258468 +0000 UTC m=+51.719009446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls") pod "dns-default-4wpt9" (UID: "406f1a28-2ffe-433e-ac46-6af95cbe6b15") : secret "dns-default-metrics-tls" not found
Jul 27 17:21:40.187511 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:21:40.187292    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls podName:10dc96d7-5b49-4b9d-a265-62c0dcce56c3 nodeName:}" failed. No retries permitted until 2026-07-27 17:21:48.187281679 +0000 UTC m=+51.719032643 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls") pod "image-registry-7875856454-b5jw7" (UID: "10dc96d7-5b49-4b9d-a265-62c0dcce56c3") : secret "image-registry-tls" not found
Jul 27 17:21:48.251106 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:48.251068    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:48.251579 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:48.251115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:48.251579 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:48.251158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls\") pod \"dns-default-4wpt9\" (UID: \"406f1a28-2ffe-433e-ac46-6af95cbe6b15\") " pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:48.254525 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:48.254503    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/406f1a28-2ffe-433e-ac46-6af95cbe6b15-metrics-tls\") pod \"dns-default-4wpt9\" (UID: \"406f1a28-2ffe-433e-ac46-6af95cbe6b15\") " pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:48.254628 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:48.254536    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa222af2-57f7-4cf8-b773-1af5e3bde69e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-stqvq\" (UID: \"aa222af2-57f7-4cf8-b773-1af5e3bde69e\") " pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:48.254628 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:48.254549    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls\") pod \"image-registry-7875856454-b5jw7\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") " pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:48.279845 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:48.279821    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:48.307924 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:48.307390    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:48.319948 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:48.319924    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-stqvq"
Jul 27 17:21:48.453236 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:48.453201    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7875856454-b5jw7"]
Jul 27 17:21:48.459930 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:21:48.459891    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10dc96d7_5b49_4b9d_a265_62c0dcce56c3.slice/crio-f1521d0efe558dedb5327ae32af754448fd2dbb5770b174dde468260e0381d65 WatchSource:0}: Error finding container f1521d0efe558dedb5327ae32af754448fd2dbb5770b174dde468260e0381d65: Status 404 returned error can't find the container with id f1521d0efe558dedb5327ae32af754448fd2dbb5770b174dde468260e0381d65
Jul 27 17:21:48.468887 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:48.468865    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4wpt9"]
Jul 27 17:21:48.472130 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:21:48.472081    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod406f1a28_2ffe_433e_ac46_6af95cbe6b15.slice/crio-79307e370929115c22b8a54e9e9b3c2125e29bf48a0848faf331c620b5a4bdda WatchSource:0}: Error finding container 79307e370929115c22b8a54e9e9b3c2125e29bf48a0848faf331c620b5a4bdda: Status 404 returned error can't find the container with id 79307e370929115c22b8a54e9e9b3c2125e29bf48a0848faf331c620b5a4bdda
Jul 27 17:21:48.494032 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:48.494006    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-stqvq"]
Jul 27 17:21:48.497711 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:21:48.497691    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa222af2_57f7_4cf8_b773_1af5e3bde69e.slice/crio-15f8fd34267ab04d934edc9f8ff09b15050ede5320d2127418092b46315a28c3 WatchSource:0}: Error finding container 15f8fd34267ab04d934edc9f8ff09b15050ede5320d2127418092b46315a28c3: Status 404 returned error can't find the container with id 15f8fd34267ab04d934edc9f8ff09b15050ede5320d2127418092b46315a28c3
Jul 27 17:21:49.218150 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:49.218110    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stqvq" event={"ID":"aa222af2-57f7-4cf8-b773-1af5e3bde69e","Type":"ContainerStarted","Data":"15f8fd34267ab04d934edc9f8ff09b15050ede5320d2127418092b46315a28c3"}
Jul 27 17:21:49.221075 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:49.221043    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4wpt9" event={"ID":"406f1a28-2ffe-433e-ac46-6af95cbe6b15","Type":"ContainerStarted","Data":"79307e370929115c22b8a54e9e9b3c2125e29bf48a0848faf331c620b5a4bdda"}
Jul 27 17:21:49.222957 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:49.222929    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7875856454-b5jw7" event={"ID":"10dc96d7-5b49-4b9d-a265-62c0dcce56c3","Type":"ContainerStarted","Data":"b5c76ad0e65dc5f9edebb2e8e973d7c79bd70108431deb5a69f7c4fed7243ede"}
Jul 27 17:21:49.223052 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:49.222977    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7875856454-b5jw7" event={"ID":"10dc96d7-5b49-4b9d-a265-62c0dcce56c3","Type":"ContainerStarted","Data":"f1521d0efe558dedb5327ae32af754448fd2dbb5770b174dde468260e0381d65"}
Jul 27 17:21:49.223697 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:49.223681    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:21:49.244564 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:49.243792    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7875856454-b5jw7" podStartSLOduration=56.243771815 podStartE2EDuration="56.243771815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:20:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:21:49.242714193 +0000 UTC m=+52.774465180" watchObservedRunningTime="2026-07-27 17:21:49.243771815 +0000 UTC m=+52.775522802"
Jul 27 17:21:54.239253 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:54.239160    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stqvq" event={"ID":"aa222af2-57f7-4cf8-b773-1af5e3bde69e","Type":"ContainerStarted","Data":"0288fe11518e9bd807722b0b10ee87b60c34c63b95a201fea22cd69903c87af3"}
Jul 27 17:21:54.241024 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:54.240998    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4wpt9" event={"ID":"406f1a28-2ffe-433e-ac46-6af95cbe6b15","Type":"ContainerStarted","Data":"4a3c1ac584ab4215964fccc9c60adcfbda776bfae2db6b53a2c66946557652a8"}
Jul 27 17:21:54.241138 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:54.241047    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4wpt9" event={"ID":"406f1a28-2ffe-433e-ac46-6af95cbe6b15","Type":"ContainerStarted","Data":"2881fcc1eaff701fac457a5f1a77219ba71259e0bc6579cea5fc3d051ee0e5e5"}
Jul 27 17:21:54.241190 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:54.241134    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:21:54.262795 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:54.262750    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4wpt9" podStartSLOduration=16.770273896 podStartE2EDuration="22.262737028s" totalImagesPullingTime="5.492463132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:21:54.261406735 +0000 UTC m=+57.793157721" watchObservedRunningTime="2026-07-27 17:21:54.262737028 +0000 UTC m=+57.794488014"
Jul 27 17:21:55.996734 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:55.996705    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g"]
Jul 27 17:21:56.003813 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.003790    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"]
Jul 27 17:21:56.003957 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.003911    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g"
Jul 27 17:21:56.005869 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.005848    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.008058 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.007938    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 17:21:56.008058 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.007952    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 27 17:21:56.008058 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.008026    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 27 17:21:56.008058 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.008032    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 17:21:56.008359 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.008134    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 27 17:21:56.008446 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.008397    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 27 17:21:56.008628 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.008608    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 27 17:21:56.008730 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.008715    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 17:21:56.012454 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.012414    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g"]
Jul 27 17:21:56.012708 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.012691    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.012803 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.012737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz8mr\" (UniqueName: \"kubernetes.io/projected/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-kube-api-access-dz8mr\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.012803 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.012768    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-ca\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.012803 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.012796    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.012988 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.012821    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-hub\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.012988 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.012848    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b323480f-55b6-456f-afaa-fdb76f9c4380-klusterlet-config\") pod \"klusterlet-addon-workmgr-74488c7f96-xnj7g\" (UID: \"b323480f-55b6-456f-afaa-fdb76f9c4380\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g"
Jul 27 17:21:56.012988 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.012923    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b323480f-55b6-456f-afaa-fdb76f9c4380-tmp\") pod \"klusterlet-addon-workmgr-74488c7f96-xnj7g\" (UID: \"b323480f-55b6-456f-afaa-fdb76f9c4380\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g"
Jul 27 17:21:56.012988 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.012962    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.013167 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.012998    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh5j7\" (UniqueName: \"kubernetes.io/projected/b323480f-55b6-456f-afaa-fdb76f9c4380-kube-api-access-xh5j7\") pod \"klusterlet-addon-workmgr-74488c7f96-xnj7g\" (UID: \"b323480f-55b6-456f-afaa-fdb76f9c4380\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g"
Jul 27 17:21:56.023736 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.023709    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"]
Jul 27 17:21:56.064151 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.064116    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7875856454-b5jw7"]
Jul 27 17:21:56.103353 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.103324    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-xxlcr"]
Jul 27 17:21:56.105944 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.105923    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-xxlcr"
Jul 27 17:21:56.107995 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.107973    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 17:21:56.108104 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.107975    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cz77x\""
Jul 27 17:21:56.108104 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.108021    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 17:21:56.115118 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.115088    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.115278 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.115134    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvzlt\" (UniqueName: \"kubernetes.io/projected/62035540-6350-4c69-9134-c954a6de1fe7-kube-api-access-vvzlt\") pod \"downloads-7c97dc4555-xxlcr\" (UID: \"62035540-6350-4c69-9134-c954a6de1fe7\") " pod="openshift-console/downloads-7c97dc4555-xxlcr"
Jul 27 17:21:56.115278 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.115180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz8mr\" (UniqueName: \"kubernetes.io/projected/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-kube-api-access-dz8mr\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.115278 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.115213    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-ca\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.115278 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.115242    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.115278 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.115266    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-hub\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.115514 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.115294    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b323480f-55b6-456f-afaa-fdb76f9c4380-klusterlet-config\") pod \"klusterlet-addon-workmgr-74488c7f96-xnj7g\" (UID: \"b323480f-55b6-456f-afaa-fdb76f9c4380\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g"
Jul 27 17:21:56.115514 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.115326    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b323480f-55b6-456f-afaa-fdb76f9c4380-tmp\") pod \"klusterlet-addon-workmgr-74488c7f96-xnj7g\" (UID: \"b323480f-55b6-456f-afaa-fdb76f9c4380\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g"
Jul 27 17:21:56.115514 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.115350    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.115514 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.115378    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh5j7\" (UniqueName: \"kubernetes.io/projected/b323480f-55b6-456f-afaa-fdb76f9c4380-kube-api-access-xh5j7\") pod \"klusterlet-addon-workmgr-74488c7f96-xnj7g\" (UID: \"b323480f-55b6-456f-afaa-fdb76f9c4380\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g"
Jul 27 17:21:56.116105 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.116057    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b323480f-55b6-456f-afaa-fdb76f9c4380-tmp\") pod \"klusterlet-addon-workmgr-74488c7f96-xnj7g\" (UID: \"b323480f-55b6-456f-afaa-fdb76f9c4380\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g"
Jul 27 17:21:56.117088 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.117014    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.118770 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.118749    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-hub\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.118863 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.118774    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-ca\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.119105 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.119037    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b323480f-55b6-456f-afaa-fdb76f9c4380-klusterlet-config\") pod \"klusterlet-addon-workmgr-74488c7f96-xnj7g\" (UID: \"b323480f-55b6-456f-afaa-fdb76f9c4380\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g"
Jul 27 17:21:56.119281 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.119256    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.120087 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.120042    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.120794 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.120775    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-xxlcr"]
Jul 27 17:21:56.131362 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.131329    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh5j7\" (UniqueName: \"kubernetes.io/projected/b323480f-55b6-456f-afaa-fdb76f9c4380-kube-api-access-xh5j7\") pod \"klusterlet-addon-workmgr-74488c7f96-xnj7g\" (UID: \"b323480f-55b6-456f-afaa-fdb76f9c4380\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g"
Jul 27 17:21:56.133007 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.132986    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz8mr\" (UniqueName: \"kubernetes.io/projected/b1c23a38-eaf3-485b-817a-33a2ec30a5e1-kube-api-access-dz8mr\") pod \"cluster-proxy-proxy-agent-65bf9787c9-fgdvq\" (UID: \"b1c23a38-eaf3-485b-817a-33a2ec30a5e1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.216348 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.216317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvzlt\" (UniqueName: \"kubernetes.io/projected/62035540-6350-4c69-9134-c954a6de1fe7-kube-api-access-vvzlt\") pod \"downloads-7c97dc4555-xxlcr\" (UID: \"62035540-6350-4c69-9134-c954a6de1fe7\") " pod="openshift-console/downloads-7c97dc4555-xxlcr"
Jul 27 17:21:56.233279 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.233241    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7548b5dbfb-xn8nq"]
Jul 27 17:21:56.236138 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.236120    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.258133 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.258068    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvzlt\" (UniqueName: \"kubernetes.io/projected/62035540-6350-4c69-9134-c954a6de1fe7-kube-api-access-vvzlt\") pod \"downloads-7c97dc4555-xxlcr\" (UID: \"62035540-6350-4c69-9134-c954a6de1fe7\") " pod="openshift-console/downloads-7c97dc4555-xxlcr"
Jul 27 17:21:56.285805 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.285771    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7548b5dbfb-xn8nq"]
Jul 27 17:21:56.317048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.317007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4764c568-b22e-4c30-b532-7f9adef5a684-bound-sa-token\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.317048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.317050    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4764c568-b22e-4c30-b532-7f9adef5a684-ca-trust-extracted\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.317265 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.317105    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4764c568-b22e-4c30-b532-7f9adef5a684-registry-tls\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.317265 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.317153    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4764c568-b22e-4c30-b532-7f9adef5a684-image-registry-private-configuration\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.317265 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.317204    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtclc\" (UniqueName: \"kubernetes.io/projected/4764c568-b22e-4c30-b532-7f9adef5a684-kube-api-access-jtclc\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.317393 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.317298    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4764c568-b22e-4c30-b532-7f9adef5a684-trusted-ca\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.317393 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.317337    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4764c568-b22e-4c30-b532-7f9adef5a684-registry-certificates\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.317393 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.317368    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4764c568-b22e-4c30-b532-7f9adef5a684-installation-pull-secrets\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.319027 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.319000    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g"
Jul 27 17:21:56.333331 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.333298    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"
Jul 27 17:21:56.416365 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.416330    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-xxlcr"
Jul 27 17:21:56.418690 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.418656    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4764c568-b22e-4c30-b532-7f9adef5a684-trusted-ca\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.418834 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.418695    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4764c568-b22e-4c30-b532-7f9adef5a684-registry-certificates\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.418834 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.418714    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4764c568-b22e-4c30-b532-7f9adef5a684-installation-pull-secrets\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.418976 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.418950    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4764c568-b22e-4c30-b532-7f9adef5a684-bound-sa-token\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.419118 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.418995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4764c568-b22e-4c30-b532-7f9adef5a684-ca-trust-extracted\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.419118 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.419027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4764c568-b22e-4c30-b532-7f9adef5a684-registry-tls\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.419118 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.419066    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4764c568-b22e-4c30-b532-7f9adef5a684-image-registry-private-configuration\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.419118 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.419110    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtclc\" (UniqueName: \"kubernetes.io/projected/4764c568-b22e-4c30-b532-7f9adef5a684-kube-api-access-jtclc\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.420471 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.420445    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4764c568-b22e-4c30-b532-7f9adef5a684-registry-certificates\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.420561 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.420479    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4764c568-b22e-4c30-b532-7f9adef5a684-trusted-ca\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.420776 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.420754    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4764c568-b22e-4c30-b532-7f9adef5a684-ca-trust-extracted\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.421652 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.421623    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4764c568-b22e-4c30-b532-7f9adef5a684-installation-pull-secrets\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.422371 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.422350    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4764c568-b22e-4c30-b532-7f9adef5a684-image-registry-private-configuration\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.423264 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.423241    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4764c568-b22e-4c30-b532-7f9adef5a684-registry-tls\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.429348 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.429321    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4764c568-b22e-4c30-b532-7f9adef5a684-bound-sa-token\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.429483 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.429456    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtclc\" (UniqueName: \"kubernetes.io/projected/4764c568-b22e-4c30-b532-7f9adef5a684-kube-api-access-jtclc\") pod \"image-registry-7548b5dbfb-xn8nq\" (UID: \"4764c568-b22e-4c30-b532-7f9adef5a684\") " pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:56.546014 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:56.545977    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:57.151023 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:57.150985    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g962t"
Jul 27 17:21:57.790957 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:57.790806    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq"]
Jul 27 17:21:57.897230 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:21:57.897152    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1c23a38_eaf3_485b_817a_33a2ec30a5e1.slice/crio-ec5aaf3ae9fa7e5a78192948cb505297b0acf9c11bab584268c064df444523ec WatchSource:0}: Error finding container ec5aaf3ae9fa7e5a78192948cb505297b0acf9c11bab584268c064df444523ec: Status 404 returned error can't find the container with id ec5aaf3ae9fa7e5a78192948cb505297b0acf9c11bab584268c064df444523ec
Jul 27 17:21:58.004826 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:58.004796    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g"]
Jul 27 17:21:58.007568 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:21:58.007546    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb323480f_55b6_456f_afaa_fdb76f9c4380.slice/crio-532a613f178e8bc9a837a122c991f1bf07eb77392017fbc67b98f1b4f2bafb57 WatchSource:0}: Error finding container 532a613f178e8bc9a837a122c991f1bf07eb77392017fbc67b98f1b4f2bafb57: Status 404 returned error can't find the container with id 532a613f178e8bc9a837a122c991f1bf07eb77392017fbc67b98f1b4f2bafb57
Jul 27 17:21:58.014984 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:58.014956    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-xxlcr"]
Jul 27 17:21:58.015490 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:58.015469    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7548b5dbfb-xn8nq"]
Jul 27 17:21:58.017658 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:21:58.017637    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4764c568_b22e_4c30_b532_7f9adef5a684.slice/crio-64695f0676e859c0dd83eae059304b78b82f609d904d9c43626b475f13341b62 WatchSource:0}: Error finding container 64695f0676e859c0dd83eae059304b78b82f609d904d9c43626b475f13341b62: Status 404 returned error can't find the container with id 64695f0676e859c0dd83eae059304b78b82f609d904d9c43626b475f13341b62
Jul 27 17:21:58.018022 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:21:58.017999    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62035540_6350_4c69_9134_c954a6de1fe7.slice/crio-96ef6182328043410646c01f490537caed127feada408ff814f8304f617148c1 WatchSource:0}: Error finding container 96ef6182328043410646c01f490537caed127feada408ff814f8304f617148c1: Status 404 returned error can't find the container with id 96ef6182328043410646c01f490537caed127feada408ff814f8304f617148c1
Jul 27 17:21:58.255414 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:58.255326    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g" event={"ID":"b323480f-55b6-456f-afaa-fdb76f9c4380","Type":"ContainerStarted","Data":"532a613f178e8bc9a837a122c991f1bf07eb77392017fbc67b98f1b4f2bafb57"}
Jul 27 17:21:58.256547 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:58.256522    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-xxlcr" event={"ID":"62035540-6350-4c69-9134-c954a6de1fe7","Type":"ContainerStarted","Data":"96ef6182328043410646c01f490537caed127feada408ff814f8304f617148c1"}
Jul 27 17:21:58.257662 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:58.257640    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq" event={"ID":"b1c23a38-eaf3-485b-817a-33a2ec30a5e1","Type":"ContainerStarted","Data":"ec5aaf3ae9fa7e5a78192948cb505297b0acf9c11bab584268c064df444523ec"}
Jul 27 17:21:58.259070 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:58.259048    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq" event={"ID":"4764c568-b22e-4c30-b532-7f9adef5a684","Type":"ContainerStarted","Data":"24d4678fbe531227e83f8b724c428876066d0e5bfd124951cdf1d4c6e9765d4a"}
Jul 27 17:21:58.259212 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:58.259085    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq" event={"ID":"4764c568-b22e-4c30-b532-7f9adef5a684","Type":"ContainerStarted","Data":"64695f0676e859c0dd83eae059304b78b82f609d904d9c43626b475f13341b62"}
Jul 27 17:21:58.259212 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:58.259127    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:21:58.260887 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:58.260863    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stqvq" event={"ID":"aa222af2-57f7-4cf8-b773-1af5e3bde69e","Type":"ContainerStarted","Data":"83ec3b26c3c11140aa147eaa8af7b02baa903ad00f91f7e15fdd01ce528b9223"}
Jul 27 17:21:58.285633 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:21:58.285547    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq" podStartSLOduration=2.2855266739999998 podStartE2EDuration="2.285526674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:21:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:21:58.284884213 +0000 UTC m=+61.816635201" watchObservedRunningTime="2026-07-27 17:21:58.285526674 +0000 UTC m=+61.817277661"
Jul 27 17:22:02.776069 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:02.776031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs\") pod \"network-metrics-daemon-qdbml\" (UID: \"d28f5e0f-9c2d-40ba-9733-e4d66a23b602\") " pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:22:02.776462 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:02.776134    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret\") pod \"global-pull-secret-syncer-lx499\" (UID: \"60a2b76f-7c85-4e78-89f2-56d0556836d2\") " pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:22:02.778603 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:02.778575    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 17:22:02.779277 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:02.779067    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 17:22:02.790969 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:02.790913    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d28f5e0f-9c2d-40ba-9733-e4d66a23b602-metrics-certs\") pod \"network-metrics-daemon-qdbml\" (UID: \"d28f5e0f-9c2d-40ba-9733-e4d66a23b602\") " pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:22:02.790969 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:02.790925    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/60a2b76f-7c85-4e78-89f2-56d0556836d2-original-pull-secret\") pod \"global-pull-secret-syncer-lx499\" (UID: \"60a2b76f-7c85-4e78-89f2-56d0556836d2\") " pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:22:02.804533 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:02.804505    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lx499"
Jul 27 17:22:02.810691 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:02.810668    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fmfvk\""
Jul 27 17:22:02.818568 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:02.818545    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qdbml"
Jul 27 17:22:02.876787 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:02.876752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mznk6\" (UniqueName: \"kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6\") pod \"network-check-target-gnx7q\" (UID: \"19b8b02a-b424-4457-99d7-27434924db05\") " pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:22:02.879449 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:02.879407    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 17:22:02.889589 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:02.889558    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 17:22:02.902147 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:02.901545    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mznk6\" (UniqueName: \"kubernetes.io/projected/19b8b02a-b424-4457-99d7-27434924db05-kube-api-access-mznk6\") pod \"network-check-target-gnx7q\" (UID: \"19b8b02a-b424-4457-99d7-27434924db05\") " pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:22:03.100915 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:03.100836    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dgczs\""
Jul 27 17:22:03.108911 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:03.108881    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:22:04.246573 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:04.246539    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4wpt9"
Jul 27 17:22:06.076561 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:06.075336    2579 patch_prober.go:28] interesting pod/image-registry-7875856454-b5jw7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 27 17:22:06.076561 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:06.075435    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7875856454-b5jw7" podUID="10dc96d7-5b49-4b9d-a265-62c0dcce56c3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 17:22:07.691806 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:07.691730    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lx499"]
Jul 27 17:22:07.696465 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:22:07.696400    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60a2b76f_7c85_4e78_89f2_56d0556836d2.slice/crio-50cec01127a564e4e8be7d66c0f13137e4b11c5104138c3f5f43eca9b1580eca WatchSource:0}: Error finding container 50cec01127a564e4e8be7d66c0f13137e4b11c5104138c3f5f43eca9b1580eca: Status 404 returned error can't find the container with id 50cec01127a564e4e8be7d66c0f13137e4b11c5104138c3f5f43eca9b1580eca
Jul 27 17:22:07.919857 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:07.919829    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gnx7q"]
Jul 27 17:22:07.924330 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:22:07.924299    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b8b02a_b424_4457_99d7_27434924db05.slice/crio-4a59080f33912c24e6de8e3952b8db6646ac696e12c8133c968da02e0ed7b194 WatchSource:0}: Error finding container 4a59080f33912c24e6de8e3952b8db6646ac696e12c8133c968da02e0ed7b194: Status 404 returned error can't find the container with id 4a59080f33912c24e6de8e3952b8db6646ac696e12c8133c968da02e0ed7b194
Jul 27 17:22:07.924652 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:07.924634    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qdbml"]
Jul 27 17:22:07.929825 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:22:07.929793    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd28f5e0f_9c2d_40ba_9733_e4d66a23b602.slice/crio-491e45fb5777c2245b6cd43792dbc186554ecf55914180abede7158c6710ce00 WatchSource:0}: Error finding container 491e45fb5777c2245b6cd43792dbc186554ecf55914180abede7158c6710ce00: Status 404 returned error can't find the container with id 491e45fb5777c2245b6cd43792dbc186554ecf55914180abede7158c6710ce00
Jul 27 17:22:08.309025 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:08.308443    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq" event={"ID":"b1c23a38-eaf3-485b-817a-33a2ec30a5e1","Type":"ContainerStarted","Data":"f85bddd6969e377446a5e480e84b53efb4e248d81894544221d5ceb1a9da4379"}
Jul 27 17:22:08.309025 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:08.308494    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq" event={"ID":"b1c23a38-eaf3-485b-817a-33a2ec30a5e1","Type":"ContainerStarted","Data":"376fa52869b7061abae9314b62e0cd4de05354044ca18896d9e7a2892e3def4a"}
Jul 27 17:22:08.309025 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:08.308514    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq" event={"ID":"b1c23a38-eaf3-485b-817a-33a2ec30a5e1","Type":"ContainerStarted","Data":"38c3d231014c322b71b0a3e51d336dcbb1d45e6eb523e69f9b67b7098062d237"}
Jul 27 17:22:08.310141 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:08.310091    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qdbml" event={"ID":"d28f5e0f-9c2d-40ba-9733-e4d66a23b602","Type":"ContainerStarted","Data":"491e45fb5777c2245b6cd43792dbc186554ecf55914180abede7158c6710ce00"}
Jul 27 17:22:08.312676 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:08.312609    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gnx7q" event={"ID":"19b8b02a-b424-4457-99d7-27434924db05","Type":"ContainerStarted","Data":"4a59080f33912c24e6de8e3952b8db6646ac696e12c8133c968da02e0ed7b194"}
Jul 27 17:22:08.315604 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:08.315577    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lx499" event={"ID":"60a2b76f-7c85-4e78-89f2-56d0556836d2","Type":"ContainerStarted","Data":"50cec01127a564e4e8be7d66c0f13137e4b11c5104138c3f5f43eca9b1580eca"}
Jul 27 17:22:08.319568 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:08.319193    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-stqvq" event={"ID":"aa222af2-57f7-4cf8-b773-1af5e3bde69e","Type":"ContainerStarted","Data":"1756ec561b93ffa1b8a59ee551a328482b771dc849f54be93ecce216d371a755"}
Jul 27 17:22:08.323282 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:08.322283    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g" event={"ID":"b323480f-55b6-456f-afaa-fdb76f9c4380","Type":"ContainerStarted","Data":"af09e7d542cfce9de5cf6f45ea220878140b5ffe3d8e6cde5977aefa2df81109"}
Jul 27 17:22:08.323282 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:08.323269    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g"
Jul 27 17:22:08.325026 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:08.325003    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g"
Jul 27 17:22:08.328084 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:08.328030    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-65bf9787c9-fgdvq" podStartSLOduration=3.7448979270000002 podStartE2EDuration="13.328012673s" totalImagesPullingTime="9.583114746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:21:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:22:08.327169578 +0000 UTC m=+71.858920591" watchObservedRunningTime="2026-07-27 17:22:08.328012673 +0000 UTC m=+71.859763654"
Jul 27 17:22:08.348858 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:08.348063    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-stqvq" podStartSLOduration=17.540633452 podStartE2EDuration="36.348043513s" totalImagesPullingTime="18.807410061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:21:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:22:08.344830199 +0000 UTC m=+71.876581186" watchObservedRunningTime="2026-07-27 17:22:08.348043513 +0000 UTC m=+71.879794499"
Jul 27 17:22:08.362303 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:08.362238    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74488c7f96-xnj7g" podStartSLOduration=3.850009168 podStartE2EDuration="13.362222599s" totalImagesPullingTime="9.512213431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:21:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:22:08.361724235 +0000 UTC m=+71.893475223" watchObservedRunningTime="2026-07-27 17:22:08.362222599 +0000 UTC m=+71.893973585"
Jul 27 17:22:16.070966 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:16.070932    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:22:18.717035 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:18.716913    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h88w2"]
Jul 27 17:22:18.873039 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:18.873005    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:18.876091 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:18.875529    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 17:22:18.876091 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:18.875622    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 17:22:18.876091 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:18.875744    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 17:22:18.876091 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:18.875920    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 17:22:18.876458 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:18.876279    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k48sk\""
Jul 27 17:22:18.876458 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:18.876363    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 17:22:18.877644 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:18.877506    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 17:22:19.018552 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.018439    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4m69\" (UniqueName: \"kubernetes.io/projected/b615dc3a-d8b9-449c-996a-374e6a2b90c2-kube-api-access-h4m69\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.018552 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.018493    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b615dc3a-d8b9-449c-996a-374e6a2b90c2-root\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.018552 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.018529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-wtmp\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.018815 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.018556    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b615dc3a-d8b9-449c-996a-374e6a2b90c2-sys\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.018815 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.018609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b615dc3a-d8b9-449c-996a-374e6a2b90c2-metrics-client-ca\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.018815 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.018649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-textfile\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.018815 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.018723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.018815 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.018782    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-tls\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.019027 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.018818    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.121093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.120218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-wtmp\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.121093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.120273    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b615dc3a-d8b9-449c-996a-374e6a2b90c2-sys\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.121093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.120308    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b615dc3a-d8b9-449c-996a-374e6a2b90c2-metrics-client-ca\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.121093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.120326    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-textfile\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.121093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.120360    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.121093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.120396    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-tls\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.121093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.120434    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-wtmp\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.121093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.120450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.121093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.120515    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4m69\" (UniqueName: \"kubernetes.io/projected/b615dc3a-d8b9-449c-996a-374e6a2b90c2-kube-api-access-h4m69\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.121093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.120532    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b615dc3a-d8b9-449c-996a-374e6a2b90c2-sys\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.121093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.120547    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b615dc3a-d8b9-449c-996a-374e6a2b90c2-root\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.121093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.120619    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b615dc3a-d8b9-449c-996a-374e6a2b90c2-root\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.121093 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:22:19.120703    2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 27 17:22:19.121093 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:22:19.120770    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-tls podName:b615dc3a-d8b9-449c-996a-374e6a2b90c2 nodeName:}" failed. No retries permitted until 2026-07-27 17:22:19.620748163 +0000 UTC m=+83.152499126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-tls") pod "node-exporter-h88w2" (UID: "b615dc3a-d8b9-449c-996a-374e6a2b90c2") : secret "node-exporter-tls" not found
Jul 27 17:22:19.121093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.120924    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-textfile\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.121093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.121058    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.121093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.121088    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b615dc3a-d8b9-449c-996a-374e6a2b90c2-metrics-client-ca\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.123659 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.123638    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.129814 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.129791    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4m69\" (UniqueName: \"kubernetes.io/projected/b615dc3a-d8b9-449c-996a-374e6a2b90c2-kube-api-access-h4m69\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.269748 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.269679    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7548b5dbfb-xn8nq"
Jul 27 17:22:19.625221 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.625181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-tls\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.627781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.627752    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b615dc3a-d8b9-449c-996a-374e6a2b90c2-node-exporter-tls\") pod \"node-exporter-h88w2\" (UID: \"b615dc3a-d8b9-449c-996a-374e6a2b90c2\") " pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:19.786823 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:19.786791    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h88w2"
Jul 27 17:22:20.396323 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:22:20.396292    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb615dc3a_d8b9_449c_996a_374e6a2b90c2.slice/crio-c6c02f6494ee58f041c952cb787a177fbdd4a33f4848341d9639218d19a440be WatchSource:0}: Error finding container c6c02f6494ee58f041c952cb787a177fbdd4a33f4848341d9639218d19a440be: Status 404 returned error can't find the container with id c6c02f6494ee58f041c952cb787a177fbdd4a33f4848341d9639218d19a440be
Jul 27 17:22:21.086023 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.085984    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7875856454-b5jw7" podUID="10dc96d7-5b49-4b9d-a265-62c0dcce56c3" containerName="registry" containerID="cri-o://b5c76ad0e65dc5f9edebb2e8e973d7c79bd70108431deb5a69f7c4fed7243ede" gracePeriod=30
Jul 27 17:22:21.381437 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.381331    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lx499" event={"ID":"60a2b76f-7c85-4e78-89f2-56d0556836d2","Type":"ContainerStarted","Data":"3cb68884029cc926139abe8fab89e4ed317a5ec4be49787e51d3a3d41cdf710b"}
Jul 27 17:22:21.383637 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.383611    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h88w2" event={"ID":"b615dc3a-d8b9-449c-996a-374e6a2b90c2","Type":"ContainerStarted","Data":"c6c02f6494ee58f041c952cb787a177fbdd4a33f4848341d9639218d19a440be"}
Jul 27 17:22:21.385978 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.385948    2579 generic.go:356] "Generic (PLEG): container finished" podID="10dc96d7-5b49-4b9d-a265-62c0dcce56c3" containerID="b5c76ad0e65dc5f9edebb2e8e973d7c79bd70108431deb5a69f7c4fed7243ede" exitCode=0
Jul 27 17:22:21.386113 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.386032    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7875856454-b5jw7" event={"ID":"10dc96d7-5b49-4b9d-a265-62c0dcce56c3","Type":"ContainerDied","Data":"b5c76ad0e65dc5f9edebb2e8e973d7c79bd70108431deb5a69f7c4fed7243ede"}
Jul 27 17:22:21.388584 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.388523    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-xxlcr" event={"ID":"62035540-6350-4c69-9134-c954a6de1fe7","Type":"ContainerStarted","Data":"e31ab9ebfad92ee9191266a3d88eb3d2f287ba8cef6e952e970547cdf9508ae1"}
Jul 27 17:22:21.388902 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.388883    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-xxlcr"
Jul 27 17:22:21.392389 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.392366    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qdbml" event={"ID":"d28f5e0f-9c2d-40ba-9733-e4d66a23b602","Type":"ContainerStarted","Data":"3e0d0a9e404d4770e580c0fdbfcb08f4690a541e7427566eda2ec9e61e455f14"}
Jul 27 17:22:21.392599 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.392438    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qdbml" event={"ID":"d28f5e0f-9c2d-40ba-9733-e4d66a23b602","Type":"ContainerStarted","Data":"174d0a600cd8e117da28d68ca74393a9de39a285ff748c3bacbbaae0dfaaac6e"}
Jul 27 17:22:21.394995 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.394974    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gnx7q" event={"ID":"19b8b02a-b424-4457-99d7-27434924db05","Type":"ContainerStarted","Data":"d8c7ddfe6c51d90460bf7e2bd2f620e43741d549409e0dd4fe86bd6e57350165"}
Jul 27 17:22:21.395393 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.395361    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:22:21.400890 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.400844    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-xxlcr"
Jul 27 17:22:21.414766 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.412970    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qdbml" podStartSLOduration=71.954371195 podStartE2EDuration="1m24.412951305s" totalImagesPullingTime="12.45858011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:22:21.411765926 +0000 UTC m=+84.943516913" watchObservedRunningTime="2026-07-27 17:22:21.412951305 +0000 UTC m=+84.944702292"
Jul 27 17:22:21.414766 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.413564    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lx499" podStartSLOduration=71.718811497 podStartE2EDuration="1m24.413548096s" totalImagesPullingTime="12.694736599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:22:21.39757584 +0000 UTC m=+84.929326826" watchObservedRunningTime="2026-07-27 17:22:21.413548096 +0000 UTC m=+84.945299088"
Jul 27 17:22:21.432323 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.432267    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-xxlcr" podStartSLOduration=3.001305207 podStartE2EDuration="25.432251373s" totalImagesPullingTime="22.430946166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:22:21.431697693 +0000 UTC m=+84.963448680" watchObservedRunningTime="2026-07-27 17:22:21.432251373 +0000 UTC m=+84.964002360"
Jul 27 17:22:21.447793 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.447751    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gnx7q" podStartSLOduration=71.981310273 podStartE2EDuration="1m24.447737192s" totalImagesPullingTime="12.466426919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:22:21.445969911 +0000 UTC m=+84.977720908" watchObservedRunningTime="2026-07-27 17:22:21.447737192 +0000 UTC m=+84.979488178"
Jul 27 17:22:21.704490 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.704135    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:22:21.849307 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.848558    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cpjv\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-kube-api-access-4cpjv\") pod \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") "
Jul 27 17:22:21.849307 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.848611    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-ca-trust-extracted\") pod \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") "
Jul 27 17:22:21.849307 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.848636    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-image-registry-private-configuration\") pod \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") "
Jul 27 17:22:21.849307 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.848657    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-bound-sa-token\") pod \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") "
Jul 27 17:22:21.849307 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.848703    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-trusted-ca\") pod \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") "
Jul 27 17:22:21.849307 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.848745    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls\") pod \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") "
Jul 27 17:22:21.849307 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.848783    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-certificates\") pod \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") "
Jul 27 17:22:21.849307 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.848830    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-installation-pull-secrets\") pod \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\" (UID: \"10dc96d7-5b49-4b9d-a265-62c0dcce56c3\") "
Jul 27 17:22:21.853504 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.853171    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "10dc96d7-5b49-4b9d-a265-62c0dcce56c3" (UID: "10dc96d7-5b49-4b9d-a265-62c0dcce56c3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:22:21.853984 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.853920    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "10dc96d7-5b49-4b9d-a265-62c0dcce56c3" (UID: "10dc96d7-5b49-4b9d-a265-62c0dcce56c3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:22:21.855243 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.855207    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "10dc96d7-5b49-4b9d-a265-62c0dcce56c3" (UID: "10dc96d7-5b49-4b9d-a265-62c0dcce56c3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:22:21.856523 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.856489    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-kube-api-access-4cpjv" (OuterVolumeSpecName: "kube-api-access-4cpjv") pod "10dc96d7-5b49-4b9d-a265-62c0dcce56c3" (UID: "10dc96d7-5b49-4b9d-a265-62c0dcce56c3"). InnerVolumeSpecName "kube-api-access-4cpjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:22:21.856686 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.856615    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "10dc96d7-5b49-4b9d-a265-62c0dcce56c3" (UID: "10dc96d7-5b49-4b9d-a265-62c0dcce56c3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:22:21.862980 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.862950    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "10dc96d7-5b49-4b9d-a265-62c0dcce56c3" (UID: "10dc96d7-5b49-4b9d-a265-62c0dcce56c3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:22:21.864664 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.864365    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "10dc96d7-5b49-4b9d-a265-62c0dcce56c3" (UID: "10dc96d7-5b49-4b9d-a265-62c0dcce56c3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:22:21.867106 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.867078    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "10dc96d7-5b49-4b9d-a265-62c0dcce56c3" (UID: "10dc96d7-5b49-4b9d-a265-62c0dcce56c3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:22:21.949984 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.949958    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-trusted-ca\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:22:21.950103 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.949987    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-tls\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:22:21.950103 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.950000    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-registry-certificates\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:22:21.950103 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.950013    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-installation-pull-secrets\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:22:21.950103 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.950026    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cpjv\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-kube-api-access-4cpjv\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:22:21.950103 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.950041    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-ca-trust-extracted\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:22:21.950103 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.950054    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-image-registry-private-configuration\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:22:21.950103 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:21.950066    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/10dc96d7-5b49-4b9d-a265-62c0dcce56c3-bound-sa-token\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:22:22.406380 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:22.401275    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7875856454-b5jw7"
Jul 27 17:22:22.406380 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:22.401289    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7875856454-b5jw7" event={"ID":"10dc96d7-5b49-4b9d-a265-62c0dcce56c3","Type":"ContainerDied","Data":"f1521d0efe558dedb5327ae32af754448fd2dbb5770b174dde468260e0381d65"}
Jul 27 17:22:22.406380 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:22.401367    2579 scope.go:117] "RemoveContainer" containerID="b5c76ad0e65dc5f9edebb2e8e973d7c79bd70108431deb5a69f7c4fed7243ede"
Jul 27 17:22:22.406380 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:22.403262    2579 generic.go:356] "Generic (PLEG): container finished" podID="b615dc3a-d8b9-449c-996a-374e6a2b90c2" containerID="981f8c6d379bf84f904f9a20bf0564d0092d6ffd9b49038632863493d4d0ff09" exitCode=0
Jul 27 17:22:22.406380 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:22.403870    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h88w2" event={"ID":"b615dc3a-d8b9-449c-996a-374e6a2b90c2","Type":"ContainerDied","Data":"981f8c6d379bf84f904f9a20bf0564d0092d6ffd9b49038632863493d4d0ff09"}
Jul 27 17:22:22.440325 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:22.440290    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7875856454-b5jw7"]
Jul 27 17:22:22.447158 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:22.447087    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7875856454-b5jw7"]
Jul 27 17:22:22.993574 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:22.993542    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10dc96d7-5b49-4b9d-a265-62c0dcce56c3" path="/var/lib/kubelet/pods/10dc96d7-5b49-4b9d-a265-62c0dcce56c3/volumes"
Jul 27 17:22:23.410705 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:23.410663    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h88w2" event={"ID":"b615dc3a-d8b9-449c-996a-374e6a2b90c2","Type":"ContainerStarted","Data":"1a3946fb1004fda615c9947b37637a380fa251ed186045029636cd1e65f870b1"}
Jul 27 17:22:23.411151 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:23.410725    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h88w2" event={"ID":"b615dc3a-d8b9-449c-996a-374e6a2b90c2","Type":"ContainerStarted","Data":"9ce3a5851e230705e490c375ab5b49315a8b8119e443d402bd6fafb97b463c85"}
Jul 27 17:22:23.447013 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:23.445819    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h88w2" podStartSLOduration=3.794905045 podStartE2EDuration="5.445797647s" totalImagesPullingTime="1.5494524s" totalInitContainerRuntime="101.440202ms" isStatefulPod=true podCreationTimestamp="2026-07-27 17:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:22:23.444995855 +0000 UTC m=+86.976746842" watchObservedRunningTime="2026-07-27 17:22:23.445797647 +0000 UTC m=+86.977548634"
Jul 27 17:22:53.414383 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:22:53.414355    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gnx7q"
Jul 27 17:25:17.618369 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.618287    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn"]
Jul 27 17:25:17.618825 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.618541    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10dc96d7-5b49-4b9d-a265-62c0dcce56c3" containerName="registry"
Jul 27 17:25:17.618825 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.618552    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="10dc96d7-5b49-4b9d-a265-62c0dcce56c3" containerName="registry"
Jul 27 17:25:17.618825 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.618603    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="10dc96d7-5b49-4b9d-a265-62c0dcce56c3" containerName="registry"
Jul 27 17:25:17.620387 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.620370    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn"
Jul 27 17:25:17.622642 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.622620    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 17:25:17.622755 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.622665    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 17:25:17.623369 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.623354    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-thzqv\""
Jul 27 17:25:17.634290 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.634270    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn"]
Jul 27 17:25:17.692674 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.692641    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99415227-bcdd-4658-a367-82c7172c16d6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn\" (UID: \"99415227-bcdd-4658-a367-82c7172c16d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn"
Jul 27 17:25:17.692674 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.692681    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99415227-bcdd-4658-a367-82c7172c16d6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn\" (UID: \"99415227-bcdd-4658-a367-82c7172c16d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn"
Jul 27 17:25:17.692902 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.692708    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zzms\" (UniqueName: \"kubernetes.io/projected/99415227-bcdd-4658-a367-82c7172c16d6-kube-api-access-6zzms\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn\" (UID: \"99415227-bcdd-4658-a367-82c7172c16d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn"
Jul 27 17:25:17.793827 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.793792    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99415227-bcdd-4658-a367-82c7172c16d6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn\" (UID: \"99415227-bcdd-4658-a367-82c7172c16d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn"
Jul 27 17:25:17.793997 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.793835    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99415227-bcdd-4658-a367-82c7172c16d6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn\" (UID: \"99415227-bcdd-4658-a367-82c7172c16d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn"
Jul 27 17:25:17.793997 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.793859    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zzms\" (UniqueName: \"kubernetes.io/projected/99415227-bcdd-4658-a367-82c7172c16d6-kube-api-access-6zzms\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn\" (UID: \"99415227-bcdd-4658-a367-82c7172c16d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn"
Jul 27 17:25:17.794284 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.794263    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99415227-bcdd-4658-a367-82c7172c16d6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn\" (UID: \"99415227-bcdd-4658-a367-82c7172c16d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn"
Jul 27 17:25:17.794324 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.794279    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99415227-bcdd-4658-a367-82c7172c16d6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn\" (UID: \"99415227-bcdd-4658-a367-82c7172c16d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn"
Jul 27 17:25:17.802262 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.802232    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zzms\" (UniqueName: \"kubernetes.io/projected/99415227-bcdd-4658-a367-82c7172c16d6-kube-api-access-6zzms\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn\" (UID: \"99415227-bcdd-4658-a367-82c7172c16d6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn"
Jul 27 17:25:17.929133 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:17.929040    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn"
Jul 27 17:25:18.056228 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:18.056196    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn"]
Jul 27 17:25:18.060795 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:25:18.060766    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99415227_bcdd_4658_a367_82c7172c16d6.slice/crio-5a6ab4987a8aea0f8c5e358244d31622b47990cb8eb531fa9ff5c0f1567506bc WatchSource:0}: Error finding container 5a6ab4987a8aea0f8c5e358244d31622b47990cb8eb531fa9ff5c0f1567506bc: Status 404 returned error can't find the container with id 5a6ab4987a8aea0f8c5e358244d31622b47990cb8eb531fa9ff5c0f1567506bc
Jul 27 17:25:18.979302 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:18.979263    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn" event={"ID":"99415227-bcdd-4658-a367-82c7172c16d6","Type":"ContainerStarted","Data":"5a6ab4987a8aea0f8c5e358244d31622b47990cb8eb531fa9ff5c0f1567506bc"}
Jul 27 17:25:25.001958 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:25.001925    2579 generic.go:356] "Generic (PLEG): container finished" podID="99415227-bcdd-4658-a367-82c7172c16d6" containerID="e26c8afe9ffa52d3e0f2298583037213f3a6fbe3278242ba70c7c2af2e2a2eff" exitCode=0
Jul 27 17:25:25.001958 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:25.001963    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn" event={"ID":"99415227-bcdd-4658-a367-82c7172c16d6","Type":"ContainerDied","Data":"e26c8afe9ffa52d3e0f2298583037213f3a6fbe3278242ba70c7c2af2e2a2eff"}
Jul 27 17:25:28.015817 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:28.015776    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn" event={"ID":"99415227-bcdd-4658-a367-82c7172c16d6","Type":"ContainerStarted","Data":"91e93a5a2ec7c38939d7eac13c820e3a0e1803556e9f7b3d0c53997152f5ac2e"}
Jul 27 17:25:29.019950 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:29.019915    2579 generic.go:356] "Generic (PLEG): container finished" podID="99415227-bcdd-4658-a367-82c7172c16d6" containerID="91e93a5a2ec7c38939d7eac13c820e3a0e1803556e9f7b3d0c53997152f5ac2e" exitCode=0
Jul 27 17:25:29.020320 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:29.019994    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn" event={"ID":"99415227-bcdd-4658-a367-82c7172c16d6","Type":"ContainerDied","Data":"91e93a5a2ec7c38939d7eac13c820e3a0e1803556e9f7b3d0c53997152f5ac2e"}
Jul 27 17:25:36.046201 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:36.046162    2579 generic.go:356] "Generic (PLEG): container finished" podID="99415227-bcdd-4658-a367-82c7172c16d6" containerID="71db12dfc0455824fa321768316e49bd1996e21ae270f995b0b6b0c6823a761b" exitCode=0
Jul 27 17:25:36.046581 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:36.046210    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn" event={"ID":"99415227-bcdd-4658-a367-82c7172c16d6","Type":"ContainerDied","Data":"71db12dfc0455824fa321768316e49bd1996e21ae270f995b0b6b0c6823a761b"}
Jul 27 17:25:37.169714 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:37.169692    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn"
Jul 27 17:25:37.249437 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:37.249392    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zzms\" (UniqueName: \"kubernetes.io/projected/99415227-bcdd-4658-a367-82c7172c16d6-kube-api-access-6zzms\") pod \"99415227-bcdd-4658-a367-82c7172c16d6\" (UID: \"99415227-bcdd-4658-a367-82c7172c16d6\") "
Jul 27 17:25:37.249614 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:37.249460    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99415227-bcdd-4658-a367-82c7172c16d6-bundle\") pod \"99415227-bcdd-4658-a367-82c7172c16d6\" (UID: \"99415227-bcdd-4658-a367-82c7172c16d6\") "
Jul 27 17:25:37.249614 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:37.249504    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99415227-bcdd-4658-a367-82c7172c16d6-util\") pod \"99415227-bcdd-4658-a367-82c7172c16d6\" (UID: \"99415227-bcdd-4658-a367-82c7172c16d6\") "
Jul 27 17:25:37.250118 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:37.250094    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99415227-bcdd-4658-a367-82c7172c16d6-bundle" (OuterVolumeSpecName: "bundle") pod "99415227-bcdd-4658-a367-82c7172c16d6" (UID: "99415227-bcdd-4658-a367-82c7172c16d6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:25:37.251875 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:37.251849    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99415227-bcdd-4658-a367-82c7172c16d6-kube-api-access-6zzms" (OuterVolumeSpecName: "kube-api-access-6zzms") pod "99415227-bcdd-4658-a367-82c7172c16d6" (UID: "99415227-bcdd-4658-a367-82c7172c16d6"). InnerVolumeSpecName "kube-api-access-6zzms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:25:37.253764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:37.253741    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99415227-bcdd-4658-a367-82c7172c16d6-util" (OuterVolumeSpecName: "util") pod "99415227-bcdd-4658-a367-82c7172c16d6" (UID: "99415227-bcdd-4658-a367-82c7172c16d6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:25:37.350269 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:37.350173    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99415227-bcdd-4658-a367-82c7172c16d6-util\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:25:37.350269 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:37.350216    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zzms\" (UniqueName: \"kubernetes.io/projected/99415227-bcdd-4658-a367-82c7172c16d6-kube-api-access-6zzms\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:25:37.350269 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:37.350228    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99415227-bcdd-4658-a367-82c7172c16d6-bundle\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:25:38.053723 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:38.053689    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn" event={"ID":"99415227-bcdd-4658-a367-82c7172c16d6","Type":"ContainerDied","Data":"5a6ab4987a8aea0f8c5e358244d31622b47990cb8eb531fa9ff5c0f1567506bc"}
Jul 27 17:25:38.053885 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:38.053735    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a6ab4987a8aea0f8c5e358244d31622b47990cb8eb531fa9ff5c0f1567506bc"
Jul 27 17:25:38.053885 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:38.053732    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bqjqn"
Jul 27 17:25:45.673955 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.673918    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dbjjq"]
Jul 27 17:25:45.674349 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.674213    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99415227-bcdd-4658-a367-82c7172c16d6" containerName="pull"
Jul 27 17:25:45.674349 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.674226    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="99415227-bcdd-4658-a367-82c7172c16d6" containerName="pull"
Jul 27 17:25:45.674349 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.674237    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99415227-bcdd-4658-a367-82c7172c16d6" containerName="util"
Jul 27 17:25:45.674349 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.674242    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="99415227-bcdd-4658-a367-82c7172c16d6" containerName="util"
Jul 27 17:25:45.674349 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.674252    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99415227-bcdd-4658-a367-82c7172c16d6" containerName="extract"
Jul 27 17:25:45.674349 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.674258    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="99415227-bcdd-4658-a367-82c7172c16d6" containerName="extract"
Jul 27 17:25:45.674349 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.674299    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="99415227-bcdd-4658-a367-82c7172c16d6" containerName="extract"
Jul 27 17:25:45.677509 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.677484    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dbjjq"
Jul 27 17:25:45.679895 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.679874    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 27 17:25:45.679991 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.679974    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vd7m5\""
Jul 27 17:25:45.680252 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.680237    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 27 17:25:45.690299 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.690274    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dbjjq"]
Jul 27 17:25:45.805522 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.805482    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/994482df-fc64-44fd-8286-3af87e823415-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dbjjq\" (UID: \"994482df-fc64-44fd-8286-3af87e823415\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dbjjq"
Jul 27 17:25:45.805707 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.805565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d7w6\" (UniqueName: \"kubernetes.io/projected/994482df-fc64-44fd-8286-3af87e823415-kube-api-access-7d7w6\") pod \"cert-manager-operator-controller-manager-55c444bf86-dbjjq\" (UID: \"994482df-fc64-44fd-8286-3af87e823415\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dbjjq"
Jul 27 17:25:45.905940 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.905902    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d7w6\" (UniqueName: \"kubernetes.io/projected/994482df-fc64-44fd-8286-3af87e823415-kube-api-access-7d7w6\") pod \"cert-manager-operator-controller-manager-55c444bf86-dbjjq\" (UID: \"994482df-fc64-44fd-8286-3af87e823415\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dbjjq"
Jul 27 17:25:45.906069 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.905961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/994482df-fc64-44fd-8286-3af87e823415-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dbjjq\" (UID: \"994482df-fc64-44fd-8286-3af87e823415\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dbjjq"
Jul 27 17:25:45.906346 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.906328    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/994482df-fc64-44fd-8286-3af87e823415-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-dbjjq\" (UID: \"994482df-fc64-44fd-8286-3af87e823415\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dbjjq"
Jul 27 17:25:45.915638 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.915617    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d7w6\" (UniqueName: \"kubernetes.io/projected/994482df-fc64-44fd-8286-3af87e823415-kube-api-access-7d7w6\") pod \"cert-manager-operator-controller-manager-55c444bf86-dbjjq\" (UID: \"994482df-fc64-44fd-8286-3af87e823415\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dbjjq"
Jul 27 17:25:45.986615 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:45.986537    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dbjjq"
Jul 27 17:25:46.123221 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:46.123198    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dbjjq"]
Jul 27 17:25:46.125340 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:25:46.125306    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994482df_fc64_44fd_8286_3af87e823415.slice/crio-69875e995cf1f5f9f9a0b2798e82bcf50fd5b436f1120080f021aa85c28897a7 WatchSource:0}: Error finding container 69875e995cf1f5f9f9a0b2798e82bcf50fd5b436f1120080f021aa85c28897a7: Status 404 returned error can't find the container with id 69875e995cf1f5f9f9a0b2798e82bcf50fd5b436f1120080f021aa85c28897a7
Jul 27 17:25:47.083704 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:47.083669    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dbjjq" event={"ID":"994482df-fc64-44fd-8286-3af87e823415","Type":"ContainerStarted","Data":"69875e995cf1f5f9f9a0b2798e82bcf50fd5b436f1120080f021aa85c28897a7"}
Jul 27 17:25:48.089446 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:48.089331    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dbjjq" event={"ID":"994482df-fc64-44fd-8286-3af87e823415","Type":"ContainerStarted","Data":"d522956e672e21f802c6a5cdecce206de76f0d51106dd8c52398b800a0cd392d"}
Jul 27 17:25:48.112840 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:48.112721    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-dbjjq" podStartSLOduration=1.457279139 podStartE2EDuration="3.112705316s" totalImagesPullingTime="1.655426177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:25:48.112185851 +0000 UTC m=+291.643936834" watchObservedRunningTime="2026-07-27 17:25:48.112705316 +0000 UTC m=+291.644456303"
Jul 27 17:25:49.477024 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:49.476990    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl"]
Jul 27 17:25:49.480233 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:49.480211    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl"
Jul 27 17:25:49.486864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:49.486837    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 17:25:49.486987 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:49.486963    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-thzqv\""
Jul 27 17:25:49.487067 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:49.487020    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 17:25:49.497640 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:49.497612    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl"]
Jul 27 17:25:49.637033 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:49.636989    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl\" (UID: \"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl"
Jul 27 17:25:49.637033 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:49.637031    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl\" (UID: \"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl"
Jul 27 17:25:49.637239 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:49.637111    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btktz\" (UniqueName: \"kubernetes.io/projected/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-kube-api-access-btktz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl\" (UID: \"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl"
Jul 27 17:25:49.738337 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:49.738254    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl\" (UID: \"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl"
Jul 27 17:25:49.738337 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:49.738288    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl\" (UID: \"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl"
Jul 27 17:25:49.738337 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:49.738327    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btktz\" (UniqueName: \"kubernetes.io/projected/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-kube-api-access-btktz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl\" (UID: \"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl"
Jul 27 17:25:49.738676 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:49.738657    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl\" (UID: \"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl"
Jul 27 17:25:49.738714 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:49.738688    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl\" (UID: \"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl"
Jul 27 17:25:49.746812 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:49.746788    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btktz\" (UniqueName: \"kubernetes.io/projected/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-kube-api-access-btktz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl\" (UID: \"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl"
Jul 27 17:25:49.789465 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:49.789409    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl"
Jul 27 17:25:49.925896 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:49.925873    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl"]
Jul 27 17:25:49.928143 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:25:49.928111    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f8f1d5_9cf1_44a4_bd89_2c671d1c2b7b.slice/crio-fd5cb9b6884db50a4f2f091aa6661cde26a52e691733455278f4753ba79e0414 WatchSource:0}: Error finding container fd5cb9b6884db50a4f2f091aa6661cde26a52e691733455278f4753ba79e0414: Status 404 returned error can't find the container with id fd5cb9b6884db50a4f2f091aa6661cde26a52e691733455278f4753ba79e0414
Jul 27 17:25:50.097934 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:50.097900    2579 generic.go:356] "Generic (PLEG): container finished" podID="61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b" containerID="b1f1797bf51ddbbd8be67c16e56f15dbc7f8625b258a46cf3f67495cc482ba47" exitCode=0
Jul 27 17:25:50.098090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:50.097944    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl" event={"ID":"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b","Type":"ContainerDied","Data":"b1f1797bf51ddbbd8be67c16e56f15dbc7f8625b258a46cf3f67495cc482ba47"}
Jul 27 17:25:50.098090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:50.097981    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl" event={"ID":"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b","Type":"ContainerStarted","Data":"fd5cb9b6884db50a4f2f091aa6661cde26a52e691733455278f4753ba79e0414"}
Jul 27 17:25:53.109215 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:53.109179    2579 generic.go:356] "Generic (PLEG): container finished" podID="61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b" containerID="28f9a1963f7cc7fe05147d89085a77316ad487ccc430e4225e2d1c694fd1b563" exitCode=0
Jul 27 17:25:53.109569 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:53.109242    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl" event={"ID":"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b","Type":"ContainerDied","Data":"28f9a1963f7cc7fe05147d89085a77316ad487ccc430e4225e2d1c694fd1b563"}
Jul 27 17:25:54.114891 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:54.114859    2579 generic.go:356] "Generic (PLEG): container finished" podID="61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b" containerID="de9f4503e7d18e8944bbd84f88b302da4fa0976b233e30b6c6578a938211b077" exitCode=0
Jul 27 17:25:54.115258 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:54.114899    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl" event={"ID":"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b","Type":"ContainerDied","Data":"de9f4503e7d18e8944bbd84f88b302da4fa0976b233e30b6c6578a938211b077"}
Jul 27 17:25:55.251226 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:55.251203    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl"
Jul 27 17:25:55.379640 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:55.379544    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-bundle\") pod \"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b\" (UID: \"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b\") "
Jul 27 17:25:55.379640 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:55.379587    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btktz\" (UniqueName: \"kubernetes.io/projected/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-kube-api-access-btktz\") pod \"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b\" (UID: \"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b\") "
Jul 27 17:25:55.379640 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:55.379623    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-util\") pod \"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b\" (UID: \"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b\") "
Jul 27 17:25:55.379993 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:55.379960    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-bundle" (OuterVolumeSpecName: "bundle") pod "61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b" (UID: "61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:25:55.381920 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:55.381896    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-kube-api-access-btktz" (OuterVolumeSpecName: "kube-api-access-btktz") pod "61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b" (UID: "61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b"). InnerVolumeSpecName "kube-api-access-btktz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:25:55.385289 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:55.385232    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-util" (OuterVolumeSpecName: "util") pod "61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b" (UID: "61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:25:55.480439 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:55.480380    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-util\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:25:55.480439 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:55.480409    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-bundle\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:25:55.480439 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:55.480437    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btktz\" (UniqueName: \"kubernetes.io/projected/61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b-kube-api-access-btktz\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:25:56.123655 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:56.123622    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl" event={"ID":"61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b","Type":"ContainerDied","Data":"fd5cb9b6884db50a4f2f091aa6661cde26a52e691733455278f4753ba79e0414"}
Jul 27 17:25:56.123655 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:56.123644    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz2zzl"
Jul 27 17:25:56.124005 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:56.123669    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd5cb9b6884db50a4f2f091aa6661cde26a52e691733455278f4753ba79e0414"
Jul 27 17:25:56.856575 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:25:56.856551    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 17:26:13.615309 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.615270    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk"]
Jul 27 17:26:13.618719 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.615517    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b" containerName="pull"
Jul 27 17:26:13.618719 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.615528    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b" containerName="pull"
Jul 27 17:26:13.618719 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.615537    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b" containerName="extract"
Jul 27 17:26:13.618719 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.615543    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b" containerName="extract"
Jul 27 17:26:13.618719 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.615552    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b" containerName="util"
Jul 27 17:26:13.618719 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.615558    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b" containerName="util"
Jul 27 17:26:13.618719 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.615605    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="61f8f1d5-9cf1-44a4-bd89-2c671d1c2b7b" containerName="extract"
Jul 27 17:26:13.618940 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.618723    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk"
Jul 27 17:26:13.621898 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.621868    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 17:26:13.622020 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.621955    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 17:26:13.622705 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.622686    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-thzqv\""
Jul 27 17:26:13.631125 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.631100    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk"]
Jul 27 17:26:13.711127 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.711092    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdjxk\" (UniqueName: \"kubernetes.io/projected/acf1cc92-b8f8-4958-82db-b165b24edf0c-kube-api-access-jdjxk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk\" (UID: \"acf1cc92-b8f8-4958-82db-b165b24edf0c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk"
Jul 27 17:26:13.711291 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.711133    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acf1cc92-b8f8-4958-82db-b165b24edf0c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk\" (UID: \"acf1cc92-b8f8-4958-82db-b165b24edf0c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk"
Jul 27 17:26:13.711291 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.711192    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acf1cc92-b8f8-4958-82db-b165b24edf0c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk\" (UID: \"acf1cc92-b8f8-4958-82db-b165b24edf0c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk"
Jul 27 17:26:13.811635 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.811589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdjxk\" (UniqueName: \"kubernetes.io/projected/acf1cc92-b8f8-4958-82db-b165b24edf0c-kube-api-access-jdjxk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk\" (UID: \"acf1cc92-b8f8-4958-82db-b165b24edf0c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk"
Jul 27 17:26:13.811635 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.811641    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acf1cc92-b8f8-4958-82db-b165b24edf0c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk\" (UID: \"acf1cc92-b8f8-4958-82db-b165b24edf0c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk"
Jul 27 17:26:13.811840 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.811695    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acf1cc92-b8f8-4958-82db-b165b24edf0c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk\" (UID: \"acf1cc92-b8f8-4958-82db-b165b24edf0c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk"
Jul 27 17:26:13.812012 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.811998    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acf1cc92-b8f8-4958-82db-b165b24edf0c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk\" (UID: \"acf1cc92-b8f8-4958-82db-b165b24edf0c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk"
Jul 27 17:26:13.812092 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.812075    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acf1cc92-b8f8-4958-82db-b165b24edf0c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk\" (UID: \"acf1cc92-b8f8-4958-82db-b165b24edf0c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk"
Jul 27 17:26:13.821963 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.821936    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdjxk\" (UniqueName: \"kubernetes.io/projected/acf1cc92-b8f8-4958-82db-b165b24edf0c-kube-api-access-jdjxk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk\" (UID: \"acf1cc92-b8f8-4958-82db-b165b24edf0c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk"
Jul 27 17:26:13.927605 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:13.927525    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk"
Jul 27 17:26:14.056184 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:14.056154    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk"]
Jul 27 17:26:14.059057 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:26:14.059032    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf1cc92_b8f8_4958_82db_b165b24edf0c.slice/crio-92ce090bc852caa19723b7842194f6120275e89b214a475cef5fd29358fdc7e2 WatchSource:0}: Error finding container 92ce090bc852caa19723b7842194f6120275e89b214a475cef5fd29358fdc7e2: Status 404 returned error can't find the container with id 92ce090bc852caa19723b7842194f6120275e89b214a475cef5fd29358fdc7e2
Jul 27 17:26:14.184691 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:14.184624    2579 generic.go:356] "Generic (PLEG): container finished" podID="acf1cc92-b8f8-4958-82db-b165b24edf0c" containerID="4cd75074cd8a8156f92dfd87fefd6e26a1629b2bd0affc59151ef32187396536" exitCode=0
Jul 27 17:26:14.184691 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:14.184672    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk" event={"ID":"acf1cc92-b8f8-4958-82db-b165b24edf0c","Type":"ContainerDied","Data":"4cd75074cd8a8156f92dfd87fefd6e26a1629b2bd0affc59151ef32187396536"}
Jul 27 17:26:14.184846 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:14.184707    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk" event={"ID":"acf1cc92-b8f8-4958-82db-b165b24edf0c","Type":"ContainerStarted","Data":"92ce090bc852caa19723b7842194f6120275e89b214a475cef5fd29358fdc7e2"}
Jul 27 17:26:14.185116 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:14.185101    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:26:15.190352 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:15.190267    2579 generic.go:356] "Generic (PLEG): container finished" podID="acf1cc92-b8f8-4958-82db-b165b24edf0c" containerID="23d823c430ca21167a660bef3ae080400b4f7cb61c45b3fe310da5ab5ca251a5" exitCode=0
Jul 27 17:26:15.190717 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:15.190346    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk" event={"ID":"acf1cc92-b8f8-4958-82db-b165b24edf0c","Type":"ContainerDied","Data":"23d823c430ca21167a660bef3ae080400b4f7cb61c45b3fe310da5ab5ca251a5"}
Jul 27 17:26:16.197553 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:16.197519    2579 generic.go:356] "Generic (PLEG): container finished" podID="acf1cc92-b8f8-4958-82db-b165b24edf0c" containerID="9dad6867eef0f62f79f99319e8ae6b7950b9f0bed5710f5b0b41e389091e045e" exitCode=0
Jul 27 17:26:16.198004 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:16.197599    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk" event={"ID":"acf1cc92-b8f8-4958-82db-b165b24edf0c","Type":"ContainerDied","Data":"9dad6867eef0f62f79f99319e8ae6b7950b9f0bed5710f5b0b41e389091e045e"}
Jul 27 17:26:17.324039 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:17.324014    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk"
Jul 27 17:26:17.334943 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:17.334907    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acf1cc92-b8f8-4958-82db-b165b24edf0c-bundle\") pod \"acf1cc92-b8f8-4958-82db-b165b24edf0c\" (UID: \"acf1cc92-b8f8-4958-82db-b165b24edf0c\") "
Jul 27 17:26:17.335071 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:17.334957    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acf1cc92-b8f8-4958-82db-b165b24edf0c-util\") pod \"acf1cc92-b8f8-4958-82db-b165b24edf0c\" (UID: \"acf1cc92-b8f8-4958-82db-b165b24edf0c\") "
Jul 27 17:26:17.335071 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:17.335023    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdjxk\" (UniqueName: \"kubernetes.io/projected/acf1cc92-b8f8-4958-82db-b165b24edf0c-kube-api-access-jdjxk\") pod \"acf1cc92-b8f8-4958-82db-b165b24edf0c\" (UID: \"acf1cc92-b8f8-4958-82db-b165b24edf0c\") "
Jul 27 17:26:17.335633 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:17.335609    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acf1cc92-b8f8-4958-82db-b165b24edf0c-bundle" (OuterVolumeSpecName: "bundle") pod "acf1cc92-b8f8-4958-82db-b165b24edf0c" (UID: "acf1cc92-b8f8-4958-82db-b165b24edf0c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:26:17.337205 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:17.337176    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acf1cc92-b8f8-4958-82db-b165b24edf0c-kube-api-access-jdjxk" (OuterVolumeSpecName: "kube-api-access-jdjxk") pod "acf1cc92-b8f8-4958-82db-b165b24edf0c" (UID: "acf1cc92-b8f8-4958-82db-b165b24edf0c"). InnerVolumeSpecName "kube-api-access-jdjxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:26:17.340448 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:17.340428    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acf1cc92-b8f8-4958-82db-b165b24edf0c-util" (OuterVolumeSpecName: "util") pod "acf1cc92-b8f8-4958-82db-b165b24edf0c" (UID: "acf1cc92-b8f8-4958-82db-b165b24edf0c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:26:17.435867 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:17.435833    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdjxk\" (UniqueName: \"kubernetes.io/projected/acf1cc92-b8f8-4958-82db-b165b24edf0c-kube-api-access-jdjxk\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:26:17.435867 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:17.435861    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acf1cc92-b8f8-4958-82db-b165b24edf0c-bundle\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:26:17.435867 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:17.435872    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acf1cc92-b8f8-4958-82db-b165b24edf0c-util\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:26:18.207221 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:18.207193    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk"
Jul 27 17:26:18.207432 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:18.207194    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afghwnk" event={"ID":"acf1cc92-b8f8-4958-82db-b165b24edf0c","Type":"ContainerDied","Data":"92ce090bc852caa19723b7842194f6120275e89b214a475cef5fd29358fdc7e2"}
Jul 27 17:26:18.207432 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:18.207317    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92ce090bc852caa19723b7842194f6120275e89b214a475cef5fd29358fdc7e2"
Jul 27 17:26:24.788067 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.788034    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"]
Jul 27 17:26:24.788445 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.788265    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acf1cc92-b8f8-4958-82db-b165b24edf0c" containerName="util"
Jul 27 17:26:24.788445 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.788275    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="acf1cc92-b8f8-4958-82db-b165b24edf0c" containerName="util"
Jul 27 17:26:24.788445 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.788284    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acf1cc92-b8f8-4958-82db-b165b24edf0c" containerName="pull"
Jul 27 17:26:24.788445 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.788289    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="acf1cc92-b8f8-4958-82db-b165b24edf0c" containerName="pull"
Jul 27 17:26:24.788445 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.788308    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acf1cc92-b8f8-4958-82db-b165b24edf0c" containerName="extract"
Jul 27 17:26:24.788445 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.788313    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="acf1cc92-b8f8-4958-82db-b165b24edf0c" containerName="extract"
Jul 27 17:26:24.788445 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.788351    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="acf1cc92-b8f8-4958-82db-b165b24edf0c" containerName="extract"
Jul 27 17:26:24.793803 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.793786    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:24.796616 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.796597    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 17:26:24.796714 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.796613    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 17:26:24.801465 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.801444    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nqddh\""
Jul 27 17:26:24.801550 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.801450    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 17:26:24.803179 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.803166    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 17:26:24.812320 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.812299    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"]
Jul 27 17:26:24.885335 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.885296    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1bf5a911-8a7c-499a-842e-d2337f71e4db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-746b8d4d47-8hg7l\" (UID: \"1bf5a911-8a7c-499a-842e-d2337f71e4db\") " pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:24.885335 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.885335    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bf5a911-8a7c-499a-842e-d2337f71e4db-webhook-cert\") pod \"opendatahub-operator-controller-manager-746b8d4d47-8hg7l\" (UID: \"1bf5a911-8a7c-499a-842e-d2337f71e4db\") " pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:24.885567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.885389    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bf5a911-8a7c-499a-842e-d2337f71e4db-tmp\") pod \"opendatahub-operator-controller-manager-746b8d4d47-8hg7l\" (UID: \"1bf5a911-8a7c-499a-842e-d2337f71e4db\") " pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:24.885567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.885453    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1bf5a911-8a7c-499a-842e-d2337f71e4db-manifests\") pod \"opendatahub-operator-controller-manager-746b8d4d47-8hg7l\" (UID: \"1bf5a911-8a7c-499a-842e-d2337f71e4db\") " pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:24.885567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.885474    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgbn8\" (UniqueName: \"kubernetes.io/projected/1bf5a911-8a7c-499a-842e-d2337f71e4db-kube-api-access-fgbn8\") pod \"opendatahub-operator-controller-manager-746b8d4d47-8hg7l\" (UID: \"1bf5a911-8a7c-499a-842e-d2337f71e4db\") " pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:24.986037 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.985993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bf5a911-8a7c-499a-842e-d2337f71e4db-tmp\") pod \"opendatahub-operator-controller-manager-746b8d4d47-8hg7l\" (UID: \"1bf5a911-8a7c-499a-842e-d2337f71e4db\") " pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:24.986037 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.986034    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1bf5a911-8a7c-499a-842e-d2337f71e4db-manifests\") pod \"opendatahub-operator-controller-manager-746b8d4d47-8hg7l\" (UID: \"1bf5a911-8a7c-499a-842e-d2337f71e4db\") " pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:24.986312 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.986058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgbn8\" (UniqueName: \"kubernetes.io/projected/1bf5a911-8a7c-499a-842e-d2337f71e4db-kube-api-access-fgbn8\") pod \"opendatahub-operator-controller-manager-746b8d4d47-8hg7l\" (UID: \"1bf5a911-8a7c-499a-842e-d2337f71e4db\") " pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:24.986312 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.986089    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1bf5a911-8a7c-499a-842e-d2337f71e4db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-746b8d4d47-8hg7l\" (UID: \"1bf5a911-8a7c-499a-842e-d2337f71e4db\") " pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:24.986312 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.986107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bf5a911-8a7c-499a-842e-d2337f71e4db-webhook-cert\") pod \"opendatahub-operator-controller-manager-746b8d4d47-8hg7l\" (UID: \"1bf5a911-8a7c-499a-842e-d2337f71e4db\") " pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:24.986592 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.986541    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1bf5a911-8a7c-499a-842e-d2337f71e4db-manifests\") pod \"opendatahub-operator-controller-manager-746b8d4d47-8hg7l\" (UID: \"1bf5a911-8a7c-499a-842e-d2337f71e4db\") " pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:24.988521 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.988488    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bf5a911-8a7c-499a-842e-d2337f71e4db-tmp\") pod \"opendatahub-operator-controller-manager-746b8d4d47-8hg7l\" (UID: \"1bf5a911-8a7c-499a-842e-d2337f71e4db\") " pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:24.988747 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.988728    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1bf5a911-8a7c-499a-842e-d2337f71e4db-apiservice-cert\") pod \"opendatahub-operator-controller-manager-746b8d4d47-8hg7l\" (UID: \"1bf5a911-8a7c-499a-842e-d2337f71e4db\") " pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:24.988888 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.988872    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bf5a911-8a7c-499a-842e-d2337f71e4db-webhook-cert\") pod \"opendatahub-operator-controller-manager-746b8d4d47-8hg7l\" (UID: \"1bf5a911-8a7c-499a-842e-d2337f71e4db\") " pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:24.996226 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:24.996206    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgbn8\" (UniqueName: \"kubernetes.io/projected/1bf5a911-8a7c-499a-842e-d2337f71e4db-kube-api-access-fgbn8\") pod \"opendatahub-operator-controller-manager-746b8d4d47-8hg7l\" (UID: \"1bf5a911-8a7c-499a-842e-d2337f71e4db\") " pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:25.103597 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:25.103513    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:25.240891 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:25.240868    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"]
Jul 27 17:26:25.243457 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:26:25.243408    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bf5a911_8a7c_499a_842e_d2337f71e4db.slice/crio-c037e13e05398985b99313d7f36af3f7e75888c6c7ec9596fd8db8d73b43ecf4 WatchSource:0}: Error finding container c037e13e05398985b99313d7f36af3f7e75888c6c7ec9596fd8db8d73b43ecf4: Status 404 returned error can't find the container with id c037e13e05398985b99313d7f36af3f7e75888c6c7ec9596fd8db8d73b43ecf4
Jul 27 17:26:26.240702 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:26.240667    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l" event={"ID":"1bf5a911-8a7c-499a-842e-d2337f71e4db","Type":"ContainerStarted","Data":"c037e13e05398985b99313d7f36af3f7e75888c6c7ec9596fd8db8d73b43ecf4"}
Jul 27 17:26:29.255958 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:29.255925    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l" event={"ID":"1bf5a911-8a7c-499a-842e-d2337f71e4db","Type":"ContainerStarted","Data":"d94ccd5a98e206f5d32cb467c41caea12b0d58ab8763e4565ab742bb337b7fc4"}
Jul 27 17:26:30.261583 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:30.261544    2579 generic.go:356] "Generic (PLEG): container finished" podID="1bf5a911-8a7c-499a-842e-d2337f71e4db" containerID="d94ccd5a98e206f5d32cb467c41caea12b0d58ab8763e4565ab742bb337b7fc4" exitCode=0
Jul 27 17:26:30.262049 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:30.261591    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l" event={"ID":"1bf5a911-8a7c-499a-842e-d2337f71e4db","Type":"ContainerDied","Data":"d94ccd5a98e206f5d32cb467c41caea12b0d58ab8763e4565ab742bb337b7fc4"}
Jul 27 17:26:31.268812 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:31.268725    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l" event={"ID":"1bf5a911-8a7c-499a-842e-d2337f71e4db","Type":"ContainerStarted","Data":"5c96351f8c6928613331dea1bf74740d4c6fe696a36046c0e2516b394a5f17a8"}
Jul 27 17:26:31.269199 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:31.268852    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:31.290093 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:31.290047    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l" podStartSLOduration=2.264096347 podStartE2EDuration="7.290026721s" totalImagesPullingTime="4.017567455s" totalInitContainerRuntime="1.008362919s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:26:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:26:31.289222292 +0000 UTC m=+334.820973292" watchObservedRunningTime="2026-07-27 17:26:31.290026721 +0000 UTC m=+334.821777763"
Jul 27 17:26:42.274296 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:42.274253    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-746b8d4d47-8hg7l"
Jul 27 17:26:44.563107 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.563067    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b8c977c58-tbqpt"]
Jul 27 17:26:44.571556 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.571535    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b8c977c58-tbqpt"
Jul 27 17:26:44.574175 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.574152    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 17:26:44.574978 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.574957    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 17:26:44.575081 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.574978    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cpv97\""
Jul 27 17:26:44.575081 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.574999    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 17:26:44.575081 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.574978    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 17:26:44.605002 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.604973    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b8c977c58-tbqpt"]
Jul 27 17:26:44.625694 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.625668    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8pn5\" (UniqueName: \"kubernetes.io/projected/50f93429-99c0-4a7e-8275-02fb03791380-kube-api-access-w8pn5\") pod \"kube-auth-proxy-5b8c977c58-tbqpt\" (UID: \"50f93429-99c0-4a7e-8275-02fb03791380\") " pod="openshift-ingress/kube-auth-proxy-5b8c977c58-tbqpt"
Jul 27 17:26:44.625835 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.625706    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50f93429-99c0-4a7e-8275-02fb03791380-tls-certs\") pod \"kube-auth-proxy-5b8c977c58-tbqpt\" (UID: \"50f93429-99c0-4a7e-8275-02fb03791380\") " pod="openshift-ingress/kube-auth-proxy-5b8c977c58-tbqpt"
Jul 27 17:26:44.625835 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.625736    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50f93429-99c0-4a7e-8275-02fb03791380-tmp\") pod \"kube-auth-proxy-5b8c977c58-tbqpt\" (UID: \"50f93429-99c0-4a7e-8275-02fb03791380\") " pod="openshift-ingress/kube-auth-proxy-5b8c977c58-tbqpt"
Jul 27 17:26:44.726906 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.726870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50f93429-99c0-4a7e-8275-02fb03791380-tls-certs\") pod \"kube-auth-proxy-5b8c977c58-tbqpt\" (UID: \"50f93429-99c0-4a7e-8275-02fb03791380\") " pod="openshift-ingress/kube-auth-proxy-5b8c977c58-tbqpt"
Jul 27 17:26:44.726906 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.726911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50f93429-99c0-4a7e-8275-02fb03791380-tmp\") pod \"kube-auth-proxy-5b8c977c58-tbqpt\" (UID: \"50f93429-99c0-4a7e-8275-02fb03791380\") " pod="openshift-ingress/kube-auth-proxy-5b8c977c58-tbqpt"
Jul 27 17:26:44.727133 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.726941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8pn5\" (UniqueName: \"kubernetes.io/projected/50f93429-99c0-4a7e-8275-02fb03791380-kube-api-access-w8pn5\") pod \"kube-auth-proxy-5b8c977c58-tbqpt\" (UID: \"50f93429-99c0-4a7e-8275-02fb03791380\") " pod="openshift-ingress/kube-auth-proxy-5b8c977c58-tbqpt"
Jul 27 17:26:44.729380 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.729354    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50f93429-99c0-4a7e-8275-02fb03791380-tmp\") pod \"kube-auth-proxy-5b8c977c58-tbqpt\" (UID: \"50f93429-99c0-4a7e-8275-02fb03791380\") " pod="openshift-ingress/kube-auth-proxy-5b8c977c58-tbqpt"
Jul 27 17:26:44.729512 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.729436    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50f93429-99c0-4a7e-8275-02fb03791380-tls-certs\") pod \"kube-auth-proxy-5b8c977c58-tbqpt\" (UID: \"50f93429-99c0-4a7e-8275-02fb03791380\") " pod="openshift-ingress/kube-auth-proxy-5b8c977c58-tbqpt"
Jul 27 17:26:44.743954 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.743932    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8pn5\" (UniqueName: \"kubernetes.io/projected/50f93429-99c0-4a7e-8275-02fb03791380-kube-api-access-w8pn5\") pod \"kube-auth-proxy-5b8c977c58-tbqpt\" (UID: \"50f93429-99c0-4a7e-8275-02fb03791380\") " pod="openshift-ingress/kube-auth-proxy-5b8c977c58-tbqpt"
Jul 27 17:26:44.881785 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:44.881705    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b8c977c58-tbqpt"
Jul 27 17:26:45.030893 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:45.030859    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b8c977c58-tbqpt"]
Jul 27 17:26:45.036139 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:26:45.036113    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50f93429_99c0_4a7e_8275_02fb03791380.slice/crio-b2253cbc4ce4b59d94d2f45b586997989c7ad1a72e175b403a97f15ff8603985 WatchSource:0}: Error finding container b2253cbc4ce4b59d94d2f45b586997989c7ad1a72e175b403a97f15ff8603985: Status 404 returned error can't find the container with id b2253cbc4ce4b59d94d2f45b586997989c7ad1a72e175b403a97f15ff8603985
Jul 27 17:26:45.328606 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:45.328558    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b8c977c58-tbqpt" event={"ID":"50f93429-99c0-4a7e-8275-02fb03791380","Type":"ContainerStarted","Data":"b2253cbc4ce4b59d94d2f45b586997989c7ad1a72e175b403a97f15ff8603985"}
Jul 27 17:26:46.049217 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.049184    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"]
Jul 27 17:26:46.052491 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.052467    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.054665 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.054643    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 17:26:46.054770 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.054649    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 17:26:46.054770 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.054690    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 17:26:46.054770 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.054715    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 17:26:46.054770 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.054733    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-v6bwz\""
Jul 27 17:26:46.083538 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.083511    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"]
Jul 27 17:26:46.138984 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.138948    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8sxp\" (UniqueName: \"kubernetes.io/projected/dd09ca57-decb-4305-ac68-3805409b7133-kube-api-access-w8sxp\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.139150 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.138996    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dd09ca57-decb-4305-ac68-3805409b7133-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.139150 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.139022    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.139150 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.139057    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd09ca57-decb-4305-ac68-3805409b7133-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.139150 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.139099    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd09ca57-decb-4305-ac68-3805409b7133-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.139335 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.139171    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.139335 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.139235    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.240083 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.240050    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.240244 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.240104    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8sxp\" (UniqueName: \"kubernetes.io/projected/dd09ca57-decb-4305-ac68-3805409b7133-kube-api-access-w8sxp\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.240285 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.240246    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dd09ca57-decb-4305-ac68-3805409b7133-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.240285 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.240279    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.240346 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.240308    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd09ca57-decb-4305-ac68-3805409b7133-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.240379 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.240348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd09ca57-decb-4305-ac68-3805409b7133-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.240379 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.240374    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.240877 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.240847    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dd09ca57-decb-4305-ac68-3805409b7133-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.242618 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.242589    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.242618 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.242607    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd09ca57-decb-4305-ac68-3805409b7133-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.242790 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.242742    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.242790 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.242776    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.248321 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.248300    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd09ca57-decb-4305-ac68-3805409b7133-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.248644 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.248625    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8sxp\" (UniqueName: \"kubernetes.io/projected/dd09ca57-decb-4305-ac68-3805409b7133-kube-api-access-w8sxp\") pod \"istiod-openshift-gateway-7b7995d5cd-7st22\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.361908 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.361823    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:46.521527 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:46.521491    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"]
Jul 27 17:26:46.525653 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:26:46.525628    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd09ca57_decb_4305_ac68_3805409b7133.slice/crio-676c69a427a08854dd3c8227c10c2060c0641ec6eb65a35510830aa9659959fc WatchSource:0}: Error finding container 676c69a427a08854dd3c8227c10c2060c0641ec6eb65a35510830aa9659959fc: Status 404 returned error can't find the container with id 676c69a427a08854dd3c8227c10c2060c0641ec6eb65a35510830aa9659959fc
Jul 27 17:26:47.338594 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:47.338469    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22" event={"ID":"dd09ca57-decb-4305-ac68-3805409b7133","Type":"ContainerStarted","Data":"676c69a427a08854dd3c8227c10c2060c0641ec6eb65a35510830aa9659959fc"}
Jul 27 17:26:48.346698 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:48.346656    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b8c977c58-tbqpt" event={"ID":"50f93429-99c0-4a7e-8275-02fb03791380","Type":"ContainerStarted","Data":"6a989317d0a3e025f8bab5465eae5c258ee78408c23aab3c5f58ec8a7fbf670d"}
Jul 27 17:26:48.390271 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:48.390212    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b8c977c58-tbqpt" podStartSLOduration=1.412798251 podStartE2EDuration="4.390192482s" totalImagesPullingTime="2.977394231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:26:48.38820408 +0000 UTC m=+351.919955066" watchObservedRunningTime="2026-07-27 17:26:48.390192482 +0000 UTC m=+351.921943467"
Jul 27 17:26:49.291793 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:49.291758    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:26:49.291891 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:49.291826    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:26:50.359982 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.359923    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22" event={"ID":"dd09ca57-decb-4305-ac68-3805409b7133","Type":"ContainerStarted","Data":"8de6a6f53d44ad785244ff4053baf4ce1b096b7a2bbf3cbfc0be32aa3ba05494"}
Jul 27 17:26:50.360595 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.360158    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:50.361995 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.361968    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-7st22 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 17:26:50.362148 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.362018    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22" podUID="dd09ca57-decb-4305-ac68-3805409b7133" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 17:26:50.384210 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.384135    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22" podStartSLOduration=1.62016807 podStartE2EDuration="4.3841197s" totalImagesPullingTime="2.76395163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:26:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:26:50.382781763 +0000 UTC m=+353.914532750" watchObservedRunningTime="2026-07-27 17:26:50.3841197 +0000 UTC m=+353.915870686"
Jul 27 17:26:50.579521 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.579492    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"]
Jul 27 17:26:50.582712 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.582692    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.585980 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.585951    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-d6vx5\""
Jul 27 17:26:50.597747 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.597718    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"]
Jul 27 17:26:50.675883 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.675799    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7dg8\" (UniqueName: \"kubernetes.io/projected/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-kube-api-access-x7dg8\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.675883 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.675838    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.675883 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.675861    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.676087 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.675919    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.676087 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.675945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.676087 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.675972    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.676087 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.676006    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.676087 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.676044    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.676236 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.676088    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.777177 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.777140    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.777177 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.777176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.777441 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.777211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.777441 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.777238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.777441 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.777268    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7dg8\" (UniqueName: \"kubernetes.io/projected/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-kube-api-access-x7dg8\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.777441 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.777307    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.777441 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.777336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.777441 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.777362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.777441 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.777387    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.777787 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.777651    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.777787 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.777725    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.777787 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.777766    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.777985 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.777880    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.778492 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.778466    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.779734 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.779716    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.780105 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.780088    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.786204 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.786180    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7dg8\" (UniqueName: \"kubernetes.io/projected/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-kube-api-access-x7dg8\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.786299 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.786246    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:50.893914 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:50.893876    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:51.025708 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:51.025683    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"]
Jul 27 17:26:51.028061 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:26:51.028036    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b66b23_9898_4c0e_b85c_d43ffaf185c4.slice/crio-e0a2d2b61ef2739d26e1336cb300b0ca285b863c4fd335c92672282e5b26bd5b WatchSource:0}: Error finding container e0a2d2b61ef2739d26e1336cb300b0ca285b863c4fd335c92672282e5b26bd5b: Status 404 returned error can't find the container with id e0a2d2b61ef2739d26e1336cb300b0ca285b863c4fd335c92672282e5b26bd5b
Jul 27 17:26:51.364950 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:51.364916    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6" event={"ID":"f5b66b23-9898-4c0e-b85c-d43ffaf185c4","Type":"ContainerStarted","Data":"e0a2d2b61ef2739d26e1336cb300b0ca285b863c4fd335c92672282e5b26bd5b"}
Jul 27 17:26:51.365725 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:51.365706    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:53.967539 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:53.967505    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:26:53.967800 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:53.967577    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:26:53.967800 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:53.967604    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:26:54.379653 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:54.379611    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6" event={"ID":"f5b66b23-9898-4c0e-b85c-d43ffaf185c4","Type":"ContainerStarted","Data":"5501b24f07455a319e99f9a0bd340113e83e4e8f54312bf9aa11f89ee09fa2ca"}
Jul 27 17:26:54.425804 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:54.425754    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6" podStartSLOduration=1.488658496 podStartE2EDuration="4.425739036s" totalImagesPullingTime="2.93708054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:26:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:26:54.42404928 +0000 UTC m=+357.955800279" watchObservedRunningTime="2026-07-27 17:26:54.425739036 +0000 UTC m=+357.957490050"
Jul 27 17:26:54.894097 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:54.894066    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:26:55.630115 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:55.630082    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"]
Jul 27 17:26:55.896223 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:55.896130    2579 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body=
Jul 27 17:26:55.896223 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:55.896184    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6" podUID="f5b66b23-9898-4c0e-b85c-d43ffaf185c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused"
Jul 27 17:26:56.894451 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:56.894403    2579 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body=
Jul 27 17:26:56.894871 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:56.894478    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6" podUID="f5b66b23-9898-4c0e-b85c-d43ffaf185c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused"
Jul 27 17:26:57.079662 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.079631    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2j29q"]
Jul 27 17:26:57.084408 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.084386    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zvcb4"]
Jul 27 17:26:57.084566 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.084510    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2j29q"
Jul 27 17:26:57.087405 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.087383    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zvcb4"
Jul 27 17:26:57.088393 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.088376    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-lhsnr\""
Jul 27 17:26:57.088650 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.088631    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 27 17:26:57.089276 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.089262    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 27 17:26:57.089558 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.089540    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-9d6pg\""
Jul 27 17:26:57.097727 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.097709    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zvcb4"]
Jul 27 17:26:57.101066 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.101047    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2j29q"]
Jul 27 17:26:57.136454 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.136413    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-255nx\" (UniqueName: \"kubernetes.io/projected/da395a06-4adf-4dd2-b530-b74993ed4dc2-kube-api-access-255nx\") pod \"llmisvc-controller-manager-777c6bd7d5-zvcb4\" (UID: \"da395a06-4adf-4dd2-b530-b74993ed4dc2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zvcb4"
Jul 27 17:26:57.136607 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.136489    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da395a06-4adf-4dd2-b530-b74993ed4dc2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zvcb4\" (UID: \"da395a06-4adf-4dd2-b530-b74993ed4dc2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zvcb4"
Jul 27 17:26:57.136607 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.136519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abb3884-5803-4323-838e-5c2043df8a1e-cert\") pod \"kserve-controller-manager-d6f4b65b8-2j29q\" (UID: \"5abb3884-5803-4323-838e-5c2043df8a1e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2j29q"
Jul 27 17:26:57.136607 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.136568    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrt2z\" (UniqueName: \"kubernetes.io/projected/5abb3884-5803-4323-838e-5c2043df8a1e-kube-api-access-vrt2z\") pod \"kserve-controller-manager-d6f4b65b8-2j29q\" (UID: \"5abb3884-5803-4323-838e-5c2043df8a1e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2j29q"
Jul 27 17:26:57.237298 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.237221    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-255nx\" (UniqueName: \"kubernetes.io/projected/da395a06-4adf-4dd2-b530-b74993ed4dc2-kube-api-access-255nx\") pod \"llmisvc-controller-manager-777c6bd7d5-zvcb4\" (UID: \"da395a06-4adf-4dd2-b530-b74993ed4dc2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zvcb4"
Jul 27 17:26:57.237298 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.237265    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da395a06-4adf-4dd2-b530-b74993ed4dc2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zvcb4\" (UID: \"da395a06-4adf-4dd2-b530-b74993ed4dc2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zvcb4"
Jul 27 17:26:57.237298 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.237281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abb3884-5803-4323-838e-5c2043df8a1e-cert\") pod \"kserve-controller-manager-d6f4b65b8-2j29q\" (UID: \"5abb3884-5803-4323-838e-5c2043df8a1e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2j29q"
Jul 27 17:26:57.237564 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.237329    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrt2z\" (UniqueName: \"kubernetes.io/projected/5abb3884-5803-4323-838e-5c2043df8a1e-kube-api-access-vrt2z\") pod \"kserve-controller-manager-d6f4b65b8-2j29q\" (UID: \"5abb3884-5803-4323-838e-5c2043df8a1e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2j29q"
Jul 27 17:26:57.237564 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:26:57.237492    2579 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 27 17:26:57.237635 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:26:57.237572    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abb3884-5803-4323-838e-5c2043df8a1e-cert podName:5abb3884-5803-4323-838e-5c2043df8a1e nodeName:}" failed. No retries permitted until 2026-07-27 17:26:57.737542755 +0000 UTC m=+361.269293725 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5abb3884-5803-4323-838e-5c2043df8a1e-cert") pod "kserve-controller-manager-d6f4b65b8-2j29q" (UID: "5abb3884-5803-4323-838e-5c2043df8a1e") : secret "kserve-webhook-server-cert" not found
Jul 27 17:26:57.239797 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.239776    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da395a06-4adf-4dd2-b530-b74993ed4dc2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zvcb4\" (UID: \"da395a06-4adf-4dd2-b530-b74993ed4dc2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zvcb4"
Jul 27 17:26:57.248821 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.248797    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrt2z\" (UniqueName: \"kubernetes.io/projected/5abb3884-5803-4323-838e-5c2043df8a1e-kube-api-access-vrt2z\") pod \"kserve-controller-manager-d6f4b65b8-2j29q\" (UID: \"5abb3884-5803-4323-838e-5c2043df8a1e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2j29q"
Jul 27 17:26:57.249435 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.249399    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-255nx\" (UniqueName: \"kubernetes.io/projected/da395a06-4adf-4dd2-b530-b74993ed4dc2-kube-api-access-255nx\") pod \"llmisvc-controller-manager-777c6bd7d5-zvcb4\" (UID: \"da395a06-4adf-4dd2-b530-b74993ed4dc2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zvcb4"
Jul 27 17:26:57.392863 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.392799    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6" podUID="f5b66b23-9898-4c0e-b85c-d43ffaf185c4" containerName="istio-proxy" containerID="cri-o://5501b24f07455a319e99f9a0bd340113e83e4e8f54312bf9aa11f89ee09fa2ca" gracePeriod=30
Jul 27 17:26:57.403763 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.403733    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zvcb4"
Jul 27 17:26:57.566647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.566622    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zvcb4"]
Jul 27 17:26:57.568348 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:26:57.568321    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podda395a06_4adf_4dd2_b530_b74993ed4dc2.slice/crio-b4c268d118c8c7fc3ba8d1331cec56cb115a8e1dff6120afe85cf485b1b2efa8 WatchSource:0}: Error finding container b4c268d118c8c7fc3ba8d1331cec56cb115a8e1dff6120afe85cf485b1b2efa8: Status 404 returned error can't find the container with id b4c268d118c8c7fc3ba8d1331cec56cb115a8e1dff6120afe85cf485b1b2efa8
Jul 27 17:26:57.742096 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:57.742052    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abb3884-5803-4323-838e-5c2043df8a1e-cert\") pod \"kserve-controller-manager-d6f4b65b8-2j29q\" (UID: \"5abb3884-5803-4323-838e-5c2043df8a1e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2j29q"
Jul 27 17:26:57.742298 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:26:57.742187    2579 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 27 17:26:57.742298 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:26:57.742270    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5abb3884-5803-4323-838e-5c2043df8a1e-cert podName:5abb3884-5803-4323-838e-5c2043df8a1e nodeName:}" failed. No retries permitted until 2026-07-27 17:26:58.742239894 +0000 UTC m=+362.273990871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5abb3884-5803-4323-838e-5c2043df8a1e-cert") pod "kserve-controller-manager-d6f4b65b8-2j29q" (UID: "5abb3884-5803-4323-838e-5c2043df8a1e") : secret "kserve-webhook-server-cert" not found
Jul 27 17:26:58.397960 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:58.397930    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zvcb4" event={"ID":"da395a06-4adf-4dd2-b530-b74993ed4dc2","Type":"ContainerStarted","Data":"b4c268d118c8c7fc3ba8d1331cec56cb115a8e1dff6120afe85cf485b1b2efa8"}
Jul 27 17:26:58.752808 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:58.752717    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abb3884-5803-4323-838e-5c2043df8a1e-cert\") pod \"kserve-controller-manager-d6f4b65b8-2j29q\" (UID: \"5abb3884-5803-4323-838e-5c2043df8a1e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2j29q"
Jul 27 17:26:58.755234 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:58.755206    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5abb3884-5803-4323-838e-5c2043df8a1e-cert\") pod \"kserve-controller-manager-d6f4b65b8-2j29q\" (UID: \"5abb3884-5803-4323-838e-5c2043df8a1e\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-2j29q"
Jul 27 17:26:58.897547 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:58.897505    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2j29q"
Jul 27 17:26:59.171399 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.171243    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-2j29q"]
Jul 27 17:26:59.173325 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:26:59.173298    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5abb3884_5803_4323_838e_5c2043df8a1e.slice/crio-8183c56e8c20f47a869e4948d679e674a7b262ef2e7ffc43c76c5a830fc1bc03 WatchSource:0}: Error finding container 8183c56e8c20f47a869e4948d679e674a7b262ef2e7ffc43c76c5a830fc1bc03: Status 404 returned error can't find the container with id 8183c56e8c20f47a869e4948d679e674a7b262ef2e7ffc43c76c5a830fc1bc03
Jul 27 17:26:59.404885 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.404845    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2j29q" event={"ID":"5abb3884-5803-4323-838e-5c2043df8a1e","Type":"ContainerStarted","Data":"8183c56e8c20f47a869e4948d679e674a7b262ef2e7ffc43c76c5a830fc1bc03"}
Jul 27 17:26:59.627370 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.627336    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"]
Jul 27 17:26:59.627641 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.627558    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22" podUID="dd09ca57-decb-4305-ac68-3805409b7133" containerName="discovery" containerID="cri-o://8de6a6f53d44ad785244ff4053baf4ce1b096b7a2bbf3cbfc0be32aa3ba05494" gracePeriod=30
Jul 27 17:26:59.880499 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.880476    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:26:59.964153 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.964072    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd09ca57-decb-4305-ac68-3805409b7133-local-certs\") pod \"dd09ca57-decb-4305-ac68-3805409b7133\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") "
Jul 27 17:26:59.964153 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.964117    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-istio-csr-dns-cert\") pod \"dd09ca57-decb-4305-ac68-3805409b7133\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") "
Jul 27 17:26:59.964373 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.964172    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dd09ca57-decb-4305-ac68-3805409b7133-istio-csr-ca-configmap\") pod \"dd09ca57-decb-4305-ac68-3805409b7133\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") "
Jul 27 17:26:59.964373 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.964199    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-istio-kubeconfig\") pod \"dd09ca57-decb-4305-ac68-3805409b7133\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") "
Jul 27 17:26:59.964373 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.964247    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd09ca57-decb-4305-ac68-3805409b7133-istio-token\") pod \"dd09ca57-decb-4305-ac68-3805409b7133\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") "
Jul 27 17:26:59.964373 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.964288    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8sxp\" (UniqueName: \"kubernetes.io/projected/dd09ca57-decb-4305-ac68-3805409b7133-kube-api-access-w8sxp\") pod \"dd09ca57-decb-4305-ac68-3805409b7133\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") "
Jul 27 17:26:59.964373 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.964331    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-cacerts\") pod \"dd09ca57-decb-4305-ac68-3805409b7133\" (UID: \"dd09ca57-decb-4305-ac68-3805409b7133\") "
Jul 27 17:26:59.964638 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.964594    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd09ca57-decb-4305-ac68-3805409b7133-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "dd09ca57-decb-4305-ac68-3805409b7133" (UID: "dd09ca57-decb-4305-ac68-3805409b7133"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:26:59.966913 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.966863    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd09ca57-decb-4305-ac68-3805409b7133-local-certs" (OuterVolumeSpecName: "local-certs") pod "dd09ca57-decb-4305-ac68-3805409b7133" (UID: "dd09ca57-decb-4305-ac68-3805409b7133"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:26:59.967567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.967472    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd09ca57-decb-4305-ac68-3805409b7133-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd09ca57-decb-4305-ac68-3805409b7133" (UID: "dd09ca57-decb-4305-ac68-3805409b7133"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:26:59.967567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.967543    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "dd09ca57-decb-4305-ac68-3805409b7133" (UID: "dd09ca57-decb-4305-ac68-3805409b7133"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:26:59.967827 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.967789    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd09ca57-decb-4305-ac68-3805409b7133-kube-api-access-w8sxp" (OuterVolumeSpecName: "kube-api-access-w8sxp") pod "dd09ca57-decb-4305-ac68-3805409b7133" (UID: "dd09ca57-decb-4305-ac68-3805409b7133"). InnerVolumeSpecName "kube-api-access-w8sxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:26:59.968489 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.968463    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "dd09ca57-decb-4305-ac68-3805409b7133" (UID: "dd09ca57-decb-4305-ac68-3805409b7133"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:26:59.969600 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:26:59.969577    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-cacerts" (OuterVolumeSpecName: "cacerts") pod "dd09ca57-decb-4305-ac68-3805409b7133" (UID: "dd09ca57-decb-4305-ac68-3805409b7133"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:27:00.065374 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:00.065333    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dd09ca57-decb-4305-ac68-3805409b7133-istio-csr-ca-configmap\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:27:00.065374 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:00.065375    2579 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-istio-kubeconfig\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:27:00.065661 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:00.065390    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd09ca57-decb-4305-ac68-3805409b7133-istio-token\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:27:00.065661 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:00.065401    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8sxp\" (UniqueName: \"kubernetes.io/projected/dd09ca57-decb-4305-ac68-3805409b7133-kube-api-access-w8sxp\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:27:00.065661 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:00.065409    2579 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-cacerts\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:27:00.065661 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:00.065431    2579 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd09ca57-decb-4305-ac68-3805409b7133-local-certs\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:27:00.065661 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:00.065443    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dd09ca57-decb-4305-ac68-3805409b7133-istio-csr-dns-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:27:00.412330 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:00.412279    2579 generic.go:356] "Generic (PLEG): container finished" podID="dd09ca57-decb-4305-ac68-3805409b7133" containerID="8de6a6f53d44ad785244ff4053baf4ce1b096b7a2bbf3cbfc0be32aa3ba05494" exitCode=0
Jul 27 17:27:00.412330 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:00.412328    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22" event={"ID":"dd09ca57-decb-4305-ac68-3805409b7133","Type":"ContainerDied","Data":"8de6a6f53d44ad785244ff4053baf4ce1b096b7a2bbf3cbfc0be32aa3ba05494"}
Jul 27 17:27:00.412845 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:00.412362    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"
Jul 27 17:27:00.412845 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:00.412373    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22" event={"ID":"dd09ca57-decb-4305-ac68-3805409b7133","Type":"ContainerDied","Data":"676c69a427a08854dd3c8227c10c2060c0641ec6eb65a35510830aa9659959fc"}
Jul 27 17:27:00.412845 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:00.412399    2579 scope.go:117] "RemoveContainer" containerID="8de6a6f53d44ad785244ff4053baf4ce1b096b7a2bbf3cbfc0be32aa3ba05494"
Jul 27 17:27:00.455088 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:00.455050    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"]
Jul 27 17:27:00.459059 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:00.459001    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7st22"]
Jul 27 17:27:00.603541 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:00.603511    2579 scope.go:117] "RemoveContainer" containerID="8de6a6f53d44ad785244ff4053baf4ce1b096b7a2bbf3cbfc0be32aa3ba05494"
Jul 27 17:27:00.603904 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:27:00.603878    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8de6a6f53d44ad785244ff4053baf4ce1b096b7a2bbf3cbfc0be32aa3ba05494\": container with ID starting with 8de6a6f53d44ad785244ff4053baf4ce1b096b7a2bbf3cbfc0be32aa3ba05494 not found: ID does not exist" containerID="8de6a6f53d44ad785244ff4053baf4ce1b096b7a2bbf3cbfc0be32aa3ba05494"
Jul 27 17:27:00.604029 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:00.603913    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de6a6f53d44ad785244ff4053baf4ce1b096b7a2bbf3cbfc0be32aa3ba05494"} err="failed to get container status \"8de6a6f53d44ad785244ff4053baf4ce1b096b7a2bbf3cbfc0be32aa3ba05494\": rpc error: code = NotFound desc = could not find container \"8de6a6f53d44ad785244ff4053baf4ce1b096b7a2bbf3cbfc0be32aa3ba05494\": container with ID starting with 8de6a6f53d44ad785244ff4053baf4ce1b096b7a2bbf3cbfc0be32aa3ba05494 not found: ID does not exist"
Jul 27 17:27:00.992149 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:00.992068    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd09ca57-decb-4305-ac68-3805409b7133" path="/var/lib/kubelet/pods/dd09ca57-decb-4305-ac68-3805409b7133/volumes"
Jul 27 17:27:01.419494 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:01.419460    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zvcb4" event={"ID":"da395a06-4adf-4dd2-b530-b74993ed4dc2","Type":"ContainerStarted","Data":"22f5058ecc0ca0b7645d7e2ca1153920ea2e2b3c4d2583e0567c4d63792dc8da"}
Jul 27 17:27:01.419933 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:01.419568    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zvcb4"
Jul 27 17:27:01.442297 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:01.442248    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zvcb4" podStartSLOduration=1.360049122 podStartE2EDuration="4.442222506s" totalImagesPullingTime="3.082173384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:27:01.440567053 +0000 UTC m=+364.972318056" watchObservedRunningTime="2026-07-27 17:27:01.442222506 +0000 UTC m=+364.973973492"
Jul 27 17:27:02.426738 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.426705    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2j29q" event={"ID":"5abb3884-5803-4323-838e-5c2043df8a1e","Type":"ContainerStarted","Data":"9fecb60b560160daf42e768e5b226c50847657c57dac33dcfad4adf08b942ff6"}
Jul 27 17:27:02.427030 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.426972    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2j29q"
Jul 27 17:27:02.442580 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.442542    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2j29q" podStartSLOduration=2.760951521 podStartE2EDuration="5.442528509s" totalImagesPullingTime="2.681576988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:27:02.441164229 +0000 UTC m=+365.972915215" watchObservedRunningTime="2026-07-27 17:27:02.442528509 +0000 UTC m=+365.974279495"
Jul 27 17:27:02.639473 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.639449    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:27:02.685791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.685712    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-data\") pod \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") "
Jul 27 17:27:02.685791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.685747    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7dg8\" (UniqueName: \"kubernetes.io/projected/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-kube-api-access-x7dg8\") pod \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") "
Jul 27 17:27:02.685989 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.685802    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-workload-socket\") pod \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") "
Jul 27 17:27:02.685989 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.685822    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-workload-certs\") pod \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") "
Jul 27 17:27:02.685989 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.685842    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-token\") pod \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") "
Jul 27 17:27:02.685989 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.685856    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-envoy\") pod \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") "
Jul 27 17:27:02.685989 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.685891    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-credential-socket\") pod \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") "
Jul 27 17:27:02.685989 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.685917    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-podinfo\") pod \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") "
Jul 27 17:27:02.685989 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.685944    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istiod-ca-cert\") pod \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\" (UID: \"f5b66b23-9898-4c0e-b85c-d43ffaf185c4\") "
Jul 27 17:27:02.686325 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.686064    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f5b66b23-9898-4c0e-b85c-d43ffaf185c4" (UID: "f5b66b23-9898-4c0e-b85c-d43ffaf185c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:27:02.686325 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.686060    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "f5b66b23-9898-4c0e-b85c-d43ffaf185c4" (UID: "f5b66b23-9898-4c0e-b85c-d43ffaf185c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:27:02.686325 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.686146    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-data\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:27:02.686325 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.686164    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-workload-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:27:02.686325 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.686161    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f5b66b23-9898-4c0e-b85c-d43ffaf185c4" (UID: "f5b66b23-9898-4c0e-b85c-d43ffaf185c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:27:02.686325 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.686271    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f5b66b23-9898-4c0e-b85c-d43ffaf185c4" (UID: "f5b66b23-9898-4c0e-b85c-d43ffaf185c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:27:02.686709 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.686488    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f5b66b23-9898-4c0e-b85c-d43ffaf185c4" (UID: "f5b66b23-9898-4c0e-b85c-d43ffaf185c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:27:02.688222 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.688191    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "f5b66b23-9898-4c0e-b85c-d43ffaf185c4" (UID: "f5b66b23-9898-4c0e-b85c-d43ffaf185c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:27:02.688222 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.688199    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f5b66b23-9898-4c0e-b85c-d43ffaf185c4" (UID: "f5b66b23-9898-4c0e-b85c-d43ffaf185c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:27:02.688693 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.688663    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f5b66b23-9898-4c0e-b85c-d43ffaf185c4" (UID: "f5b66b23-9898-4c0e-b85c-d43ffaf185c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 17:27:02.688775 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.688669    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-kube-api-access-x7dg8" (OuterVolumeSpecName: "kube-api-access-x7dg8") pod "f5b66b23-9898-4c0e-b85c-d43ffaf185c4" (UID: "f5b66b23-9898-4c0e-b85c-d43ffaf185c4"). InnerVolumeSpecName "kube-api-access-x7dg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:27:02.787083 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.787036    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7dg8\" (UniqueName: \"kubernetes.io/projected/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-kube-api-access-x7dg8\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:27:02.787083 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.787077    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-workload-certs\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:27:02.787083 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.787088    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-token\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:27:02.787083 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.787095    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-envoy\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:27:02.787391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.787103    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-credential-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:27:02.787391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.787112    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istio-podinfo\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:27:02.787391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:02.787120    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5b66b23-9898-4c0e-b85c-d43ffaf185c4-istiod-ca-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:27:03.432212 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:03.432180    2579 generic.go:356] "Generic (PLEG): container finished" podID="f5b66b23-9898-4c0e-b85c-d43ffaf185c4" containerID="5501b24f07455a319e99f9a0bd340113e83e4e8f54312bf9aa11f89ee09fa2ca" exitCode=0
Jul 27 17:27:03.432666 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:03.432224    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"
Jul 27 17:27:03.432666 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:03.432268    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6" event={"ID":"f5b66b23-9898-4c0e-b85c-d43ffaf185c4","Type":"ContainerDied","Data":"5501b24f07455a319e99f9a0bd340113e83e4e8f54312bf9aa11f89ee09fa2ca"}
Jul 27 17:27:03.432666 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:03.432330    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6" event={"ID":"f5b66b23-9898-4c0e-b85c-d43ffaf185c4","Type":"ContainerDied","Data":"e0a2d2b61ef2739d26e1336cb300b0ca285b863c4fd335c92672282e5b26bd5b"}
Jul 27 17:27:03.432666 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:03.432353    2579 scope.go:117] "RemoveContainer" containerID="5501b24f07455a319e99f9a0bd340113e83e4e8f54312bf9aa11f89ee09fa2ca"
Jul 27 17:27:03.440955 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:03.440938    2579 scope.go:117] "RemoveContainer" containerID="5501b24f07455a319e99f9a0bd340113e83e4e8f54312bf9aa11f89ee09fa2ca"
Jul 27 17:27:03.441208 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:27:03.441190    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5501b24f07455a319e99f9a0bd340113e83e4e8f54312bf9aa11f89ee09fa2ca\": container with ID starting with 5501b24f07455a319e99f9a0bd340113e83e4e8f54312bf9aa11f89ee09fa2ca not found: ID does not exist" containerID="5501b24f07455a319e99f9a0bd340113e83e4e8f54312bf9aa11f89ee09fa2ca"
Jul 27 17:27:03.441251 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:03.441218    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5501b24f07455a319e99f9a0bd340113e83e4e8f54312bf9aa11f89ee09fa2ca"} err="failed to get container status \"5501b24f07455a319e99f9a0bd340113e83e4e8f54312bf9aa11f89ee09fa2ca\": rpc error: code = NotFound desc = could not find container \"5501b24f07455a319e99f9a0bd340113e83e4e8f54312bf9aa11f89ee09fa2ca\": container with ID starting with 5501b24f07455a319e99f9a0bd340113e83e4e8f54312bf9aa11f89ee09fa2ca not found: ID does not exist"
Jul 27 17:27:03.450017 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:03.449993    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"]
Jul 27 17:27:03.454623 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:03.454602    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4q6s6"]
Jul 27 17:27:04.992292 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:04.992256    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5b66b23-9898-4c0e-b85c-d43ffaf185c4" path="/var/lib/kubelet/pods/f5b66b23-9898-4c0e-b85c-d43ffaf185c4/volumes"
Jul 27 17:27:32.429345 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:32.429313    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zvcb4"
Jul 27 17:27:33.437552 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:33.437521    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-2j29q"
Jul 27 17:27:45.587408 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:45.587132    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2pvjs"]
Jul 27 17:27:45.587900 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:45.587778    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd09ca57-decb-4305-ac68-3805409b7133" containerName="discovery"
Jul 27 17:27:45.587900 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:45.587797    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd09ca57-decb-4305-ac68-3805409b7133" containerName="discovery"
Jul 27 17:27:45.587900 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:45.587843    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5b66b23-9898-4c0e-b85c-d43ffaf185c4" containerName="istio-proxy"
Jul 27 17:27:45.587900 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:45.587853    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b66b23-9898-4c0e-b85c-d43ffaf185c4" containerName="istio-proxy"
Jul 27 17:27:45.588086 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:45.587979    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd09ca57-decb-4305-ac68-3805409b7133" containerName="discovery"
Jul 27 17:27:45.588086 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:45.587997    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5b66b23-9898-4c0e-b85c-d43ffaf185c4" containerName="istio-proxy"
Jul 27 17:27:45.601902 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:45.601867    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2pvjs"]
Jul 27 17:27:45.602065 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:45.601966    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2pvjs"
Jul 27 17:27:45.604128 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:45.604107    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2z8xz\""
Jul 27 17:27:45.604391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:45.604372    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 17:27:45.604664 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:45.604651    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 17:27:45.723065 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:45.723023    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmvfx\" (UniqueName: \"kubernetes.io/projected/cabc680f-fe3a-4913-bd45-f86826f01e02-kube-api-access-wmvfx\") pod \"kuadrant-operator-catalog-2pvjs\" (UID: \"cabc680f-fe3a-4913-bd45-f86826f01e02\") " pod="kuadrant-system/kuadrant-operator-catalog-2pvjs"
Jul 27 17:27:45.824115 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:45.824072    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmvfx\" (UniqueName: \"kubernetes.io/projected/cabc680f-fe3a-4913-bd45-f86826f01e02-kube-api-access-wmvfx\") pod \"kuadrant-operator-catalog-2pvjs\" (UID: \"cabc680f-fe3a-4913-bd45-f86826f01e02\") " pod="kuadrant-system/kuadrant-operator-catalog-2pvjs"
Jul 27 17:27:45.833013 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:45.832992    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmvfx\" (UniqueName: \"kubernetes.io/projected/cabc680f-fe3a-4913-bd45-f86826f01e02-kube-api-access-wmvfx\") pod \"kuadrant-operator-catalog-2pvjs\" (UID: \"cabc680f-fe3a-4913-bd45-f86826f01e02\") " pod="kuadrant-system/kuadrant-operator-catalog-2pvjs"
Jul 27 17:27:45.912049 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:45.911965    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2pvjs"
Jul 27 17:27:45.932942 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:45.932913    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2pvjs"]
Jul 27 17:27:46.043260 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:46.043235    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2pvjs"]
Jul 27 17:27:46.046035 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:27:46.046011    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcabc680f_fe3a_4913_bd45_f86826f01e02.slice/crio-e616fafe8b276929acdc25ea6a7c8b31c97475f5033d61c6c3cfb79ef5771655 WatchSource:0}: Error finding container e616fafe8b276929acdc25ea6a7c8b31c97475f5033d61c6c3cfb79ef5771655: Status 404 returned error can't find the container with id e616fafe8b276929acdc25ea6a7c8b31c97475f5033d61c6c3cfb79ef5771655
Jul 27 17:27:46.143304 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:46.143275    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c82cs"]
Jul 27 17:27:46.147668 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:46.147652    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c82cs"
Jul 27 17:27:46.155217 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:46.155196    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c82cs"]
Jul 27 17:27:46.327322 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:46.327294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqw62\" (UniqueName: \"kubernetes.io/projected/8007e12e-a67a-40c3-9648-0fcc74613b3a-kube-api-access-nqw62\") pod \"kuadrant-operator-catalog-c82cs\" (UID: \"8007e12e-a67a-40c3-9648-0fcc74613b3a\") " pod="kuadrant-system/kuadrant-operator-catalog-c82cs"
Jul 27 17:27:46.428473 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:46.428443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqw62\" (UniqueName: \"kubernetes.io/projected/8007e12e-a67a-40c3-9648-0fcc74613b3a-kube-api-access-nqw62\") pod \"kuadrant-operator-catalog-c82cs\" (UID: \"8007e12e-a67a-40c3-9648-0fcc74613b3a\") " pod="kuadrant-system/kuadrant-operator-catalog-c82cs"
Jul 27 17:27:46.436821 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:46.436792    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqw62\" (UniqueName: \"kubernetes.io/projected/8007e12e-a67a-40c3-9648-0fcc74613b3a-kube-api-access-nqw62\") pod \"kuadrant-operator-catalog-c82cs\" (UID: \"8007e12e-a67a-40c3-9648-0fcc74613b3a\") " pod="kuadrant-system/kuadrant-operator-catalog-c82cs"
Jul 27 17:27:46.457662 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:46.457641    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c82cs"
Jul 27 17:27:46.583588 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:46.583513    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c82cs"]
Jul 27 17:27:46.585953 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:27:46.585928    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8007e12e_a67a_40c3_9648_0fcc74613b3a.slice/crio-0ca9aec3f0c40276a91ba9e257062a7aafab04cc046307fb2093e69fb60c955d WatchSource:0}: Error finding container 0ca9aec3f0c40276a91ba9e257062a7aafab04cc046307fb2093e69fb60c955d: Status 404 returned error can't find the container with id 0ca9aec3f0c40276a91ba9e257062a7aafab04cc046307fb2093e69fb60c955d
Jul 27 17:27:46.608069 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:46.608040    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c82cs" event={"ID":"8007e12e-a67a-40c3-9648-0fcc74613b3a","Type":"ContainerStarted","Data":"0ca9aec3f0c40276a91ba9e257062a7aafab04cc046307fb2093e69fb60c955d"}
Jul 27 17:27:46.609105 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:46.609083    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2pvjs" event={"ID":"cabc680f-fe3a-4913-bd45-f86826f01e02","Type":"ContainerStarted","Data":"e616fafe8b276929acdc25ea6a7c8b31c97475f5033d61c6c3cfb79ef5771655"}
Jul 27 17:27:49.628340 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:49.628308    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c82cs" event={"ID":"8007e12e-a67a-40c3-9648-0fcc74613b3a","Type":"ContainerStarted","Data":"51bae674e725dbcc6623ec9a136f9cdb6dac426ecc8473ebc1a80cdc67db8bb3"}
Jul 27 17:27:49.629802 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:49.629780    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2pvjs" event={"ID":"cabc680f-fe3a-4913-bd45-f86826f01e02","Type":"ContainerStarted","Data":"98f41535fc31015f13fea7e48e7dc194c8ff3652928dd11edb665155307d4f46"}
Jul 27 17:27:49.629915 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:49.629854    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-2pvjs" podUID="cabc680f-fe3a-4913-bd45-f86826f01e02" containerName="registry-server" containerID="cri-o://98f41535fc31015f13fea7e48e7dc194c8ff3652928dd11edb665155307d4f46" gracePeriod=2
Jul 27 17:27:49.644496 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:49.644455    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-c82cs" podStartSLOduration=1.547717011 podStartE2EDuration="3.644441347s" totalImagesPullingTime="2.096724336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:27:49.643592571 +0000 UTC m=+413.175343557" watchObservedRunningTime="2026-07-27 17:27:49.644441347 +0000 UTC m=+413.176192346"
Jul 27 17:27:49.659496 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:49.659455    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2pvjs" podStartSLOduration=2.026602103 podStartE2EDuration="4.659441333s" totalImagesPullingTime="2.63283923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:27:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:27:49.658341242 +0000 UTC m=+413.190092239" watchObservedRunningTime="2026-07-27 17:27:49.659441333 +0000 UTC m=+413.191192310"
Jul 27 17:27:49.870390 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:49.870366    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2pvjs"
Jul 27 17:27:50.054488 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:50.054456    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmvfx\" (UniqueName: \"kubernetes.io/projected/cabc680f-fe3a-4913-bd45-f86826f01e02-kube-api-access-wmvfx\") pod \"cabc680f-fe3a-4913-bd45-f86826f01e02\" (UID: \"cabc680f-fe3a-4913-bd45-f86826f01e02\") "
Jul 27 17:27:50.056727 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:50.056704    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cabc680f-fe3a-4913-bd45-f86826f01e02-kube-api-access-wmvfx" (OuterVolumeSpecName: "kube-api-access-wmvfx") pod "cabc680f-fe3a-4913-bd45-f86826f01e02" (UID: "cabc680f-fe3a-4913-bd45-f86826f01e02"). InnerVolumeSpecName "kube-api-access-wmvfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:27:50.155332 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:50.155294    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmvfx\" (UniqueName: \"kubernetes.io/projected/cabc680f-fe3a-4913-bd45-f86826f01e02-kube-api-access-wmvfx\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:27:50.635745 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:50.635708    2579 generic.go:356] "Generic (PLEG): container finished" podID="cabc680f-fe3a-4913-bd45-f86826f01e02" containerID="98f41535fc31015f13fea7e48e7dc194c8ff3652928dd11edb665155307d4f46" exitCode=0
Jul 27 17:27:50.636200 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:50.635768    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2pvjs"
Jul 27 17:27:50.636200 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:50.635807    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2pvjs" event={"ID":"cabc680f-fe3a-4913-bd45-f86826f01e02","Type":"ContainerDied","Data":"98f41535fc31015f13fea7e48e7dc194c8ff3652928dd11edb665155307d4f46"}
Jul 27 17:27:50.636200 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:50.635867    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2pvjs" event={"ID":"cabc680f-fe3a-4913-bd45-f86826f01e02","Type":"ContainerDied","Data":"e616fafe8b276929acdc25ea6a7c8b31c97475f5033d61c6c3cfb79ef5771655"}
Jul 27 17:27:50.636200 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:50.635898    2579 scope.go:117] "RemoveContainer" containerID="98f41535fc31015f13fea7e48e7dc194c8ff3652928dd11edb665155307d4f46"
Jul 27 17:27:50.644361 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:50.644345    2579 scope.go:117] "RemoveContainer" containerID="98f41535fc31015f13fea7e48e7dc194c8ff3652928dd11edb665155307d4f46"
Jul 27 17:27:50.644639 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:27:50.644620    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98f41535fc31015f13fea7e48e7dc194c8ff3652928dd11edb665155307d4f46\": container with ID starting with 98f41535fc31015f13fea7e48e7dc194c8ff3652928dd11edb665155307d4f46 not found: ID does not exist" containerID="98f41535fc31015f13fea7e48e7dc194c8ff3652928dd11edb665155307d4f46"
Jul 27 17:27:50.644692 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:50.644648    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f41535fc31015f13fea7e48e7dc194c8ff3652928dd11edb665155307d4f46"} err="failed to get container status \"98f41535fc31015f13fea7e48e7dc194c8ff3652928dd11edb665155307d4f46\": rpc error: code = NotFound desc = could not find container \"98f41535fc31015f13fea7e48e7dc194c8ff3652928dd11edb665155307d4f46\": container with ID starting with 98f41535fc31015f13fea7e48e7dc194c8ff3652928dd11edb665155307d4f46 not found: ID does not exist"
Jul 27 17:27:50.654889 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:50.654868    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2pvjs"]
Jul 27 17:27:50.658295 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:50.658277    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2pvjs"]
Jul 27 17:27:50.992964 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:50.992886    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cabc680f-fe3a-4913-bd45-f86826f01e02" path="/var/lib/kubelet/pods/cabc680f-fe3a-4913-bd45-f86826f01e02/volumes"
Jul 27 17:27:56.458512 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:56.458476    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-c82cs"
Jul 27 17:27:56.458945 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:56.458556    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-c82cs"
Jul 27 17:27:56.479876 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:56.479851    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-c82cs"
Jul 27 17:27:56.684936 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:27:56.684911    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-c82cs"
Jul 27 17:28:01.515926 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.515879    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls"]
Jul 27 17:28:01.516395 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.516178    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cabc680f-fe3a-4913-bd45-f86826f01e02" containerName="registry-server"
Jul 27 17:28:01.516395 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.516190    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cabc680f-fe3a-4913-bd45-f86826f01e02" containerName="registry-server"
Jul 27 17:28:01.516395 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.516266    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cabc680f-fe3a-4913-bd45-f86826f01e02" containerName="registry-server"
Jul 27 17:28:01.520864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.520842    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls"
Jul 27 17:28:01.523371 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.523346    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-scg5l\""
Jul 27 17:28:01.529292 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.529262    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls"]
Jul 27 17:28:01.536326 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.536298    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed4fd33b-7d70-466f-87d4-87c14e122527-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls\" (UID: \"ed4fd33b-7d70-466f-87d4-87c14e122527\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls"
Jul 27 17:28:01.536470 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.536351    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggfm2\" (UniqueName: \"kubernetes.io/projected/ed4fd33b-7d70-466f-87d4-87c14e122527-kube-api-access-ggfm2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls\" (UID: \"ed4fd33b-7d70-466f-87d4-87c14e122527\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls"
Jul 27 17:28:01.536470 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.536375    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed4fd33b-7d70-466f-87d4-87c14e122527-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls\" (UID: \"ed4fd33b-7d70-466f-87d4-87c14e122527\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls"
Jul 27 17:28:01.637691 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.637651    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed4fd33b-7d70-466f-87d4-87c14e122527-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls\" (UID: \"ed4fd33b-7d70-466f-87d4-87c14e122527\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls"
Jul 27 17:28:01.637851 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.637707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed4fd33b-7d70-466f-87d4-87c14e122527-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls\" (UID: \"ed4fd33b-7d70-466f-87d4-87c14e122527\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls"
Jul 27 17:28:01.637851 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.637755    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggfm2\" (UniqueName: \"kubernetes.io/projected/ed4fd33b-7d70-466f-87d4-87c14e122527-kube-api-access-ggfm2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls\" (UID: \"ed4fd33b-7d70-466f-87d4-87c14e122527\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls"
Jul 27 17:28:01.638046 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.638028    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed4fd33b-7d70-466f-87d4-87c14e122527-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls\" (UID: \"ed4fd33b-7d70-466f-87d4-87c14e122527\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls"
Jul 27 17:28:01.638082 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.638054    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed4fd33b-7d70-466f-87d4-87c14e122527-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls\" (UID: \"ed4fd33b-7d70-466f-87d4-87c14e122527\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls"
Jul 27 17:28:01.646948 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.646921    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggfm2\" (UniqueName: \"kubernetes.io/projected/ed4fd33b-7d70-466f-87d4-87c14e122527-kube-api-access-ggfm2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls\" (UID: \"ed4fd33b-7d70-466f-87d4-87c14e122527\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls"
Jul 27 17:28:01.830558 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.830532    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls"
Jul 27 17:28:01.963163 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:01.963129    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls"]
Jul 27 17:28:01.966602 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:28:01.966565    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded4fd33b_7d70_466f_87d4_87c14e122527.slice/crio-74c386d66f8afc4b5a53409e86b2f4e55f414839fbd31349a298bba8ec5e9dd3 WatchSource:0}: Error finding container 74c386d66f8afc4b5a53409e86b2f4e55f414839fbd31349a298bba8ec5e9dd3: Status 404 returned error can't find the container with id 74c386d66f8afc4b5a53409e86b2f4e55f414839fbd31349a298bba8ec5e9dd3
Jul 27 17:28:02.137158 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.137085    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn"]
Jul 27 17:28:02.140303 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.140286    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn"
Jul 27 17:28:02.147627 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.147607    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn"]
Jul 27 17:28:02.241161 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.241129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn\" (UID: \"5fc06110-0f2d-4c67-84a8-d76c4e56e98c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn"
Jul 27 17:28:02.241327 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.241176    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn\" (UID: \"5fc06110-0f2d-4c67-84a8-d76c4e56e98c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn"
Jul 27 17:28:02.241327 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.241203    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mmtw\" (UniqueName: \"kubernetes.io/projected/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-kube-api-access-7mmtw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn\" (UID: \"5fc06110-0f2d-4c67-84a8-d76c4e56e98c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn"
Jul 27 17:28:02.342149 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.342115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn\" (UID: \"5fc06110-0f2d-4c67-84a8-d76c4e56e98c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn"
Jul 27 17:28:02.342327 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.342164    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn\" (UID: \"5fc06110-0f2d-4c67-84a8-d76c4e56e98c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn"
Jul 27 17:28:02.342327 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.342191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mmtw\" (UniqueName: \"kubernetes.io/projected/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-kube-api-access-7mmtw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn\" (UID: \"5fc06110-0f2d-4c67-84a8-d76c4e56e98c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn"
Jul 27 17:28:02.342560 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.342540    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn\" (UID: \"5fc06110-0f2d-4c67-84a8-d76c4e56e98c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn"
Jul 27 17:28:02.342602 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.342552    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn\" (UID: \"5fc06110-0f2d-4c67-84a8-d76c4e56e98c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn"
Jul 27 17:28:02.351650 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.351625    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mmtw\" (UniqueName: \"kubernetes.io/projected/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-kube-api-access-7mmtw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn\" (UID: \"5fc06110-0f2d-4c67-84a8-d76c4e56e98c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn"
Jul 27 17:28:02.449281 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.449203    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn"
Jul 27 17:28:02.514011 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.513978    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs"]
Jul 27 17:28:02.518480 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.518451    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs"
Jul 27 17:28:02.526988 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.526962    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs"]
Jul 27 17:28:02.544331 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.544297    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs\" (UID: \"bbff31b6-96de-40f1-94b8-ca4841c3c9ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs"
Jul 27 17:28:02.544495 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.544376    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs\" (UID: \"bbff31b6-96de-40f1-94b8-ca4841c3c9ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs"
Jul 27 17:28:02.544495 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.544485    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jspxd\" (UniqueName: \"kubernetes.io/projected/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-kube-api-access-jspxd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs\" (UID: \"bbff31b6-96de-40f1-94b8-ca4841c3c9ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs"
Jul 27 17:28:02.591316 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.591285    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn"]
Jul 27 17:28:02.593449 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:28:02.593397    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc06110_0f2d_4c67_84a8_d76c4e56e98c.slice/crio-2257c852abda0428398fc2383fa66f8398608788052a9d272237dad24cc44d35 WatchSource:0}: Error finding container 2257c852abda0428398fc2383fa66f8398608788052a9d272237dad24cc44d35: Status 404 returned error can't find the container with id 2257c852abda0428398fc2383fa66f8398608788052a9d272237dad24cc44d35
Jul 27 17:28:02.645461 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.645437    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs\" (UID: \"bbff31b6-96de-40f1-94b8-ca4841c3c9ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs"
Jul 27 17:28:02.645581 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.645505    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs\" (UID: \"bbff31b6-96de-40f1-94b8-ca4841c3c9ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs"
Jul 27 17:28:02.645581 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.645563    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jspxd\" (UniqueName: \"kubernetes.io/projected/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-kube-api-access-jspxd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs\" (UID: \"bbff31b6-96de-40f1-94b8-ca4841c3c9ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs"
Jul 27 17:28:02.645807 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.645785    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs\" (UID: \"bbff31b6-96de-40f1-94b8-ca4841c3c9ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs"
Jul 27 17:28:02.645807 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.645796    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs\" (UID: \"bbff31b6-96de-40f1-94b8-ca4841c3c9ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs"
Jul 27 17:28:02.653730 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.653705    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jspxd\" (UniqueName: \"kubernetes.io/projected/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-kube-api-access-jspxd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs\" (UID: \"bbff31b6-96de-40f1-94b8-ca4841c3c9ba\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs"
Jul 27 17:28:02.690804 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.690773    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn" event={"ID":"5fc06110-0f2d-4c67-84a8-d76c4e56e98c","Type":"ContainerStarted","Data":"3277287ee605aae12a042f9a2b62133a9253589d445ea67edd5ca79e830a1c8f"}
Jul 27 17:28:02.690993 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.690833    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn" event={"ID":"5fc06110-0f2d-4c67-84a8-d76c4e56e98c","Type":"ContainerStarted","Data":"2257c852abda0428398fc2383fa66f8398608788052a9d272237dad24cc44d35"}
Jul 27 17:28:02.692369 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.692341    2579 generic.go:356] "Generic (PLEG): container finished" podID="ed4fd33b-7d70-466f-87d4-87c14e122527" containerID="e9b0d3ccca90cf569a2b538d8a70a3732f58c45a8013ea56e7306d713afc931a" exitCode=0
Jul 27 17:28:02.692502 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.692444    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls" event={"ID":"ed4fd33b-7d70-466f-87d4-87c14e122527","Type":"ContainerDied","Data":"e9b0d3ccca90cf569a2b538d8a70a3732f58c45a8013ea56e7306d713afc931a"}
Jul 27 17:28:02.692502 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.692483    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls" event={"ID":"ed4fd33b-7d70-466f-87d4-87c14e122527","Type":"ContainerStarted","Data":"74c386d66f8afc4b5a53409e86b2f4e55f414839fbd31349a298bba8ec5e9dd3"}
Jul 27 17:28:02.827764 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.827728    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs"
Jul 27 17:28:02.920735 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.920706    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98"]
Jul 27 17:28:02.925230 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.925205    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98"
Jul 27 17:28:02.932804 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.932514    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98"]
Jul 27 17:28:02.947805 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.947777    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00b83755-b21c-42d0-9e6b-b8431459ce5f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98\" (UID: \"00b83755-b21c-42d0-9e6b-b8431459ce5f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98"
Jul 27 17:28:02.947961 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.947811    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00b83755-b21c-42d0-9e6b-b8431459ce5f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98\" (UID: \"00b83755-b21c-42d0-9e6b-b8431459ce5f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98"
Jul 27 17:28:02.947961 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.947866    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjv7j\" (UniqueName: \"kubernetes.io/projected/00b83755-b21c-42d0-9e6b-b8431459ce5f-kube-api-access-bjv7j\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98\" (UID: \"00b83755-b21c-42d0-9e6b-b8431459ce5f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98"
Jul 27 17:28:02.967876 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:02.967708    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs"]
Jul 27 17:28:02.969981 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:28:02.969951    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbff31b6_96de_40f1_94b8_ca4841c3c9ba.slice/crio-5b21f2303d222a35b1b8fb78c4d70247706e368e2e41a9ac8e27625a6d5254f9 WatchSource:0}: Error finding container 5b21f2303d222a35b1b8fb78c4d70247706e368e2e41a9ac8e27625a6d5254f9: Status 404 returned error can't find the container with id 5b21f2303d222a35b1b8fb78c4d70247706e368e2e41a9ac8e27625a6d5254f9
Jul 27 17:28:03.049223 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:03.049183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00b83755-b21c-42d0-9e6b-b8431459ce5f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98\" (UID: \"00b83755-b21c-42d0-9e6b-b8431459ce5f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98"
Jul 27 17:28:03.049463 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:03.049233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00b83755-b21c-42d0-9e6b-b8431459ce5f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98\" (UID: \"00b83755-b21c-42d0-9e6b-b8431459ce5f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98"
Jul 27 17:28:03.049463 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:03.049272    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjv7j\" (UniqueName: \"kubernetes.io/projected/00b83755-b21c-42d0-9e6b-b8431459ce5f-kube-api-access-bjv7j\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98\" (UID: \"00b83755-b21c-42d0-9e6b-b8431459ce5f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98"
Jul 27 17:28:03.049661 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:03.049638    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00b83755-b21c-42d0-9e6b-b8431459ce5f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98\" (UID: \"00b83755-b21c-42d0-9e6b-b8431459ce5f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98"
Jul 27 17:28:03.049717 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:03.049699    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00b83755-b21c-42d0-9e6b-b8431459ce5f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98\" (UID: \"00b83755-b21c-42d0-9e6b-b8431459ce5f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98"
Jul 27 17:28:03.059214 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:03.059186    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjv7j\" (UniqueName: \"kubernetes.io/projected/00b83755-b21c-42d0-9e6b-b8431459ce5f-kube-api-access-bjv7j\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98\" (UID: \"00b83755-b21c-42d0-9e6b-b8431459ce5f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98"
Jul 27 17:28:03.238757 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:03.238679    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98"
Jul 27 17:28:03.379291 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:03.379258    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98"]
Jul 27 17:28:03.382686 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:28:03.382662    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b83755_b21c_42d0_9e6b_b8431459ce5f.slice/crio-11f154d22936895b7e3d73e0412fa68140f39bf797af1b1a4dd4d5044f706dce WatchSource:0}: Error finding container 11f154d22936895b7e3d73e0412fa68140f39bf797af1b1a4dd4d5044f706dce: Status 404 returned error can't find the container with id 11f154d22936895b7e3d73e0412fa68140f39bf797af1b1a4dd4d5044f706dce
Jul 27 17:28:03.698846 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:03.698818    2579 generic.go:356] "Generic (PLEG): container finished" podID="5fc06110-0f2d-4c67-84a8-d76c4e56e98c" containerID="3277287ee605aae12a042f9a2b62133a9253589d445ea67edd5ca79e830a1c8f" exitCode=0
Jul 27 17:28:03.699201 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:03.698895    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn" event={"ID":"5fc06110-0f2d-4c67-84a8-d76c4e56e98c","Type":"ContainerDied","Data":"3277287ee605aae12a042f9a2b62133a9253589d445ea67edd5ca79e830a1c8f"}
Jul 27 17:28:03.702472 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:03.702450    2579 generic.go:356] "Generic (PLEG): container finished" podID="bbff31b6-96de-40f1-94b8-ca4841c3c9ba" containerID="fb935769b793e9d66313289db2860939b36de822786657e51c80c833a256cfac" exitCode=0
Jul 27 17:28:03.702569 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:03.702533    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs" event={"ID":"bbff31b6-96de-40f1-94b8-ca4841c3c9ba","Type":"ContainerDied","Data":"fb935769b793e9d66313289db2860939b36de822786657e51c80c833a256cfac"}
Jul 27 17:28:03.702635 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:03.702583    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs" event={"ID":"bbff31b6-96de-40f1-94b8-ca4841c3c9ba","Type":"ContainerStarted","Data":"5b21f2303d222a35b1b8fb78c4d70247706e368e2e41a9ac8e27625a6d5254f9"}
Jul 27 17:28:03.704079 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:03.704058    2579 generic.go:356] "Generic (PLEG): container finished" podID="00b83755-b21c-42d0-9e6b-b8431459ce5f" containerID="39f541c0f02507b2115e259dfa3ff1afadaa812d89ea2fd62609bd0aff053a89" exitCode=0
Jul 27 17:28:03.704174 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:03.704116    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98" event={"ID":"00b83755-b21c-42d0-9e6b-b8431459ce5f","Type":"ContainerDied","Data":"39f541c0f02507b2115e259dfa3ff1afadaa812d89ea2fd62609bd0aff053a89"}
Jul 27 17:28:03.704174 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:03.704166    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98" event={"ID":"00b83755-b21c-42d0-9e6b-b8431459ce5f","Type":"ContainerStarted","Data":"11f154d22936895b7e3d73e0412fa68140f39bf797af1b1a4dd4d5044f706dce"}
Jul 27 17:28:04.710279 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:04.710208    2579 generic.go:356] "Generic (PLEG): container finished" podID="5fc06110-0f2d-4c67-84a8-d76c4e56e98c" containerID="b1fa9420d91e35b2760a7c1f3329532e63b7ce603325f4d24ec685f48aa05912" exitCode=0
Jul 27 17:28:04.710743 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:04.710291    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn" event={"ID":"5fc06110-0f2d-4c67-84a8-d76c4e56e98c","Type":"ContainerDied","Data":"b1fa9420d91e35b2760a7c1f3329532e63b7ce603325f4d24ec685f48aa05912"}
Jul 27 17:28:04.712107 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:04.712084    2579 generic.go:356] "Generic (PLEG): container finished" podID="ed4fd33b-7d70-466f-87d4-87c14e122527" containerID="3f67896d7947b04b077582c1db93c19f3ac38a143025c3879d7ced29f4f0a1b3" exitCode=0
Jul 27 17:28:04.712176 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:04.712152    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls" event={"ID":"ed4fd33b-7d70-466f-87d4-87c14e122527","Type":"ContainerDied","Data":"3f67896d7947b04b077582c1db93c19f3ac38a143025c3879d7ced29f4f0a1b3"}
Jul 27 17:28:05.718490 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:05.718455    2579 generic.go:356] "Generic (PLEG): container finished" podID="5fc06110-0f2d-4c67-84a8-d76c4e56e98c" containerID="28b1f178c3a60c3c59c7005c4b0adce9533ecf9736cd701426c8c58232cec30e" exitCode=0
Jul 27 17:28:05.718920 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:05.718554    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn" event={"ID":"5fc06110-0f2d-4c67-84a8-d76c4e56e98c","Type":"ContainerDied","Data":"28b1f178c3a60c3c59c7005c4b0adce9533ecf9736cd701426c8c58232cec30e"}
Jul 27 17:28:05.720385 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:05.720361    2579 generic.go:356] "Generic (PLEG): container finished" podID="ed4fd33b-7d70-466f-87d4-87c14e122527" containerID="2c7c3545eed55c75cdc1dba557e841ff8dbdd07d2f14c718d8b3c7ed55aabdb0" exitCode=0
Jul 27 17:28:05.720480 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:05.720456    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls" event={"ID":"ed4fd33b-7d70-466f-87d4-87c14e122527","Type":"ContainerDied","Data":"2c7c3545eed55c75cdc1dba557e841ff8dbdd07d2f14c718d8b3c7ed55aabdb0"}
Jul 27 17:28:05.721910 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:05.721888    2579 generic.go:356] "Generic (PLEG): container finished" podID="00b83755-b21c-42d0-9e6b-b8431459ce5f" containerID="a50cc12eff3fc763b8a3f9dd59c3e3b738d311c25849d1b156410f968a5a0970" exitCode=0
Jul 27 17:28:05.722020 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:05.721972    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98" event={"ID":"00b83755-b21c-42d0-9e6b-b8431459ce5f","Type":"ContainerDied","Data":"a50cc12eff3fc763b8a3f9dd59c3e3b738d311c25849d1b156410f968a5a0970"}
Jul 27 17:28:06.733585 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.733548    2579 generic.go:356] "Generic (PLEG): container finished" podID="bbff31b6-96de-40f1-94b8-ca4841c3c9ba" containerID="e3e7e147414151f8fd1f73a0a3d285cd8d17ac5e3f2cb37b0aea071c12b330ff" exitCode=0
Jul 27 17:28:06.733998 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.733583    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs" event={"ID":"bbff31b6-96de-40f1-94b8-ca4841c3c9ba","Type":"ContainerDied","Data":"e3e7e147414151f8fd1f73a0a3d285cd8d17ac5e3f2cb37b0aea071c12b330ff"}
Jul 27 17:28:06.735996 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.735974    2579 generic.go:356] "Generic (PLEG): container finished" podID="00b83755-b21c-42d0-9e6b-b8431459ce5f" containerID="ce76fbdc86c53d5a1087a75efd3fd0ee0db855f2bbe4d451db0f72080119fbaf" exitCode=0
Jul 27 17:28:06.736096 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.736036    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98" event={"ID":"00b83755-b21c-42d0-9e6b-b8431459ce5f","Type":"ContainerDied","Data":"ce76fbdc86c53d5a1087a75efd3fd0ee0db855f2bbe4d451db0f72080119fbaf"}
Jul 27 17:28:06.879994 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.879952    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn"
Jul 27 17:28:06.964474 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.964450    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls"
Jul 27 17:28:06.980083 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.980056    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed4fd33b-7d70-466f-87d4-87c14e122527-bundle\") pod \"ed4fd33b-7d70-466f-87d4-87c14e122527\" (UID: \"ed4fd33b-7d70-466f-87d4-87c14e122527\") "
Jul 27 17:28:06.980231 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.980136    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggfm2\" (UniqueName: \"kubernetes.io/projected/ed4fd33b-7d70-466f-87d4-87c14e122527-kube-api-access-ggfm2\") pod \"ed4fd33b-7d70-466f-87d4-87c14e122527\" (UID: \"ed4fd33b-7d70-466f-87d4-87c14e122527\") "
Jul 27 17:28:06.980231 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.980171    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mmtw\" (UniqueName: \"kubernetes.io/projected/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-kube-api-access-7mmtw\") pod \"5fc06110-0f2d-4c67-84a8-d76c4e56e98c\" (UID: \"5fc06110-0f2d-4c67-84a8-d76c4e56e98c\") "
Jul 27 17:28:06.980231 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.980209    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-bundle\") pod \"5fc06110-0f2d-4c67-84a8-d76c4e56e98c\" (UID: \"5fc06110-0f2d-4c67-84a8-d76c4e56e98c\") "
Jul 27 17:28:06.980388 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.980236    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed4fd33b-7d70-466f-87d4-87c14e122527-util\") pod \"ed4fd33b-7d70-466f-87d4-87c14e122527\" (UID: \"ed4fd33b-7d70-466f-87d4-87c14e122527\") "
Jul 27 17:28:06.980485 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.980443    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-util\") pod \"5fc06110-0f2d-4c67-84a8-d76c4e56e98c\" (UID: \"5fc06110-0f2d-4c67-84a8-d76c4e56e98c\") "
Jul 27 17:28:06.980805 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.980779    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed4fd33b-7d70-466f-87d4-87c14e122527-bundle" (OuterVolumeSpecName: "bundle") pod "ed4fd33b-7d70-466f-87d4-87c14e122527" (UID: "ed4fd33b-7d70-466f-87d4-87c14e122527"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:28:06.981213 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.981185    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-bundle" (OuterVolumeSpecName: "bundle") pod "5fc06110-0f2d-4c67-84a8-d76c4e56e98c" (UID: "5fc06110-0f2d-4c67-84a8-d76c4e56e98c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:28:06.982987 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.982943    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-kube-api-access-7mmtw" (OuterVolumeSpecName: "kube-api-access-7mmtw") pod "5fc06110-0f2d-4c67-84a8-d76c4e56e98c" (UID: "5fc06110-0f2d-4c67-84a8-d76c4e56e98c"). InnerVolumeSpecName "kube-api-access-7mmtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:28:06.982987 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.982946    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed4fd33b-7d70-466f-87d4-87c14e122527-kube-api-access-ggfm2" (OuterVolumeSpecName: "kube-api-access-ggfm2") pod "ed4fd33b-7d70-466f-87d4-87c14e122527" (UID: "ed4fd33b-7d70-466f-87d4-87c14e122527"). InnerVolumeSpecName "kube-api-access-ggfm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:28:06.986909 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.986854    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed4fd33b-7d70-466f-87d4-87c14e122527-util" (OuterVolumeSpecName: "util") pod "ed4fd33b-7d70-466f-87d4-87c14e122527" (UID: "ed4fd33b-7d70-466f-87d4-87c14e122527"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:28:06.988671 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:06.988639    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-util" (OuterVolumeSpecName: "util") pod "5fc06110-0f2d-4c67-84a8-d76c4e56e98c" (UID: "5fc06110-0f2d-4c67-84a8-d76c4e56e98c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:28:07.081738 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.081702    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-util\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:28:07.081738 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.081736    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed4fd33b-7d70-466f-87d4-87c14e122527-bundle\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:28:07.081738 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.081747    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggfm2\" (UniqueName: \"kubernetes.io/projected/ed4fd33b-7d70-466f-87d4-87c14e122527-kube-api-access-ggfm2\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:28:07.081979 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.081760    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mmtw\" (UniqueName: \"kubernetes.io/projected/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-kube-api-access-7mmtw\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:28:07.081979 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.081773    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5fc06110-0f2d-4c67-84a8-d76c4e56e98c-bundle\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:28:07.081979 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.081783    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed4fd33b-7d70-466f-87d4-87c14e122527-util\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:28:07.742481 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.742448    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn" event={"ID":"5fc06110-0f2d-4c67-84a8-d76c4e56e98c","Type":"ContainerDied","Data":"2257c852abda0428398fc2383fa66f8398608788052a9d272237dad24cc44d35"}
Jul 27 17:28:07.742481 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.742466    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn"
Jul 27 17:28:07.742958 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.742497    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2257c852abda0428398fc2383fa66f8398608788052a9d272237dad24cc44d35"
Jul 27 17:28:07.744501 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.744470    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls" event={"ID":"ed4fd33b-7d70-466f-87d4-87c14e122527","Type":"ContainerDied","Data":"74c386d66f8afc4b5a53409e86b2f4e55f414839fbd31349a298bba8ec5e9dd3"}
Jul 27 17:28:07.744684 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.744518    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74c386d66f8afc4b5a53409e86b2f4e55f414839fbd31349a298bba8ec5e9dd3"
Jul 27 17:28:07.744684 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.744481    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls"
Jul 27 17:28:07.746797 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.746773    2579 generic.go:356] "Generic (PLEG): container finished" podID="bbff31b6-96de-40f1-94b8-ca4841c3c9ba" containerID="ae76eade7f8edda320d33181d4fe4bb6a78122b3160aeb247c7570af2e472fc7" exitCode=0
Jul 27 17:28:07.746891 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.746851    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs" event={"ID":"bbff31b6-96de-40f1-94b8-ca4841c3c9ba","Type":"ContainerDied","Data":"ae76eade7f8edda320d33181d4fe4bb6a78122b3160aeb247c7570af2e472fc7"}
Jul 27 17:28:07.884056 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.884033    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98"
Jul 27 17:28:07.988067 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.988033    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjv7j\" (UniqueName: \"kubernetes.io/projected/00b83755-b21c-42d0-9e6b-b8431459ce5f-kube-api-access-bjv7j\") pod \"00b83755-b21c-42d0-9e6b-b8431459ce5f\" (UID: \"00b83755-b21c-42d0-9e6b-b8431459ce5f\") "
Jul 27 17:28:07.988067 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.988070    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00b83755-b21c-42d0-9e6b-b8431459ce5f-bundle\") pod \"00b83755-b21c-42d0-9e6b-b8431459ce5f\" (UID: \"00b83755-b21c-42d0-9e6b-b8431459ce5f\") "
Jul 27 17:28:07.988267 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.988123    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00b83755-b21c-42d0-9e6b-b8431459ce5f-util\") pod \"00b83755-b21c-42d0-9e6b-b8431459ce5f\" (UID: \"00b83755-b21c-42d0-9e6b-b8431459ce5f\") "
Jul 27 17:28:07.988612 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.988574    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00b83755-b21c-42d0-9e6b-b8431459ce5f-bundle" (OuterVolumeSpecName: "bundle") pod "00b83755-b21c-42d0-9e6b-b8431459ce5f" (UID: "00b83755-b21c-42d0-9e6b-b8431459ce5f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:28:07.990274 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.990245    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b83755-b21c-42d0-9e6b-b8431459ce5f-kube-api-access-bjv7j" (OuterVolumeSpecName: "kube-api-access-bjv7j") pod "00b83755-b21c-42d0-9e6b-b8431459ce5f" (UID: "00b83755-b21c-42d0-9e6b-b8431459ce5f"). InnerVolumeSpecName "kube-api-access-bjv7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:28:07.993919 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:07.993860    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00b83755-b21c-42d0-9e6b-b8431459ce5f-util" (OuterVolumeSpecName: "util") pod "00b83755-b21c-42d0-9e6b-b8431459ce5f" (UID: "00b83755-b21c-42d0-9e6b-b8431459ce5f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:28:08.088929 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:08.088892    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjv7j\" (UniqueName: \"kubernetes.io/projected/00b83755-b21c-42d0-9e6b-b8431459ce5f-kube-api-access-bjv7j\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:28:08.088929 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:08.088920    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00b83755-b21c-42d0-9e6b-b8431459ce5f-bundle\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:28:08.088929 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:08.088929    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00b83755-b21c-42d0-9e6b-b8431459ce5f-util\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:28:08.753510 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:08.753480    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98"
Jul 27 17:28:08.753510 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:08.753491    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98" event={"ID":"00b83755-b21c-42d0-9e6b-b8431459ce5f","Type":"ContainerDied","Data":"11f154d22936895b7e3d73e0412fa68140f39bf797af1b1a4dd4d5044f706dce"}
Jul 27 17:28:08.753918 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:08.753544    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11f154d22936895b7e3d73e0412fa68140f39bf797af1b1a4dd4d5044f706dce"
Jul 27 17:28:08.882038 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:08.882016    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs"
Jul 27 17:28:08.997252 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:08.997225    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-util\") pod \"bbff31b6-96de-40f1-94b8-ca4841c3c9ba\" (UID: \"bbff31b6-96de-40f1-94b8-ca4841c3c9ba\") "
Jul 27 17:28:08.997408 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:08.997263    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jspxd\" (UniqueName: \"kubernetes.io/projected/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-kube-api-access-jspxd\") pod \"bbff31b6-96de-40f1-94b8-ca4841c3c9ba\" (UID: \"bbff31b6-96de-40f1-94b8-ca4841c3c9ba\") "
Jul 27 17:28:08.997408 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:08.997293    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-bundle\") pod \"bbff31b6-96de-40f1-94b8-ca4841c3c9ba\" (UID: \"bbff31b6-96de-40f1-94b8-ca4841c3c9ba\") "
Jul 27 17:28:08.997847 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:08.997815    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-bundle" (OuterVolumeSpecName: "bundle") pod "bbff31b6-96de-40f1-94b8-ca4841c3c9ba" (UID: "bbff31b6-96de-40f1-94b8-ca4841c3c9ba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:28:08.999479 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:08.999446    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-kube-api-access-jspxd" (OuterVolumeSpecName: "kube-api-access-jspxd") pod "bbff31b6-96de-40f1-94b8-ca4841c3c9ba" (UID: "bbff31b6-96de-40f1-94b8-ca4841c3c9ba"). InnerVolumeSpecName "kube-api-access-jspxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:28:09.002044 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:09.002022    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-util" (OuterVolumeSpecName: "util") pod "bbff31b6-96de-40f1-94b8-ca4841c3c9ba" (UID: "bbff31b6-96de-40f1-94b8-ca4841c3c9ba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:28:09.098481 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:09.098450    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-util\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:28:09.098481 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:09.098480    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jspxd\" (UniqueName: \"kubernetes.io/projected/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-kube-api-access-jspxd\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:28:09.098672 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:09.098491    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbff31b6-96de-40f1-94b8-ca4841c3c9ba-bundle\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:28:09.759446 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:09.759381    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs" event={"ID":"bbff31b6-96de-40f1-94b8-ca4841c3c9ba","Type":"ContainerDied","Data":"5b21f2303d222a35b1b8fb78c4d70247706e368e2e41a9ac8e27625a6d5254f9"}
Jul 27 17:28:09.759446 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:09.759448    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b21f2303d222a35b1b8fb78c4d70247706e368e2e41a9ac8e27625a6d5254f9"
Jul 27 17:28:09.759982 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:09.759475    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs"
Jul 27 17:28:19.366727 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.366640    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"]
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.366909    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b83755-b21c-42d0-9e6b-b8431459ce5f" containerName="pull"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.366919    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b83755-b21c-42d0-9e6b-b8431459ce5f" containerName="pull"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.366928    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbff31b6-96de-40f1-94b8-ca4841c3c9ba" containerName="pull"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.366933    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbff31b6-96de-40f1-94b8-ca4841c3c9ba" containerName="pull"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.366941    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbff31b6-96de-40f1-94b8-ca4841c3c9ba" containerName="extract"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.366946    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbff31b6-96de-40f1-94b8-ca4841c3c9ba" containerName="extract"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.366953    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbff31b6-96de-40f1-94b8-ca4841c3c9ba" containerName="util"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.366958    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbff31b6-96de-40f1-94b8-ca4841c3c9ba" containerName="util"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.366970    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed4fd33b-7d70-466f-87d4-87c14e122527" containerName="util"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.366975    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed4fd33b-7d70-466f-87d4-87c14e122527" containerName="util"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.366980    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b83755-b21c-42d0-9e6b-b8431459ce5f" containerName="util"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.366986    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b83755-b21c-42d0-9e6b-b8431459ce5f" containerName="util"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.366991    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc06110-0f2d-4c67-84a8-d76c4e56e98c" containerName="util"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.366996    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc06110-0f2d-4c67-84a8-d76c4e56e98c" containerName="util"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.367002    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed4fd33b-7d70-466f-87d4-87c14e122527" containerName="pull"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.367007    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed4fd33b-7d70-466f-87d4-87c14e122527" containerName="pull"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.367015    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed4fd33b-7d70-466f-87d4-87c14e122527" containerName="extract"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.367019    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed4fd33b-7d70-466f-87d4-87c14e122527" containerName="extract"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.367025    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b83755-b21c-42d0-9e6b-b8431459ce5f" containerName="extract"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.367031    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b83755-b21c-42d0-9e6b-b8431459ce5f" containerName="extract"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.367037    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc06110-0f2d-4c67-84a8-d76c4e56e98c" containerName="extract"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.367042    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc06110-0f2d-4c67-84a8-d76c4e56e98c" containerName="extract"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.367048    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc06110-0f2d-4c67-84a8-d76c4e56e98c" containerName="pull"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.367053    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc06110-0f2d-4c67-84a8-d76c4e56e98c" containerName="pull"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.367097    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b83755-b21c-42d0-9e6b-b8431459ce5f" containerName="extract"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.367107    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed4fd33b-7d70-466f-87d4-87c14e122527" containerName="extract"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.367113    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fc06110-0f2d-4c67-84a8-d76c4e56e98c" containerName="extract"
Jul 27 17:28:19.367101 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.367118    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbff31b6-96de-40f1-94b8-ca4841c3c9ba" containerName="extract"
Jul 27 17:28:19.369878 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.369863    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:19.372102 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.372081    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sr86m\""
Jul 27 17:28:19.382791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.382769    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"]
Jul 27 17:28:19.478009 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.477973    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f65dc117-375e-4254-99e2-913f39fb25b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" (UID: \"f65dc117-375e-4254-99e2-913f39fb25b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:19.478199 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.478041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpqwz\" (UniqueName: \"kubernetes.io/projected/f65dc117-375e-4254-99e2-913f39fb25b8-kube-api-access-hpqwz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" (UID: \"f65dc117-375e-4254-99e2-913f39fb25b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:19.579074 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.579036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f65dc117-375e-4254-99e2-913f39fb25b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" (UID: \"f65dc117-375e-4254-99e2-913f39fb25b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:19.579235 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.579126    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpqwz\" (UniqueName: \"kubernetes.io/projected/f65dc117-375e-4254-99e2-913f39fb25b8-kube-api-access-hpqwz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" (UID: \"f65dc117-375e-4254-99e2-913f39fb25b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:19.579444 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.579406    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f65dc117-375e-4254-99e2-913f39fb25b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" (UID: \"f65dc117-375e-4254-99e2-913f39fb25b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:19.589693 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.589659    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpqwz\" (UniqueName: \"kubernetes.io/projected/f65dc117-375e-4254-99e2-913f39fb25b8-kube-api-access-hpqwz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" (UID: \"f65dc117-375e-4254-99e2-913f39fb25b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:19.679930 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.679835    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:19.820213 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:19.820183    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"]
Jul 27 17:28:19.824761 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:28:19.824737    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf65dc117_375e_4254_99e2_913f39fb25b8.slice/crio-710e2276643af31b004643c7a5d1099b8251671f37766216fb15eb00f5c2b480 WatchSource:0}: Error finding container 710e2276643af31b004643c7a5d1099b8251671f37766216fb15eb00f5c2b480: Status 404 returned error can't find the container with id 710e2276643af31b004643c7a5d1099b8251671f37766216fb15eb00f5c2b480
Jul 27 17:28:20.809546 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:20.809503    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw" event={"ID":"f65dc117-375e-4254-99e2-913f39fb25b8","Type":"ContainerStarted","Data":"710e2276643af31b004643c7a5d1099b8251671f37766216fb15eb00f5c2b480"}
Jul 27 17:28:22.038404 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:22.038370    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2646d"]
Jul 27 17:28:22.046729 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:22.046704    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2646d"
Jul 27 17:28:22.049008 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:22.048978    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dnj4w\""
Jul 27 17:28:22.054137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:22.054110    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2646d"]
Jul 27 17:28:22.098522 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:22.098484    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfqzp\" (UniqueName: \"kubernetes.io/projected/5fc3b099-dfac-4d28-b9f7-a4bed919814c-kube-api-access-tfqzp\") pod \"authorino-operator-75cc8d5cb7-2646d\" (UID: \"5fc3b099-dfac-4d28-b9f7-a4bed919814c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2646d"
Jul 27 17:28:22.199171 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:22.199131    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfqzp\" (UniqueName: \"kubernetes.io/projected/5fc3b099-dfac-4d28-b9f7-a4bed919814c-kube-api-access-tfqzp\") pod \"authorino-operator-75cc8d5cb7-2646d\" (UID: \"5fc3b099-dfac-4d28-b9f7-a4bed919814c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2646d"
Jul 27 17:28:22.207532 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:22.207498    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfqzp\" (UniqueName: \"kubernetes.io/projected/5fc3b099-dfac-4d28-b9f7-a4bed919814c-kube-api-access-tfqzp\") pod \"authorino-operator-75cc8d5cb7-2646d\" (UID: \"5fc3b099-dfac-4d28-b9f7-a4bed919814c\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2646d"
Jul 27 17:28:22.359356 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:22.359267    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2646d"
Jul 27 17:28:22.499090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:22.499026    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2646d"]
Jul 27 17:28:22.501664 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:28:22.501627    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc3b099_dfac_4d28_b9f7_a4bed919814c.slice/crio-409293c1c48d69bc00f8dca9e7f2cac2754d359e78e06080f4ba49a5cd10e5d9 WatchSource:0}: Error finding container 409293c1c48d69bc00f8dca9e7f2cac2754d359e78e06080f4ba49a5cd10e5d9: Status 404 returned error can't find the container with id 409293c1c48d69bc00f8dca9e7f2cac2754d359e78e06080f4ba49a5cd10e5d9
Jul 27 17:28:22.820876 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:22.820841    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2646d" event={"ID":"5fc3b099-dfac-4d28-b9f7-a4bed919814c","Type":"ContainerStarted","Data":"409293c1c48d69bc00f8dca9e7f2cac2754d359e78e06080f4ba49a5cd10e5d9"}
Jul 27 17:28:24.151126 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:24.151097    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"]
Jul 27 17:28:24.154753 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:24.154732    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:24.156949 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:24.156921    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qnhm9\""
Jul 27 17:28:24.165642 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:24.165619    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"]
Jul 27 17:28:24.216440 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:24.216375    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmjzr\" (UniqueName: \"kubernetes.io/projected/5c1c72fc-892d-4fd4-8fca-0d72cc81666c-kube-api-access-kmjzr\") pod \"limitador-operator-controller-manager-859d7b78bd-7gz8k\" (UID: \"5c1c72fc-892d-4fd4-8fca-0d72cc81666c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:24.317842 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:24.317807    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmjzr\" (UniqueName: \"kubernetes.io/projected/5c1c72fc-892d-4fd4-8fca-0d72cc81666c-kube-api-access-kmjzr\") pod \"limitador-operator-controller-manager-859d7b78bd-7gz8k\" (UID: \"5c1c72fc-892d-4fd4-8fca-0d72cc81666c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:24.329031 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:24.328999    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmjzr\" (UniqueName: \"kubernetes.io/projected/5c1c72fc-892d-4fd4-8fca-0d72cc81666c-kube-api-access-kmjzr\") pod \"limitador-operator-controller-manager-859d7b78bd-7gz8k\" (UID: \"5c1c72fc-892d-4fd4-8fca-0d72cc81666c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:24.467020 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:24.466940    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:26.254438 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:26.254394    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"]
Jul 27 17:28:26.256534 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:28:26.256508    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1c72fc_892d_4fd4_8fca_0d72cc81666c.slice/crio-b0de3e311f11b5fd9ee11deb50b2aa1bb3bfe08b1bdf34bf34bec3ef78683ca9 WatchSource:0}: Error finding container b0de3e311f11b5fd9ee11deb50b2aa1bb3bfe08b1bdf34bf34bec3ef78683ca9: Status 404 returned error can't find the container with id b0de3e311f11b5fd9ee11deb50b2aa1bb3bfe08b1bdf34bf34bec3ef78683ca9
Jul 27 17:28:26.662757 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:26.662720    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpcm4"]
Jul 27 17:28:26.666256 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:26.666235    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpcm4"
Jul 27 17:28:26.668292 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:26.668268    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 27 17:28:26.668491 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:26.668320    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-529bf\""
Jul 27 17:28:26.678210 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:26.678187    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpcm4"]
Jul 27 17:28:26.737409 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:26.737368    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwdjc\" (UniqueName: \"kubernetes.io/projected/9942cad9-6c09-4014-86de-fa51de1ca664-kube-api-access-pwdjc\") pod \"dns-operator-controller-manager-864dd78c4c-bpcm4\" (UID: \"9942cad9-6c09-4014-86de-fa51de1ca664\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpcm4"
Jul 27 17:28:26.838156 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:26.838106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwdjc\" (UniqueName: \"kubernetes.io/projected/9942cad9-6c09-4014-86de-fa51de1ca664-kube-api-access-pwdjc\") pod \"dns-operator-controller-manager-864dd78c4c-bpcm4\" (UID: \"9942cad9-6c09-4014-86de-fa51de1ca664\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpcm4"
Jul 27 17:28:26.844312 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:26.844270    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2646d" event={"ID":"5fc3b099-dfac-4d28-b9f7-a4bed919814c","Type":"ContainerStarted","Data":"8af78c58aa9c688203cb58ce322a48a848d3d5851d6204a93ee615f775268372"}
Jul 27 17:28:26.844517 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:26.844399    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2646d"
Jul 27 17:28:26.845584 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:26.845560    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k" event={"ID":"5c1c72fc-892d-4fd4-8fca-0d72cc81666c","Type":"ContainerStarted","Data":"b0de3e311f11b5fd9ee11deb50b2aa1bb3bfe08b1bdf34bf34bec3ef78683ca9"}
Jul 27 17:28:26.847090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:26.847067    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwdjc\" (UniqueName: \"kubernetes.io/projected/9942cad9-6c09-4014-86de-fa51de1ca664-kube-api-access-pwdjc\") pod \"dns-operator-controller-manager-864dd78c4c-bpcm4\" (UID: \"9942cad9-6c09-4014-86de-fa51de1ca664\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpcm4"
Jul 27 17:28:26.847298 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:26.847281    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw" event={"ID":"f65dc117-375e-4254-99e2-913f39fb25b8","Type":"ContainerStarted","Data":"4c406632ca206ae242f684c23455ea70db97060407ff2647ff8851c1d9f4cafc"}
Jul 27 17:28:26.847347 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:26.847334    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:26.861490 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:26.861413    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2646d" podStartSLOduration=1.254307052 podStartE2EDuration="4.86139873s" totalImagesPullingTime="3.607091678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:26.860063157 +0000 UTC m=+450.391814143" watchObservedRunningTime="2026-07-27 17:28:26.86139873 +0000 UTC m=+450.393149715"
Jul 27 17:28:26.886065 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:26.886013    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw" podStartSLOduration=1.584721193 podStartE2EDuration="7.885998314s" totalImagesPullingTime="6.301277121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:26.884839301 +0000 UTC m=+450.416590287" watchObservedRunningTime="2026-07-27 17:28:26.885998314 +0000 UTC m=+450.417749299"
Jul 27 17:28:26.978320 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:26.978240    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpcm4"
Jul 27 17:28:27.319770 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:27.319738    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpcm4"]
Jul 27 17:28:27.329338 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:28:27.329296    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9942cad9_6c09_4014_86de_fa51de1ca664.slice/crio-c546b9bf7890a41213fc27feba402c5b7c010d0725b0691fd5267f2f7052b7ca WatchSource:0}: Error finding container c546b9bf7890a41213fc27feba402c5b7c010d0725b0691fd5267f2f7052b7ca: Status 404 returned error can't find the container with id c546b9bf7890a41213fc27feba402c5b7c010d0725b0691fd5267f2f7052b7ca
Jul 27 17:28:27.852995 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:27.852956    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpcm4" event={"ID":"9942cad9-6c09-4014-86de-fa51de1ca664","Type":"ContainerStarted","Data":"c546b9bf7890a41213fc27feba402c5b7c010d0725b0691fd5267f2f7052b7ca"}
Jul 27 17:28:28.859805 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:28.859717    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k" event={"ID":"5c1c72fc-892d-4fd4-8fca-0d72cc81666c","Type":"ContainerStarted","Data":"9a9202b0e0cde3c1aa014212df0f035cdd17172143c473427445ab0d719b946e"}
Jul 27 17:28:28.860158 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:28.859822    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:28.880240 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:28.880190    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k" podStartSLOduration=2.595537482 podStartE2EDuration="4.880174119s" totalImagesPullingTime="2.284636637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:28.878340175 +0000 UTC m=+452.410091175" watchObservedRunningTime="2026-07-27 17:28:28.880174119 +0000 UTC m=+452.411925107"
Jul 27 17:28:29.146276 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.146197    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7w8kk"]
Jul 27 17:28:29.149536 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.149507    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7w8kk"
Jul 27 17:28:29.151654 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.151627    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 27 17:28:29.151767 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.151695    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 27 17:28:29.151767 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.151644    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-scg5l\""
Jul 27 17:28:29.159652 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.159627    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7w8kk"]
Jul 27 17:28:29.258637 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.258603    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e1e21d1-53da-40c1-b930-199a22d75aad-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7w8kk\" (UID: \"9e1e21d1-53da-40c1-b930-199a22d75aad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7w8kk"
Jul 27 17:28:29.258812 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.258658    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhtgg\" (UniqueName: \"kubernetes.io/projected/9e1e21d1-53da-40c1-b930-199a22d75aad-kube-api-access-vhtgg\") pod \"kuadrant-console-plugin-66b5774985-7w8kk\" (UID: \"9e1e21d1-53da-40c1-b930-199a22d75aad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7w8kk"
Jul 27 17:28:29.258812 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.258715    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9e1e21d1-53da-40c1-b930-199a22d75aad-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7w8kk\" (UID: \"9e1e21d1-53da-40c1-b930-199a22d75aad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7w8kk"
Jul 27 17:28:29.359156 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.359118    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhtgg\" (UniqueName: \"kubernetes.io/projected/9e1e21d1-53da-40c1-b930-199a22d75aad-kube-api-access-vhtgg\") pod \"kuadrant-console-plugin-66b5774985-7w8kk\" (UID: \"9e1e21d1-53da-40c1-b930-199a22d75aad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7w8kk"
Jul 27 17:28:29.359156 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.359158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9e1e21d1-53da-40c1-b930-199a22d75aad-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7w8kk\" (UID: \"9e1e21d1-53da-40c1-b930-199a22d75aad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7w8kk"
Jul 27 17:28:29.359399 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.359210    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e1e21d1-53da-40c1-b930-199a22d75aad-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7w8kk\" (UID: \"9e1e21d1-53da-40c1-b930-199a22d75aad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7w8kk"
Jul 27 17:28:29.359880 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.359854    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9e1e21d1-53da-40c1-b930-199a22d75aad-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7w8kk\" (UID: \"9e1e21d1-53da-40c1-b930-199a22d75aad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7w8kk"
Jul 27 17:28:29.361787 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.361767    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e1e21d1-53da-40c1-b930-199a22d75aad-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7w8kk\" (UID: \"9e1e21d1-53da-40c1-b930-199a22d75aad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7w8kk"
Jul 27 17:28:29.380161 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.380121    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhtgg\" (UniqueName: \"kubernetes.io/projected/9e1e21d1-53da-40c1-b930-199a22d75aad-kube-api-access-vhtgg\") pod \"kuadrant-console-plugin-66b5774985-7w8kk\" (UID: \"9e1e21d1-53da-40c1-b930-199a22d75aad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7w8kk"
Jul 27 17:28:29.460226 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.460120    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7w8kk"
Jul 27 17:28:29.606403 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.606376    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7w8kk"]
Jul 27 17:28:29.847573 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:28:29.847541    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e1e21d1_53da_40c1_b930_199a22d75aad.slice/crio-e78e693237368ea123ccbcc97da4a64889ca101bf03ba66cb25d8a46c6f1f81b WatchSource:0}: Error finding container e78e693237368ea123ccbcc97da4a64889ca101bf03ba66cb25d8a46c6f1f81b: Status 404 returned error can't find the container with id e78e693237368ea123ccbcc97da4a64889ca101bf03ba66cb25d8a46c6f1f81b
Jul 27 17:28:29.866186 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:29.866153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7w8kk" event={"ID":"9e1e21d1-53da-40c1-b930-199a22d75aad","Type":"ContainerStarted","Data":"e78e693237368ea123ccbcc97da4a64889ca101bf03ba66cb25d8a46c6f1f81b"}
Jul 27 17:28:30.872742 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:30.872710    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpcm4" event={"ID":"9942cad9-6c09-4014-86de-fa51de1ca664","Type":"ContainerStarted","Data":"b5021123a4ef2bb2dcbbc6956585fac767144a03479d2800bc4c7bce700ed2f3"}
Jul 27 17:28:30.873141 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:30.872799    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpcm4"
Jul 27 17:28:30.890494 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:30.890447    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpcm4" podStartSLOduration=2.323482484 podStartE2EDuration="4.890413991s" totalImagesPullingTime="2.566931507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:30.889491899 +0000 UTC m=+454.421242885" watchObservedRunningTime="2026-07-27 17:28:30.890413991 +0000 UTC m=+454.422164976"
Jul 27 17:28:37.855861 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:37.855830    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2646d"
Jul 27 17:28:37.856399 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:37.855913    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:39.521165 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.521133    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"]
Jul 27 17:28:39.521588 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.521322    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" containerName="manager" containerID="cri-o://4c406632ca206ae242f684c23455ea70db97060407ff2647ff8851c1d9f4cafc" gracePeriod=2
Jul 27 17:28:39.527999 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.527964    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"]
Jul 27 17:28:39.550939 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.550910    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"]
Jul 27 17:28:39.551138 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.551109    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k" podUID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" containerName="manager" containerID="cri-o://9a9202b0e0cde3c1aa014212df0f035cdd17172143c473427445ab0d719b946e" gracePeriod=2
Jul 27 17:28:39.553556 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.553482    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:39.556955 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.556846    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"]
Jul 27 17:28:39.559185 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:39.559149    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:39.560955 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:39.560923    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7gz8k\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:39.562730 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:39.562707    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:39.566242 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.566220    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"]
Jul 27 17:28:39.566532 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.566519    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" containerName="manager"
Jul 27 17:28:39.566578 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.566534    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" containerName="manager"
Jul 27 17:28:39.566578 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.566553    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" containerName="manager"
Jul 27 17:28:39.566578 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.566559    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" containerName="manager"
Jul 27 17:28:39.566669 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.566606    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" containerName="manager"
Jul 27 17:28:39.566669 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.566613    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" containerName="manager"
Jul 27 17:28:39.569674 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.569657    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"
Jul 27 17:28:39.572111 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:39.572082    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7gz8k\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:39.574239 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:39.574217    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:39.594998 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.594546    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-brf46"]
Jul 27 17:28:39.598656 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.598624    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"]
Jul 27 17:28:39.598778 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.598764    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-brf46"
Jul 27 17:28:39.618147 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.618105    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-brf46"]
Jul 27 17:28:39.638401 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:39.638363    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7gz8k\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:39.640530 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:39.640498    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:39.646454 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.646403    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttwp2\" (UniqueName: \"kubernetes.io/projected/9e6885e1-5c78-44aa-ba0a-fe2182c497d5-kube-api-access-ttwp2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9xmj8\" (UID: \"9e6885e1-5c78-44aa-ba0a-fe2182c497d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"
Jul 27 17:28:39.646584 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.646513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e6885e1-5c78-44aa-ba0a-fe2182c497d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9xmj8\" (UID: \"9e6885e1-5c78-44aa-ba0a-fe2182c497d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"
Jul 27 17:28:39.747060 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.747023    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z8df\" (UniqueName: \"kubernetes.io/projected/f7f4d213-3760-43ad-9673-e19e544df507-kube-api-access-8z8df\") pod \"limitador-operator-controller-manager-859d7b78bd-brf46\" (UID: \"f7f4d213-3760-43ad-9673-e19e544df507\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-brf46"
Jul 27 17:28:39.747222 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.747086    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttwp2\" (UniqueName: \"kubernetes.io/projected/9e6885e1-5c78-44aa-ba0a-fe2182c497d5-kube-api-access-ttwp2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9xmj8\" (UID: \"9e6885e1-5c78-44aa-ba0a-fe2182c497d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"
Jul 27 17:28:39.747222 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.747142    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e6885e1-5c78-44aa-ba0a-fe2182c497d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9xmj8\" (UID: \"9e6885e1-5c78-44aa-ba0a-fe2182c497d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"
Jul 27 17:28:39.747853 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.747827    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e6885e1-5c78-44aa-ba0a-fe2182c497d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9xmj8\" (UID: \"9e6885e1-5c78-44aa-ba0a-fe2182c497d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"
Jul 27 17:28:39.760730 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.760686    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttwp2\" (UniqueName: \"kubernetes.io/projected/9e6885e1-5c78-44aa-ba0a-fe2182c497d5-kube-api-access-ttwp2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9xmj8\" (UID: \"9e6885e1-5c78-44aa-ba0a-fe2182c497d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"
Jul 27 17:28:39.816136 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.816114    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:39.818130 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:39.818103    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:39.818325 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.818309    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:39.819721 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:39.819699    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7gz8k\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:39.821307 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:39.821288    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7gz8k\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:39.822697 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:39.822671    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:39.848067 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.848039    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z8df\" (UniqueName: \"kubernetes.io/projected/f7f4d213-3760-43ad-9673-e19e544df507-kube-api-access-8z8df\") pod \"limitador-operator-controller-manager-859d7b78bd-brf46\" (UID: \"f7f4d213-3760-43ad-9673-e19e544df507\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-brf46"
Jul 27 17:28:39.859854 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.859829    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z8df\" (UniqueName: \"kubernetes.io/projected/f7f4d213-3760-43ad-9673-e19e544df507-kube-api-access-8z8df\") pod \"limitador-operator-controller-manager-859d7b78bd-brf46\" (UID: \"f7f4d213-3760-43ad-9673-e19e544df507\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-brf46"
Jul 27 17:28:39.924479 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.924449    2579 generic.go:356] "Generic (PLEG): container finished" podID="f65dc117-375e-4254-99e2-913f39fb25b8" containerID="4c406632ca206ae242f684c23455ea70db97060407ff2647ff8851c1d9f4cafc" exitCode=0
Jul 27 17:28:39.924657 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.924487    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:39.924657 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.924524    2579 scope.go:117] "RemoveContainer" containerID="4c406632ca206ae242f684c23455ea70db97060407ff2647ff8851c1d9f4cafc"
Jul 27 17:28:39.926312 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.926284    2579 generic.go:356] "Generic (PLEG): container finished" podID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" containerID="9a9202b0e0cde3c1aa014212df0f035cdd17172143c473427445ab0d719b946e" exitCode=0
Jul 27 17:28:39.926458 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:39.926342    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7gz8k\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:39.926458 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.926391    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:39.927878 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:39.927853    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:39.929518 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:39.929488    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7gz8k\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:39.931059 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:39.931032    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:39.934794 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.934774    2579 scope.go:117] "RemoveContainer" containerID="4c406632ca206ae242f684c23455ea70db97060407ff2647ff8851c1d9f4cafc"
Jul 27 17:28:39.935247 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:39.935224    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c406632ca206ae242f684c23455ea70db97060407ff2647ff8851c1d9f4cafc\": container with ID starting with 4c406632ca206ae242f684c23455ea70db97060407ff2647ff8851c1d9f4cafc not found: ID does not exist" containerID="4c406632ca206ae242f684c23455ea70db97060407ff2647ff8851c1d9f4cafc"
Jul 27 17:28:39.935323 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.935257    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c406632ca206ae242f684c23455ea70db97060407ff2647ff8851c1d9f4cafc"} err="failed to get container status \"4c406632ca206ae242f684c23455ea70db97060407ff2647ff8851c1d9f4cafc\": rpc error: code = NotFound desc = could not find container \"4c406632ca206ae242f684c23455ea70db97060407ff2647ff8851c1d9f4cafc\": container with ID starting with 4c406632ca206ae242f684c23455ea70db97060407ff2647ff8851c1d9f4cafc not found: ID does not exist"
Jul 27 17:28:39.935323 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.935274    2579 scope.go:117] "RemoveContainer" containerID="9a9202b0e0cde3c1aa014212df0f035cdd17172143c473427445ab0d719b946e"
Jul 27 17:28:39.944601 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.944577    2579 scope.go:117] "RemoveContainer" containerID="9a9202b0e0cde3c1aa014212df0f035cdd17172143c473427445ab0d719b946e"
Jul 27 17:28:39.944896 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:39.944874    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a9202b0e0cde3c1aa014212df0f035cdd17172143c473427445ab0d719b946e\": container with ID starting with 9a9202b0e0cde3c1aa014212df0f035cdd17172143c473427445ab0d719b946e not found: ID does not exist" containerID="9a9202b0e0cde3c1aa014212df0f035cdd17172143c473427445ab0d719b946e"
Jul 27 17:28:39.944964 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.944908    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a9202b0e0cde3c1aa014212df0f035cdd17172143c473427445ab0d719b946e"} err="failed to get container status \"9a9202b0e0cde3c1aa014212df0f035cdd17172143c473427445ab0d719b946e\": rpc error: code = NotFound desc = could not find container \"9a9202b0e0cde3c1aa014212df0f035cdd17172143c473427445ab0d719b946e\": container with ID starting with 9a9202b0e0cde3c1aa014212df0f035cdd17172143c473427445ab0d719b946e not found: ID does not exist"
Jul 27 17:28:39.949285 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.949249    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpqwz\" (UniqueName: \"kubernetes.io/projected/f65dc117-375e-4254-99e2-913f39fb25b8-kube-api-access-hpqwz\") pod \"f65dc117-375e-4254-99e2-913f39fb25b8\" (UID: \"f65dc117-375e-4254-99e2-913f39fb25b8\") "
Jul 27 17:28:39.949367 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.949302    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f65dc117-375e-4254-99e2-913f39fb25b8-extensions-socket-volume\") pod \"f65dc117-375e-4254-99e2-913f39fb25b8\" (UID: \"f65dc117-375e-4254-99e2-913f39fb25b8\") "
Jul 27 17:28:39.949367 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.949330    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmjzr\" (UniqueName: \"kubernetes.io/projected/5c1c72fc-892d-4fd4-8fca-0d72cc81666c-kube-api-access-kmjzr\") pod \"5c1c72fc-892d-4fd4-8fca-0d72cc81666c\" (UID: \"5c1c72fc-892d-4fd4-8fca-0d72cc81666c\") "
Jul 27 17:28:39.949878 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.949837    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f65dc117-375e-4254-99e2-913f39fb25b8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f65dc117-375e-4254-99e2-913f39fb25b8" (UID: "f65dc117-375e-4254-99e2-913f39fb25b8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:28:39.951742 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.951720    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c1c72fc-892d-4fd4-8fca-0d72cc81666c-kube-api-access-kmjzr" (OuterVolumeSpecName: "kube-api-access-kmjzr") pod "5c1c72fc-892d-4fd4-8fca-0d72cc81666c" (UID: "5c1c72fc-892d-4fd4-8fca-0d72cc81666c"). InnerVolumeSpecName "kube-api-access-kmjzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:28:39.951855 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.951819    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f65dc117-375e-4254-99e2-913f39fb25b8-kube-api-access-hpqwz" (OuterVolumeSpecName: "kube-api-access-hpqwz") pod "f65dc117-375e-4254-99e2-913f39fb25b8" (UID: "f65dc117-375e-4254-99e2-913f39fb25b8"). InnerVolumeSpecName "kube-api-access-hpqwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:28:39.961020 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.960996    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"
Jul 27 17:28:39.968547 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:39.968521    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-brf46"
Jul 27 17:28:40.050667 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:40.050494    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpqwz\" (UniqueName: \"kubernetes.io/projected/f65dc117-375e-4254-99e2-913f39fb25b8-kube-api-access-hpqwz\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:28:40.050667 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:40.050528    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f65dc117-375e-4254-99e2-913f39fb25b8-extensions-socket-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:28:40.050667 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:40.050542    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmjzr\" (UniqueName: \"kubernetes.io/projected/5c1c72fc-892d-4fd4-8fca-0d72cc81666c-kube-api-access-kmjzr\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:28:40.125835 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:40.125803    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"]
Jul 27 17:28:40.128620 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:28:40.128594    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e6885e1_5c78_44aa_ba0a_fe2182c497d5.slice/crio-afc2c77d86a9010a9c933b9ac4721aca8283982ef8f83d7407ed0e8bba4f5dac WatchSource:0}: Error finding container afc2c77d86a9010a9c933b9ac4721aca8283982ef8f83d7407ed0e8bba4f5dac: Status 404 returned error can't find the container with id afc2c77d86a9010a9c933b9ac4721aca8283982ef8f83d7407ed0e8bba4f5dac
Jul 27 17:28:40.146499 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:40.146475    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-brf46"]
Jul 27 17:28:40.148482 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:28:40.148454    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f4d213_3760_43ad_9673_e19e544df507.slice/crio-2db956d297d8af3d3ea530301ddbd41918cb08ab74e2fd161dab523f2714301a WatchSource:0}: Error finding container 2db956d297d8af3d3ea530301ddbd41918cb08ab74e2fd161dab523f2714301a: Status 404 returned error can't find the container with id 2db956d297d8af3d3ea530301ddbd41918cb08ab74e2fd161dab523f2714301a
Jul 27 17:28:40.240627 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:40.240590    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7gz8k\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:40.241948 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:40.241915    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:40.243343 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:40.243314    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7gz8k\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:40.244576 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:40.244549    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:40.934938 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:40.934849    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-brf46" event={"ID":"f7f4d213-3760-43ad-9673-e19e544df507","Type":"ContainerStarted","Data":"c60f93a03a72f8bee5df1ca867dbe99bc2ff5ad99c5ce3c1c07797d825025d57"}
Jul 27 17:28:40.934938 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:40.934906    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-brf46" event={"ID":"f7f4d213-3760-43ad-9673-e19e544df507","Type":"ContainerStarted","Data":"2db956d297d8af3d3ea530301ddbd41918cb08ab74e2fd161dab523f2714301a"}
Jul 27 17:28:40.935476 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:40.934984    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-brf46"
Jul 27 17:28:40.936711 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:40.936679    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8" event={"ID":"9e6885e1-5c78-44aa-ba0a-fe2182c497d5","Type":"ContainerStarted","Data":"ea030f5c959149948edd6e2d8db566f45f2625e1f4b853b95e8c612c1fcc3b1c"}
Jul 27 17:28:40.936824 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:40.936730    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8" event={"ID":"9e6885e1-5c78-44aa-ba0a-fe2182c497d5","Type":"ContainerStarted","Data":"afc2c77d86a9010a9c933b9ac4721aca8283982ef8f83d7407ed0e8bba4f5dac"}
Jul 27 17:28:40.936824 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:40.936804    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"
Jul 27 17:28:40.950588 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:40.950543    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-brf46" podStartSLOduration=1.950529332 podStartE2EDuration="1.950529332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:40.949294184 +0000 UTC m=+464.481045336" watchObservedRunningTime="2026-07-27 17:28:40.950529332 +0000 UTC m=+464.482280317"
Jul 27 17:28:40.950757 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:40.950735    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7gz8k\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:40.952258 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:40.952232    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:40.953699 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:40.953671    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:40.981461 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:40.981398    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7gz8k\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:40.981903 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:40.981860    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8" podStartSLOduration=1.981840412 podStartE2EDuration="1.981840412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:40.979726169 +0000 UTC m=+464.511477168" watchObservedRunningTime="2026-07-27 17:28:40.981840412 +0000 UTC m=+464.513591399"
Jul 27 17:28:40.988390 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:40.988356    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"]
Jul 27 17:28:40.993513 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:40.993478    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"
Jul 27 17:28:40.995961 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:40.995923    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7gz8k\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7gz8k"
Jul 27 17:28:40.997565 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:28:40.997529    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-269hw\" is forbidden: User \"system:node:ip-10-0-128-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-74.ec2.internal' and this object" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-269hw"
Jul 27 17:28:41.001257 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:41.001229    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c1c72fc-892d-4fd4-8fca-0d72cc81666c" path="/var/lib/kubelet/pods/5c1c72fc-892d-4fd4-8fca-0d72cc81666c/volumes"
Jul 27 17:28:41.002190 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:41.001765    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f65dc117-375e-4254-99e2-913f39fb25b8" path="/var/lib/kubelet/pods/f65dc117-375e-4254-99e2-913f39fb25b8/volumes"
Jul 27 17:28:41.005729 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:41.005705    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"]
Jul 27 17:28:41.160305 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:41.160267    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lxbd\" (UniqueName: \"kubernetes.io/projected/2b64cab9-fe5c-496f-84a4-deef7885406d-kube-api-access-2lxbd\") pod \"kuadrant-operator-controller-manager-86878c769f-d88bf\" (UID: \"2b64cab9-fe5c-496f-84a4-deef7885406d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"
Jul 27 17:28:41.160509 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:41.160343    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b64cab9-fe5c-496f-84a4-deef7885406d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-d88bf\" (UID: \"2b64cab9-fe5c-496f-84a4-deef7885406d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"
Jul 27 17:28:41.261202 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:41.261120    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b64cab9-fe5c-496f-84a4-deef7885406d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-d88bf\" (UID: \"2b64cab9-fe5c-496f-84a4-deef7885406d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"
Jul 27 17:28:41.261367 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:41.261215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lxbd\" (UniqueName: \"kubernetes.io/projected/2b64cab9-fe5c-496f-84a4-deef7885406d-kube-api-access-2lxbd\") pod \"kuadrant-operator-controller-manager-86878c769f-d88bf\" (UID: \"2b64cab9-fe5c-496f-84a4-deef7885406d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"
Jul 27 17:28:41.261543 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:41.261514    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b64cab9-fe5c-496f-84a4-deef7885406d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-d88bf\" (UID: \"2b64cab9-fe5c-496f-84a4-deef7885406d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"
Jul 27 17:28:41.270777 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:41.270727    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lxbd\" (UniqueName: \"kubernetes.io/projected/2b64cab9-fe5c-496f-84a4-deef7885406d-kube-api-access-2lxbd\") pod \"kuadrant-operator-controller-manager-86878c769f-d88bf\" (UID: \"2b64cab9-fe5c-496f-84a4-deef7885406d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"
Jul 27 17:28:41.307300 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:41.307265    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"
Jul 27 17:28:41.881434 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:41.881387    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bpcm4"
Jul 27 17:28:51.946501 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:51.946465    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"
Jul 27 17:28:51.946851 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:51.946573    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-brf46"
Jul 27 17:28:55.679996 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:55.679969    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"]
Jul 27 17:28:55.682702 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:28:55.682678    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b64cab9_fe5c_496f_84a4_deef7885406d.slice/crio-25e01da53d5730b2850d637384bb6df15a52454359c8c9557682c5cec776a7dc WatchSource:0}: Error finding container 25e01da53d5730b2850d637384bb6df15a52454359c8c9557682c5cec776a7dc: Status 404 returned error can't find the container with id 25e01da53d5730b2850d637384bb6df15a52454359c8c9557682c5cec776a7dc
Jul 27 17:28:56.027151 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:56.027109    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7w8kk" event={"ID":"9e1e21d1-53da-40c1-b930-199a22d75aad","Type":"ContainerStarted","Data":"ef070105b0082741f52f2d7b6b102f77b79b47975704ea8e7d00da5b27757f83"}
Jul 27 17:28:56.028824 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:56.028786    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf" event={"ID":"2b64cab9-fe5c-496f-84a4-deef7885406d","Type":"ContainerStarted","Data":"0d1d31fbfe290077c82b899fac700fd642f2d21b81f2ba1b61c74f1cff98ccf4"}
Jul 27 17:28:56.028942 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:56.028839    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf" event={"ID":"2b64cab9-fe5c-496f-84a4-deef7885406d","Type":"ContainerStarted","Data":"25e01da53d5730b2850d637384bb6df15a52454359c8c9557682c5cec776a7dc"}
Jul 27 17:28:56.028942 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:56.028865    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"
Jul 27 17:28:56.048104 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:56.048057    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7w8kk" podStartSLOduration=1.275249506 podStartE2EDuration="27.048040225s" totalImagesPullingTime="25.772790719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:56.046722244 +0000 UTC m=+479.578473226" watchObservedRunningTime="2026-07-27 17:28:56.048040225 +0000 UTC m=+479.579791210"
Jul 27 17:28:56.067379 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:28:56.067329    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf" podStartSLOduration=16.067310792 podStartE2EDuration="16.067310792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:28:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:28:56.064948633 +0000 UTC m=+479.596699620" watchObservedRunningTime="2026-07-27 17:28:56.067310792 +0000 UTC m=+479.599061778"
Jul 27 17:29:07.036030 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:07.035997    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"
Jul 27 17:29:07.100554 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:07.100518    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"]
Jul 27 17:29:07.100844 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:07.100795    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8" podUID="9e6885e1-5c78-44aa-ba0a-fe2182c497d5" containerName="manager" containerID="cri-o://ea030f5c959149948edd6e2d8db566f45f2625e1f4b853b95e8c612c1fcc3b1c" gracePeriod=10
Jul 27 17:29:07.400139 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:07.400107    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"
Jul 27 17:29:07.478001 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:07.477973    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttwp2\" (UniqueName: \"kubernetes.io/projected/9e6885e1-5c78-44aa-ba0a-fe2182c497d5-kube-api-access-ttwp2\") pod \"9e6885e1-5c78-44aa-ba0a-fe2182c497d5\" (UID: \"9e6885e1-5c78-44aa-ba0a-fe2182c497d5\") "
Jul 27 17:29:07.478247 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:07.478039    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e6885e1-5c78-44aa-ba0a-fe2182c497d5-extensions-socket-volume\") pod \"9e6885e1-5c78-44aa-ba0a-fe2182c497d5\" (UID: \"9e6885e1-5c78-44aa-ba0a-fe2182c497d5\") "
Jul 27 17:29:07.478483 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:07.478454    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e6885e1-5c78-44aa-ba0a-fe2182c497d5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9e6885e1-5c78-44aa-ba0a-fe2182c497d5" (UID: "9e6885e1-5c78-44aa-ba0a-fe2182c497d5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:29:07.480386 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:07.480360    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e6885e1-5c78-44aa-ba0a-fe2182c497d5-kube-api-access-ttwp2" (OuterVolumeSpecName: "kube-api-access-ttwp2") pod "9e6885e1-5c78-44aa-ba0a-fe2182c497d5" (UID: "9e6885e1-5c78-44aa-ba0a-fe2182c497d5"). InnerVolumeSpecName "kube-api-access-ttwp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:29:07.578683 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:07.578601    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttwp2\" (UniqueName: \"kubernetes.io/projected/9e6885e1-5c78-44aa-ba0a-fe2182c497d5-kube-api-access-ttwp2\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:29:07.578683 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:07.578633    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e6885e1-5c78-44aa-ba0a-fe2182c497d5-extensions-socket-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:29:08.088620 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:08.088588    2579 generic.go:356] "Generic (PLEG): container finished" podID="9e6885e1-5c78-44aa-ba0a-fe2182c497d5" containerID="ea030f5c959149948edd6e2d8db566f45f2625e1f4b853b95e8c612c1fcc3b1c" exitCode=0
Jul 27 17:29:08.089129 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:08.088662    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"
Jul 27 17:29:08.089129 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:08.088667    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8" event={"ID":"9e6885e1-5c78-44aa-ba0a-fe2182c497d5","Type":"ContainerDied","Data":"ea030f5c959149948edd6e2d8db566f45f2625e1f4b853b95e8c612c1fcc3b1c"}
Jul 27 17:29:08.089129 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:08.088743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8" event={"ID":"9e6885e1-5c78-44aa-ba0a-fe2182c497d5","Type":"ContainerDied","Data":"afc2c77d86a9010a9c933b9ac4721aca8283982ef8f83d7407ed0e8bba4f5dac"}
Jul 27 17:29:08.089129 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:08.088765    2579 scope.go:117] "RemoveContainer" containerID="ea030f5c959149948edd6e2d8db566f45f2625e1f4b853b95e8c612c1fcc3b1c"
Jul 27 17:29:08.098566 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:08.098544    2579 scope.go:117] "RemoveContainer" containerID="ea030f5c959149948edd6e2d8db566f45f2625e1f4b853b95e8c612c1fcc3b1c"
Jul 27 17:29:08.098827 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:29:08.098807    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea030f5c959149948edd6e2d8db566f45f2625e1f4b853b95e8c612c1fcc3b1c\": container with ID starting with ea030f5c959149948edd6e2d8db566f45f2625e1f4b853b95e8c612c1fcc3b1c not found: ID does not exist" containerID="ea030f5c959149948edd6e2d8db566f45f2625e1f4b853b95e8c612c1fcc3b1c"
Jul 27 17:29:08.098890 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:08.098837    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea030f5c959149948edd6e2d8db566f45f2625e1f4b853b95e8c612c1fcc3b1c"} err="failed to get container status \"ea030f5c959149948edd6e2d8db566f45f2625e1f4b853b95e8c612c1fcc3b1c\": rpc error: code = NotFound desc = could not find container \"ea030f5c959149948edd6e2d8db566f45f2625e1f4b853b95e8c612c1fcc3b1c\": container with ID starting with ea030f5c959149948edd6e2d8db566f45f2625e1f4b853b95e8c612c1fcc3b1c not found: ID does not exist"
Jul 27 17:29:08.114546 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:08.114518    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"]
Jul 27 17:29:08.119473 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:08.119449    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xmj8"]
Jul 27 17:29:08.992717 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:08.992686    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e6885e1-5c78-44aa-ba0a-fe2182c497d5" path="/var/lib/kubelet/pods/9e6885e1-5c78-44aa-ba0a-fe2182c497d5/volumes"
Jul 27 17:29:23.405768 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.405735    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"]
Jul 27 17:29:23.406125 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.406044    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e6885e1-5c78-44aa-ba0a-fe2182c497d5" containerName="manager"
Jul 27 17:29:23.406125 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.406053    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e6885e1-5c78-44aa-ba0a-fe2182c497d5" containerName="manager"
Jul 27 17:29:23.406125 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.406107    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e6885e1-5c78-44aa-ba0a-fe2182c497d5" containerName="manager"
Jul 27 17:29:23.409081 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.409062    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.412631 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.412603    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-nvwhl\""
Jul 27 17:29:23.412766 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.412608    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 17:29:23.423365 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.423340    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"]
Jul 27 17:29:23.501765 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.501733    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/786cec5a-444f-47f9-9363-2fda57df5799-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.501765 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.501769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldsp2\" (UniqueName: \"kubernetes.io/projected/786cec5a-444f-47f9-9363-2fda57df5799-kube-api-access-ldsp2\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.502038 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.501795    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/786cec5a-444f-47f9-9363-2fda57df5799-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.502038 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.501891    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/786cec5a-444f-47f9-9363-2fda57df5799-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.502038 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.501939    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/786cec5a-444f-47f9-9363-2fda57df5799-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.502038 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.501991    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/786cec5a-444f-47f9-9363-2fda57df5799-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.502214 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.502039    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/786cec5a-444f-47f9-9363-2fda57df5799-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.502214 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.502072    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/786cec5a-444f-47f9-9363-2fda57df5799-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.502214 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.502102    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/786cec5a-444f-47f9-9363-2fda57df5799-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.603131 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.603092    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/786cec5a-444f-47f9-9363-2fda57df5799-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.603131 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.603131    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldsp2\" (UniqueName: \"kubernetes.io/projected/786cec5a-444f-47f9-9363-2fda57df5799-kube-api-access-ldsp2\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.603384 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.603155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/786cec5a-444f-47f9-9363-2fda57df5799-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.603384 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.603194    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/786cec5a-444f-47f9-9363-2fda57df5799-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.603384 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.603219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/786cec5a-444f-47f9-9363-2fda57df5799-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.603384 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.603268    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/786cec5a-444f-47f9-9363-2fda57df5799-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.603384 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.603298    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/786cec5a-444f-47f9-9363-2fda57df5799-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.603384 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.603324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/786cec5a-444f-47f9-9363-2fda57df5799-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.603384 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.603355    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/786cec5a-444f-47f9-9363-2fda57df5799-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.603755 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.603665    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/786cec5a-444f-47f9-9363-2fda57df5799-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.603755 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.603688    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/786cec5a-444f-47f9-9363-2fda57df5799-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.603856 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.603772    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/786cec5a-444f-47f9-9363-2fda57df5799-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.603856 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.603796    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/786cec5a-444f-47f9-9363-2fda57df5799-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.604079 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.604060    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/786cec5a-444f-47f9-9363-2fda57df5799-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.605841 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.605815    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/786cec5a-444f-47f9-9363-2fda57df5799-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.605998 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.605975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/786cec5a-444f-47f9-9363-2fda57df5799-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.613315 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.613278    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldsp2\" (UniqueName: \"kubernetes.io/projected/786cec5a-444f-47f9-9363-2fda57df5799-kube-api-access-ldsp2\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.614011 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.613989    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/786cec5a-444f-47f9-9363-2fda57df5799-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vxlln\" (UID: \"786cec5a-444f-47f9-9363-2fda57df5799\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.719642 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.719517    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:23.875865 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.875832    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"]
Jul 27 17:29:23.880895 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:29:23.880871    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod786cec5a_444f_47f9_9363_2fda57df5799.slice/crio-df0268ed73f9f94e1b7c0260aa8943f77990d8b0b318ee3838a80610645c7272 WatchSource:0}: Error finding container df0268ed73f9f94e1b7c0260aa8943f77990d8b0b318ee3838a80610645c7272: Status 404 returned error can't find the container with id df0268ed73f9f94e1b7c0260aa8943f77990d8b0b318ee3838a80610645c7272
Jul 27 17:29:23.882890 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.882861    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:29:23.882986 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.882921    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:29:23.882986 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:23.882950    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:29:24.174738 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:24.174702    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln" event={"ID":"786cec5a-444f-47f9-9363-2fda57df5799","Type":"ContainerStarted","Data":"9f8ccc787628b3bc6ed5b9cb1a2c1970a2d5caf3573dbe224f344f7fd692fc35"}
Jul 27 17:29:24.174932 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:24.174761    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln" event={"ID":"786cec5a-444f-47f9-9363-2fda57df5799","Type":"ContainerStarted","Data":"df0268ed73f9f94e1b7c0260aa8943f77990d8b0b318ee3838a80610645c7272"}
Jul 27 17:29:24.196538 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:24.196487    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln" podStartSLOduration=1.196448807 podStartE2EDuration="1.196448807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:24.19605277 +0000 UTC m=+507.727803757" watchObservedRunningTime="2026-07-27 17:29:24.196448807 +0000 UTC m=+507.728199797"
Jul 27 17:29:24.719692 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:24.719656    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:24.724733 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:24.724709    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:25.180346 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:25.180314    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:25.181192 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:25.181176    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:29:25.249379 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:25.249353    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qcspq"]
Jul 27 17:29:25.282568 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:25.282532    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qcspq"]
Jul 27 17:29:25.282719 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:25.282624    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq"
Jul 27 17:29:25.284855 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:25.284838    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 17:29:25.318051 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:25.318021    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc5xt\" (UniqueName: \"kubernetes.io/projected/ad85f595-8f35-428e-8e45-8b47d7c5f3f5-kube-api-access-zc5xt\") pod \"limitador-limitador-64c94fd64f-qcspq\" (UID: \"ad85f595-8f35-428e-8e45-8b47d7c5f3f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq"
Jul 27 17:29:25.318210 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:25.318097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad85f595-8f35-428e-8e45-8b47d7c5f3f5-config-file\") pod \"limitador-limitador-64c94fd64f-qcspq\" (UID: \"ad85f595-8f35-428e-8e45-8b47d7c5f3f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq"
Jul 27 17:29:25.345532 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:25.345501    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qcspq"]
Jul 27 17:29:25.418635 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:25.418601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad85f595-8f35-428e-8e45-8b47d7c5f3f5-config-file\") pod \"limitador-limitador-64c94fd64f-qcspq\" (UID: \"ad85f595-8f35-428e-8e45-8b47d7c5f3f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq"
Jul 27 17:29:25.418807 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:25.418644    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc5xt\" (UniqueName: \"kubernetes.io/projected/ad85f595-8f35-428e-8e45-8b47d7c5f3f5-kube-api-access-zc5xt\") pod \"limitador-limitador-64c94fd64f-qcspq\" (UID: \"ad85f595-8f35-428e-8e45-8b47d7c5f3f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq"
Jul 27 17:29:25.419225 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:25.419204    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad85f595-8f35-428e-8e45-8b47d7c5f3f5-config-file\") pod \"limitador-limitador-64c94fd64f-qcspq\" (UID: \"ad85f595-8f35-428e-8e45-8b47d7c5f3f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq"
Jul 27 17:29:25.428250 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:25.428224    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc5xt\" (UniqueName: \"kubernetes.io/projected/ad85f595-8f35-428e-8e45-8b47d7c5f3f5-kube-api-access-zc5xt\") pod \"limitador-limitador-64c94fd64f-qcspq\" (UID: \"ad85f595-8f35-428e-8e45-8b47d7c5f3f5\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq"
Jul 27 17:29:25.594031 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:25.593993    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq"
Jul 27 17:29:25.730731 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:25.730701    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qcspq"]
Jul 27 17:29:25.732831 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:29:25.732807    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad85f595_8f35_428e_8e45_8b47d7c5f3f5.slice/crio-75ad151db0244e43b6a3b9ab73f5e44c1e0aaee0cda93da981004587ed2d8b64 WatchSource:0}: Error finding container 75ad151db0244e43b6a3b9ab73f5e44c1e0aaee0cda93da981004587ed2d8b64: Status 404 returned error can't find the container with id 75ad151db0244e43b6a3b9ab73f5e44c1e0aaee0cda93da981004587ed2d8b64
Jul 27 17:29:26.186214 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:26.186182    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq" event={"ID":"ad85f595-8f35-428e-8e45-8b47d7c5f3f5","Type":"ContainerStarted","Data":"75ad151db0244e43b6a3b9ab73f5e44c1e0aaee0cda93da981004587ed2d8b64"}
Jul 27 17:29:26.273699 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:26.273665    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-d2fg4"]
Jul 27 17:29:26.278684 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:26.278666    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d2fg4"
Jul 27 17:29:26.280706 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:26.280690    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-428tm\""
Jul 27 17:29:26.286960 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:26.286937    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d2fg4"]
Jul 27 17:29:26.325451 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:26.325406    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvxtw\" (UniqueName: \"kubernetes.io/projected/dc2dcdf6-1074-4523-94a6-c59b9cab42de-kube-api-access-bvxtw\") pod \"authorino-75d556bd77-d2fg4\" (UID: \"dc2dcdf6-1074-4523-94a6-c59b9cab42de\") " pod="kuadrant-system/authorino-75d556bd77-d2fg4"
Jul 27 17:29:26.425932 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:26.425897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvxtw\" (UniqueName: \"kubernetes.io/projected/dc2dcdf6-1074-4523-94a6-c59b9cab42de-kube-api-access-bvxtw\") pod \"authorino-75d556bd77-d2fg4\" (UID: \"dc2dcdf6-1074-4523-94a6-c59b9cab42de\") " pod="kuadrant-system/authorino-75d556bd77-d2fg4"
Jul 27 17:29:26.435053 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:26.435024    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvxtw\" (UniqueName: \"kubernetes.io/projected/dc2dcdf6-1074-4523-94a6-c59b9cab42de-kube-api-access-bvxtw\") pod \"authorino-75d556bd77-d2fg4\" (UID: \"dc2dcdf6-1074-4523-94a6-c59b9cab42de\") " pod="kuadrant-system/authorino-75d556bd77-d2fg4"
Jul 27 17:29:26.589703 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:26.589654    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d2fg4"
Jul 27 17:29:26.770791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:26.770473    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d2fg4"]
Jul 27 17:29:26.772994 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:29:26.772894    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc2dcdf6_1074_4523_94a6_c59b9cab42de.slice/crio-70d9e329b36776fef420f9e5b776d8cee40699577f32159fe84837ae0b71319f WatchSource:0}: Error finding container 70d9e329b36776fef420f9e5b776d8cee40699577f32159fe84837ae0b71319f: Status 404 returned error can't find the container with id 70d9e329b36776fef420f9e5b776d8cee40699577f32159fe84837ae0b71319f
Jul 27 17:29:27.195603 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:27.195560    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d2fg4" event={"ID":"dc2dcdf6-1074-4523-94a6-c59b9cab42de","Type":"ContainerStarted","Data":"70d9e329b36776fef420f9e5b776d8cee40699577f32159fe84837ae0b71319f"}
Jul 27 17:29:29.211009 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:29.210935    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq" event={"ID":"ad85f595-8f35-428e-8e45-8b47d7c5f3f5","Type":"ContainerStarted","Data":"0c84ef2a33f3793fb6e72d3d660599f4cb6ec363e64413e0cf51a86d62f9971b"}
Jul 27 17:29:29.211510 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:29.211321    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq"
Jul 27 17:29:29.233870 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:29.233809    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq" podStartSLOduration=1.4776534190000001 podStartE2EDuration="4.233788635s" totalImagesPullingTime="2.756135216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:29.231113567 +0000 UTC m=+512.762864565" watchObservedRunningTime="2026-07-27 17:29:29.233788635 +0000 UTC m=+512.765539622"
Jul 27 17:29:32.229398 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:32.229361    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d2fg4" event={"ID":"dc2dcdf6-1074-4523-94a6-c59b9cab42de","Type":"ContainerStarted","Data":"402fbff12c258b627662e65f6b19151551a3e750722410a535cc0353368654a5"}
Jul 27 17:29:32.245870 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:32.245824    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-d2fg4" podStartSLOduration=1.813640365 podStartE2EDuration="6.245810323s" totalImagesPullingTime="4.432169958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:32.243210868 +0000 UTC m=+515.774961854" watchObservedRunningTime="2026-07-27 17:29:32.245810323 +0000 UTC m=+515.777561308"
Jul 27 17:29:40.218177 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:40.218144    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq"
Jul 27 17:29:43.551250 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:43.551218    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qcspq"]
Jul 27 17:29:43.551686 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:43.551399    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq" podUID="ad85f595-8f35-428e-8e45-8b47d7c5f3f5" containerName="limitador" containerID="cri-o://0c84ef2a33f3793fb6e72d3d660599f4cb6ec363e64413e0cf51a86d62f9971b" gracePeriod=30
Jul 27 17:29:44.101335 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:44.101313    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq"
Jul 27 17:29:44.179560 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:44.179479    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc5xt\" (UniqueName: \"kubernetes.io/projected/ad85f595-8f35-428e-8e45-8b47d7c5f3f5-kube-api-access-zc5xt\") pod \"ad85f595-8f35-428e-8e45-8b47d7c5f3f5\" (UID: \"ad85f595-8f35-428e-8e45-8b47d7c5f3f5\") "
Jul 27 17:29:44.179560 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:44.179532    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad85f595-8f35-428e-8e45-8b47d7c5f3f5-config-file\") pod \"ad85f595-8f35-428e-8e45-8b47d7c5f3f5\" (UID: \"ad85f595-8f35-428e-8e45-8b47d7c5f3f5\") "
Jul 27 17:29:44.179885 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:44.179860    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad85f595-8f35-428e-8e45-8b47d7c5f3f5-config-file" (OuterVolumeSpecName: "config-file") pod "ad85f595-8f35-428e-8e45-8b47d7c5f3f5" (UID: "ad85f595-8f35-428e-8e45-8b47d7c5f3f5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:29:44.181676 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:44.181655    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad85f595-8f35-428e-8e45-8b47d7c5f3f5-kube-api-access-zc5xt" (OuterVolumeSpecName: "kube-api-access-zc5xt") pod "ad85f595-8f35-428e-8e45-8b47d7c5f3f5" (UID: "ad85f595-8f35-428e-8e45-8b47d7c5f3f5"). InnerVolumeSpecName "kube-api-access-zc5xt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:29:44.280315 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:44.280286    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc5xt\" (UniqueName: \"kubernetes.io/projected/ad85f595-8f35-428e-8e45-8b47d7c5f3f5-kube-api-access-zc5xt\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:29:44.280315 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:44.280310    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ad85f595-8f35-428e-8e45-8b47d7c5f3f5-config-file\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:29:44.290738 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:44.290712    2579 generic.go:356] "Generic (PLEG): container finished" podID="ad85f595-8f35-428e-8e45-8b47d7c5f3f5" containerID="0c84ef2a33f3793fb6e72d3d660599f4cb6ec363e64413e0cf51a86d62f9971b" exitCode=0
Jul 27 17:29:44.290868 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:44.290760    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq" event={"ID":"ad85f595-8f35-428e-8e45-8b47d7c5f3f5","Type":"ContainerDied","Data":"0c84ef2a33f3793fb6e72d3d660599f4cb6ec363e64413e0cf51a86d62f9971b"}
Jul 27 17:29:44.290868 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:44.290766    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq"
Jul 27 17:29:44.290868 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:44.290802    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcspq" event={"ID":"ad85f595-8f35-428e-8e45-8b47d7c5f3f5","Type":"ContainerDied","Data":"75ad151db0244e43b6a3b9ab73f5e44c1e0aaee0cda93da981004587ed2d8b64"}
Jul 27 17:29:44.290868 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:44.290827    2579 scope.go:117] "RemoveContainer" containerID="0c84ef2a33f3793fb6e72d3d660599f4cb6ec363e64413e0cf51a86d62f9971b"
Jul 27 17:29:44.299554 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:44.299536    2579 scope.go:117] "RemoveContainer" containerID="0c84ef2a33f3793fb6e72d3d660599f4cb6ec363e64413e0cf51a86d62f9971b"
Jul 27 17:29:44.299827 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:29:44.299803    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c84ef2a33f3793fb6e72d3d660599f4cb6ec363e64413e0cf51a86d62f9971b\": container with ID starting with 0c84ef2a33f3793fb6e72d3d660599f4cb6ec363e64413e0cf51a86d62f9971b not found: ID does not exist" containerID="0c84ef2a33f3793fb6e72d3d660599f4cb6ec363e64413e0cf51a86d62f9971b"
Jul 27 17:29:44.299925 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:44.299833    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c84ef2a33f3793fb6e72d3d660599f4cb6ec363e64413e0cf51a86d62f9971b"} err="failed to get container status \"0c84ef2a33f3793fb6e72d3d660599f4cb6ec363e64413e0cf51a86d62f9971b\": rpc error: code = NotFound desc = could not find container \"0c84ef2a33f3793fb6e72d3d660599f4cb6ec363e64413e0cf51a86d62f9971b\": container with ID starting with 0c84ef2a33f3793fb6e72d3d660599f4cb6ec363e64413e0cf51a86d62f9971b not found: ID does not exist"
Jul 27 17:29:44.312875 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:44.312852    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qcspq"]
Jul 27 17:29:44.316133 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:44.316114    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qcspq"]
Jul 27 17:29:44.992786 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:44.992752    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad85f595-8f35-428e-8e45-8b47d7c5f3f5" path="/var/lib/kubelet/pods/ad85f595-8f35-428e-8e45-8b47d7c5f3f5/volumes"
Jul 27 17:29:46.768429 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:46.768383    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dv8nt"]
Jul 27 17:29:46.768793 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:46.768740    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad85f595-8f35-428e-8e45-8b47d7c5f3f5" containerName="limitador"
Jul 27 17:29:46.768793 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:46.768755    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad85f595-8f35-428e-8e45-8b47d7c5f3f5" containerName="limitador"
Jul 27 17:29:46.768878 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:46.768835    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad85f595-8f35-428e-8e45-8b47d7c5f3f5" containerName="limitador"
Jul 27 17:29:46.773449 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:46.773408    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv8nt"
Jul 27 17:29:46.775991 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:46.775971    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 27 17:29:46.776250 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:46.776232    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-tsqhs\""
Jul 27 17:29:46.776323 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:46.776261    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 17:29:46.776323 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:46.776305    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 17:29:46.787283 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:46.787263    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dv8nt"]
Jul 27 17:29:46.900465 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:46.900389    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/27c22213-503f-40d9-9f26-861b818290d3-data\") pod \"postgres-69fb4594cf-dv8nt\" (UID: \"27c22213-503f-40d9-9f26-861b818290d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv8nt"
Jul 27 17:29:46.900642 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:46.900544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8446f\" (UniqueName: \"kubernetes.io/projected/27c22213-503f-40d9-9f26-861b818290d3-kube-api-access-8446f\") pod \"postgres-69fb4594cf-dv8nt\" (UID: \"27c22213-503f-40d9-9f26-861b818290d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv8nt"
Jul 27 17:29:47.001819 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:47.001740    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8446f\" (UniqueName: \"kubernetes.io/projected/27c22213-503f-40d9-9f26-861b818290d3-kube-api-access-8446f\") pod \"postgres-69fb4594cf-dv8nt\" (UID: \"27c22213-503f-40d9-9f26-861b818290d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv8nt"
Jul 27 17:29:47.001819 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:47.001805    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/27c22213-503f-40d9-9f26-861b818290d3-data\") pod \"postgres-69fb4594cf-dv8nt\" (UID: \"27c22213-503f-40d9-9f26-861b818290d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv8nt"
Jul 27 17:29:47.002122 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:47.002106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/27c22213-503f-40d9-9f26-861b818290d3-data\") pod \"postgres-69fb4594cf-dv8nt\" (UID: \"27c22213-503f-40d9-9f26-861b818290d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv8nt"
Jul 27 17:29:47.017200 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:47.017177    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8446f\" (UniqueName: \"kubernetes.io/projected/27c22213-503f-40d9-9f26-861b818290d3-kube-api-access-8446f\") pod \"postgres-69fb4594cf-dv8nt\" (UID: \"27c22213-503f-40d9-9f26-861b818290d3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv8nt"
Jul 27 17:29:47.083464 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:47.083437    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv8nt"
Jul 27 17:29:47.215718 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:47.215680    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-dv8nt"]
Jul 27 17:29:47.217772 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:29:47.217747    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c22213_503f_40d9_9f26_861b818290d3.slice/crio-7c09dc37c2fb40208c5cd35b0054ae0d48c6f9b6da60500eda2399f97e8fbfea WatchSource:0}: Error finding container 7c09dc37c2fb40208c5cd35b0054ae0d48c6f9b6da60500eda2399f97e8fbfea: Status 404 returned error can't find the container with id 7c09dc37c2fb40208c5cd35b0054ae0d48c6f9b6da60500eda2399f97e8fbfea
Jul 27 17:29:47.311439 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:47.311380    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv8nt" event={"ID":"27c22213-503f-40d9-9f26-861b818290d3","Type":"ContainerStarted","Data":"7c09dc37c2fb40208c5cd35b0054ae0d48c6f9b6da60500eda2399f97e8fbfea"}
Jul 27 17:29:52.344603 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:52.344569    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv8nt" event={"ID":"27c22213-503f-40d9-9f26-861b818290d3","Type":"ContainerStarted","Data":"167bc1dac51485bd5ca292bbf97d71051419791f9fc15a4a87d744ed86ec751a"}
Jul 27 17:29:52.345078 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:52.344697    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv8nt"
Jul 27 17:29:52.363134 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:52.363088    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv8nt" podStartSLOduration=1.420286215 podStartE2EDuration="6.363075059s" totalImagesPullingTime="4.942788844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:29:52.361089426 +0000 UTC m=+535.892840412" watchObservedRunningTime="2026-07-27 17:29:52.363075059 +0000 UTC m=+535.894826044"
Jul 27 17:29:58.378078 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:29:58.378050    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-dv8nt"
Jul 27 17:30:00.677525 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:00.677491    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d2fg4"]
Jul 27 17:30:00.677942 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:00.677678    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-d2fg4" podUID="dc2dcdf6-1074-4523-94a6-c59b9cab42de" containerName="authorino" containerID="cri-o://402fbff12c258b627662e65f6b19151551a3e750722410a535cc0353368654a5" gracePeriod=30
Jul 27 17:30:00.931380 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:00.931321    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d2fg4"
Jul 27 17:30:01.127228 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:01.127189    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvxtw\" (UniqueName: \"kubernetes.io/projected/dc2dcdf6-1074-4523-94a6-c59b9cab42de-kube-api-access-bvxtw\") pod \"dc2dcdf6-1074-4523-94a6-c59b9cab42de\" (UID: \"dc2dcdf6-1074-4523-94a6-c59b9cab42de\") "
Jul 27 17:30:01.129586 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:01.129555    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc2dcdf6-1074-4523-94a6-c59b9cab42de-kube-api-access-bvxtw" (OuterVolumeSpecName: "kube-api-access-bvxtw") pod "dc2dcdf6-1074-4523-94a6-c59b9cab42de" (UID: "dc2dcdf6-1074-4523-94a6-c59b9cab42de"). InnerVolumeSpecName "kube-api-access-bvxtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:30:01.228075 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:01.228004    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvxtw\" (UniqueName: \"kubernetes.io/projected/dc2dcdf6-1074-4523-94a6-c59b9cab42de-kube-api-access-bvxtw\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:30:01.391610 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:01.391579    2579 generic.go:356] "Generic (PLEG): container finished" podID="dc2dcdf6-1074-4523-94a6-c59b9cab42de" containerID="402fbff12c258b627662e65f6b19151551a3e750722410a535cc0353368654a5" exitCode=0
Jul 27 17:30:01.391757 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:01.391620    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d2fg4"
Jul 27 17:30:01.391757 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:01.391630    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d2fg4" event={"ID":"dc2dcdf6-1074-4523-94a6-c59b9cab42de","Type":"ContainerDied","Data":"402fbff12c258b627662e65f6b19151551a3e750722410a535cc0353368654a5"}
Jul 27 17:30:01.391757 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:01.391660    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d2fg4" event={"ID":"dc2dcdf6-1074-4523-94a6-c59b9cab42de","Type":"ContainerDied","Data":"70d9e329b36776fef420f9e5b776d8cee40699577f32159fe84837ae0b71319f"}
Jul 27 17:30:01.391757 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:01.391676    2579 scope.go:117] "RemoveContainer" containerID="402fbff12c258b627662e65f6b19151551a3e750722410a535cc0353368654a5"
Jul 27 17:30:01.400630 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:01.400613    2579 scope.go:117] "RemoveContainer" containerID="402fbff12c258b627662e65f6b19151551a3e750722410a535cc0353368654a5"
Jul 27 17:30:01.400913 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:30:01.400887    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"402fbff12c258b627662e65f6b19151551a3e750722410a535cc0353368654a5\": container with ID starting with 402fbff12c258b627662e65f6b19151551a3e750722410a535cc0353368654a5 not found: ID does not exist" containerID="402fbff12c258b627662e65f6b19151551a3e750722410a535cc0353368654a5"
Jul 27 17:30:01.401006 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:01.400921    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"402fbff12c258b627662e65f6b19151551a3e750722410a535cc0353368654a5"} err="failed to get container status \"402fbff12c258b627662e65f6b19151551a3e750722410a535cc0353368654a5\": rpc error: code = NotFound desc = could not find container \"402fbff12c258b627662e65f6b19151551a3e750722410a535cc0353368654a5\": container with ID starting with 402fbff12c258b627662e65f6b19151551a3e750722410a535cc0353368654a5 not found: ID does not exist"
Jul 27 17:30:01.425970 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:01.425933    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d2fg4"]
Jul 27 17:30:01.433018 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:01.432996    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d2fg4"]
Jul 27 17:30:02.992929 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:02.992897    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc2dcdf6-1074-4523-94a6-c59b9cab42de" path="/var/lib/kubelet/pods/dc2dcdf6-1074-4523-94a6-c59b9cab42de/volumes"
Jul 27 17:30:05.391159 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:05.391117    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7975dbccc5-vvzxg"]
Jul 27 17:30:05.391652 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:05.391597    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2dcdf6-1074-4523-94a6-c59b9cab42de" containerName="authorino"
Jul 27 17:30:05.391652 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:05.391615    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2dcdf6-1074-4523-94a6-c59b9cab42de" containerName="authorino"
Jul 27 17:30:05.391766 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:05.391717    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc2dcdf6-1074-4523-94a6-c59b9cab42de" containerName="authorino"
Jul 27 17:30:05.507547 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:05.507511    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7975dbccc5-vvzxg"]
Jul 27 17:30:05.507741 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:05.507644    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7975dbccc5-vvzxg"
Jul 27 17:30:05.510469 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:05.510448    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 17:30:05.510598 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:05.510485    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 17:30:05.510598 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:05.510571    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bps2r\""
Jul 27 17:30:05.559616 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:05.559587    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51c2bb99-3c39-443d-85cb-8ae33cf2ba28-webhook-cert\") pod \"maas-controller-7975dbccc5-vvzxg\" (UID: \"51c2bb99-3c39-443d-85cb-8ae33cf2ba28\") " pod="opendatahub/maas-controller-7975dbccc5-vvzxg"
Jul 27 17:30:05.559745 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:05.559632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkqbz\" (UniqueName: \"kubernetes.io/projected/51c2bb99-3c39-443d-85cb-8ae33cf2ba28-kube-api-access-jkqbz\") pod \"maas-controller-7975dbccc5-vvzxg\" (UID: \"51c2bb99-3c39-443d-85cb-8ae33cf2ba28\") " pod="opendatahub/maas-controller-7975dbccc5-vvzxg"
Jul 27 17:30:05.660645 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:05.660551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51c2bb99-3c39-443d-85cb-8ae33cf2ba28-webhook-cert\") pod \"maas-controller-7975dbccc5-vvzxg\" (UID: \"51c2bb99-3c39-443d-85cb-8ae33cf2ba28\") " pod="opendatahub/maas-controller-7975dbccc5-vvzxg"
Jul 27 17:30:05.660645 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:05.660628    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkqbz\" (UniqueName: \"kubernetes.io/projected/51c2bb99-3c39-443d-85cb-8ae33cf2ba28-kube-api-access-jkqbz\") pod \"maas-controller-7975dbccc5-vvzxg\" (UID: \"51c2bb99-3c39-443d-85cb-8ae33cf2ba28\") " pod="opendatahub/maas-controller-7975dbccc5-vvzxg"
Jul 27 17:30:05.663209 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:05.663184    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51c2bb99-3c39-443d-85cb-8ae33cf2ba28-webhook-cert\") pod \"maas-controller-7975dbccc5-vvzxg\" (UID: \"51c2bb99-3c39-443d-85cb-8ae33cf2ba28\") " pod="opendatahub/maas-controller-7975dbccc5-vvzxg"
Jul 27 17:30:05.669054 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:05.669026    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkqbz\" (UniqueName: \"kubernetes.io/projected/51c2bb99-3c39-443d-85cb-8ae33cf2ba28-kube-api-access-jkqbz\") pod \"maas-controller-7975dbccc5-vvzxg\" (UID: \"51c2bb99-3c39-443d-85cb-8ae33cf2ba28\") " pod="opendatahub/maas-controller-7975dbccc5-vvzxg"
Jul 27 17:30:05.818820 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:05.818782    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7975dbccc5-vvzxg"
Jul 27 17:30:05.985659 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:05.985536    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7975dbccc5-vvzxg"]
Jul 27 17:30:05.988209 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:30:05.988184    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c2bb99_3c39_443d_85cb_8ae33cf2ba28.slice/crio-3b5528d26544f1d046acde5d43c4609a618c9bf411b33d80af7de34bbb9bea9b WatchSource:0}: Error finding container 3b5528d26544f1d046acde5d43c4609a618c9bf411b33d80af7de34bbb9bea9b: Status 404 returned error can't find the container with id 3b5528d26544f1d046acde5d43c4609a618c9bf411b33d80af7de34bbb9bea9b
Jul 27 17:30:06.417442 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:06.417380    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7975dbccc5-vvzxg" event={"ID":"51c2bb99-3c39-443d-85cb-8ae33cf2ba28","Type":"ContainerStarted","Data":"3b5528d26544f1d046acde5d43c4609a618c9bf411b33d80af7de34bbb9bea9b"}
Jul 27 17:30:10.439576 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:10.439534    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7975dbccc5-vvzxg" event={"ID":"51c2bb99-3c39-443d-85cb-8ae33cf2ba28","Type":"ContainerStarted","Data":"133e345a47889fa4fb11c9fd87b4fa46baf31b9ac3a4bca3623a9f4865f25af1"}
Jul 27 17:30:10.440042 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:10.439678    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7975dbccc5-vvzxg"
Jul 27 17:30:10.458309 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:10.458263    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7975dbccc5-vvzxg" podStartSLOduration=1.222910717 podStartE2EDuration="5.458249547s" totalImagesPullingTime="4.23533883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:30:10.456340013 +0000 UTC m=+553.988091000" watchObservedRunningTime="2026-07-27 17:30:10.458249547 +0000 UTC m=+553.990000533"
Jul 27 17:30:21.446910 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:21.446881    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7975dbccc5-vvzxg"
Jul 27 17:30:42.861507 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:42.861457    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-l4dk8"]
Jul 27 17:30:42.868646 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:42.868624    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-l4dk8"
Jul 27 17:30:42.870970 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:42.870946    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 17:30:42.871228 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:42.871209    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-tf4c5\""
Jul 27 17:30:42.874969 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:42.874944    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-l4dk8"]
Jul 27 17:30:42.974401 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:42.974369    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb94c657-b0a1-426d-8414-89545237e621-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-l4dk8\" (UID: \"eb94c657-b0a1-426d-8414-89545237e621\") " pod="openshift-ingress/payload-processing-5cc6cd444b-l4dk8"
Jul 27 17:30:42.974401 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:42.974409    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddsrh\" (UniqueName: \"kubernetes.io/projected/eb94c657-b0a1-426d-8414-89545237e621-kube-api-access-ddsrh\") pod \"payload-processing-5cc6cd444b-l4dk8\" (UID: \"eb94c657-b0a1-426d-8414-89545237e621\") " pod="openshift-ingress/payload-processing-5cc6cd444b-l4dk8"
Jul 27 17:30:43.075654 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:43.075621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb94c657-b0a1-426d-8414-89545237e621-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-l4dk8\" (UID: \"eb94c657-b0a1-426d-8414-89545237e621\") " pod="openshift-ingress/payload-processing-5cc6cd444b-l4dk8"
Jul 27 17:30:43.075654 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:43.075659    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddsrh\" (UniqueName: \"kubernetes.io/projected/eb94c657-b0a1-426d-8414-89545237e621-kube-api-access-ddsrh\") pod \"payload-processing-5cc6cd444b-l4dk8\" (UID: \"eb94c657-b0a1-426d-8414-89545237e621\") " pod="openshift-ingress/payload-processing-5cc6cd444b-l4dk8"
Jul 27 17:30:43.076289 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:43.076271    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb94c657-b0a1-426d-8414-89545237e621-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-l4dk8\" (UID: \"eb94c657-b0a1-426d-8414-89545237e621\") " pod="openshift-ingress/payload-processing-5cc6cd444b-l4dk8"
Jul 27 17:30:43.083663 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:43.083635    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddsrh\" (UniqueName: \"kubernetes.io/projected/eb94c657-b0a1-426d-8414-89545237e621-kube-api-access-ddsrh\") pod \"payload-processing-5cc6cd444b-l4dk8\" (UID: \"eb94c657-b0a1-426d-8414-89545237e621\") " pod="openshift-ingress/payload-processing-5cc6cd444b-l4dk8"
Jul 27 17:30:43.180785 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:43.180699    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-l4dk8"
Jul 27 17:30:43.321097 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:43.320880    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-l4dk8"]
Jul 27 17:30:43.323635 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:30:43.323602    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb94c657_b0a1_426d_8414_89545237e621.slice/crio-ec94d2b491656c5f6c4a5944be9302bd6f8874598f7e6e701be0be0459c0f7a5 WatchSource:0}: Error finding container ec94d2b491656c5f6c4a5944be9302bd6f8874598f7e6e701be0be0459c0f7a5: Status 404 returned error can't find the container with id ec94d2b491656c5f6c4a5944be9302bd6f8874598f7e6e701be0be0459c0f7a5
Jul 27 17:30:43.607752 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:43.607703    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-l4dk8" event={"ID":"eb94c657-b0a1-426d-8414-89545237e621","Type":"ContainerStarted","Data":"ec94d2b491656c5f6c4a5944be9302bd6f8874598f7e6e701be0be0459c0f7a5"}
Jul 27 17:30:45.633888 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:45.633788    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-l4dk8" event={"ID":"eb94c657-b0a1-426d-8414-89545237e621","Type":"ContainerStarted","Data":"eab8f7f3ddfe3cc824b57c23b596da50bdfa05587dbcad0c9d200654be4e0c3d"}
Jul 27 17:30:45.634607 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:45.634551    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-l4dk8"
Jul 27 17:30:45.652500 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:45.652436    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-l4dk8" podStartSLOduration=1.6285321069999998 podStartE2EDuration="3.652396487s" totalImagesPullingTime="2.02386438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:30:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:30:45.648972083 +0000 UTC m=+589.180723069" watchObservedRunningTime="2026-07-27 17:30:45.652396487 +0000 UTC m=+589.184147474"
Jul 27 17:30:50.663668 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:50.663577    2579 generic.go:356] "Generic (PLEG): container finished" podID="786cec5a-444f-47f9-9363-2fda57df5799" containerID="9f8ccc787628b3bc6ed5b9cb1a2c1970a2d5caf3573dbe224f344f7fd692fc35" exitCode=0
Jul 27 17:30:50.663668 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:50.663626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln" event={"ID":"786cec5a-444f-47f9-9363-2fda57df5799","Type":"ContainerDied","Data":"9f8ccc787628b3bc6ed5b9cb1a2c1970a2d5caf3573dbe224f344f7fd692fc35"}
Jul 27 17:30:50.664227 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:50.664088    2579 scope.go:117] "RemoveContainer" containerID="9f8ccc787628b3bc6ed5b9cb1a2c1970a2d5caf3573dbe224f344f7fd692fc35"
Jul 27 17:30:50.665140 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:50.665111    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:30:50.665214 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:50.665197    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:30:50.665262 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:50.665246    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:30:51.670307 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:51.670272    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln" event={"ID":"786cec5a-444f-47f9-9363-2fda57df5799","Type":"ContainerStarted","Data":"1e0c25e939319f2bb9dd7aa18246358d007e10de89ea09db195f420d5d36a87c"}
Jul 27 17:30:51.720695 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:51.720648    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:30:51.722078 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:51.721715    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-vxlln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 27 17:30:51.722078 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:51.721775    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln" podUID="786cec5a-444f-47f9-9363-2fda57df5799" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 27 17:30:52.720196 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:52.720156    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-vxlln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 27 17:30:52.720830 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:52.720227    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln" podUID="786cec5a-444f-47f9-9363-2fda57df5799" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 27 17:30:53.721860 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:53.721814    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-vxlln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 27 17:30:53.722366 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:53.721884    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln" podUID="786cec5a-444f-47f9-9363-2fda57df5799" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 27 17:30:54.720001 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:54.719959    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-vxlln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 27 17:30:54.720207 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:54.720032    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln" podUID="786cec5a-444f-47f9-9363-2fda57df5799" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 27 17:30:55.180671 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:55.180644    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:30:55.724531 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:55.724498    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:30:55.725526 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:55.725505    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vxlln"
Jul 27 17:30:57.648604 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:30:57.648571    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-l4dk8"
Jul 27 17:31:12.663374 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.663337    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"]
Jul 27 17:31:12.668054 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.668034    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.670435 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.670330    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 27 17:31:12.670435 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.670334    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zlcs9\""
Jul 27 17:31:12.670737 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.670715    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 17:31:12.670848 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.670795    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 17:31:12.677837 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.677815    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"]
Jul 27 17:31:12.727279 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.727251    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjhrq\" (UniqueName: \"kubernetes.io/projected/2fd83369-b33c-478c-b2ee-44b741d00172-kube-api-access-sjhrq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.727279 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.727289    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fd83369-b33c-478c-b2ee-44b741d00172-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.727531 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.727335    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fd83369-b33c-478c-b2ee-44b741d00172-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.727531 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.727355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fd83369-b33c-478c-b2ee-44b741d00172-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.727531 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.727373    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fd83369-b33c-478c-b2ee-44b741d00172-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.727531 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.727400    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fd83369-b33c-478c-b2ee-44b741d00172-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.828614 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.828579    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fd83369-b33c-478c-b2ee-44b741d00172-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.828614 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.828621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fd83369-b33c-478c-b2ee-44b741d00172-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.828865 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.828650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fd83369-b33c-478c-b2ee-44b741d00172-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.828865 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.828689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjhrq\" (UniqueName: \"kubernetes.io/projected/2fd83369-b33c-478c-b2ee-44b741d00172-kube-api-access-sjhrq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.828865 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.828720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fd83369-b33c-478c-b2ee-44b741d00172-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.828865 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.828781    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fd83369-b33c-478c-b2ee-44b741d00172-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.829076 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.828996    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fd83369-b33c-478c-b2ee-44b741d00172-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.829133 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.829106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fd83369-b33c-478c-b2ee-44b741d00172-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.829173 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.829154    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fd83369-b33c-478c-b2ee-44b741d00172-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.831184 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.831167    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fd83369-b33c-478c-b2ee-44b741d00172-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.831258 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.831184    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fd83369-b33c-478c-b2ee-44b741d00172-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.839984 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.839957    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjhrq\" (UniqueName: \"kubernetes.io/projected/2fd83369-b33c-478c-b2ee-44b741d00172-kube-api-access-sjhrq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ml6cb\" (UID: \"2fd83369-b33c-478c-b2ee-44b741d00172\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:12.980080 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:12.979996    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:13.115675 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:13.115649    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"]
Jul 27 17:31:13.117800 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:31:13.117769    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd83369_b33c_478c_b2ee_44b741d00172.slice/crio-d0c87effc5b888cf2a759b84147868b12fefca7d13afa666b6dd18d710bd4ebe WatchSource:0}: Error finding container d0c87effc5b888cf2a759b84147868b12fefca7d13afa666b6dd18d710bd4ebe: Status 404 returned error can't find the container with id d0c87effc5b888cf2a759b84147868b12fefca7d13afa666b6dd18d710bd4ebe
Jul 27 17:31:13.783988 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:13.783955    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb" event={"ID":"2fd83369-b33c-478c-b2ee-44b741d00172","Type":"ContainerStarted","Data":"d0c87effc5b888cf2a759b84147868b12fefca7d13afa666b6dd18d710bd4ebe"}
Jul 27 17:31:18.817844 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:18.817808    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb" event={"ID":"2fd83369-b33c-478c-b2ee-44b741d00172","Type":"ContainerStarted","Data":"c40c1e15436d6addcb10cca4fb36cc79a0090acb692fc37683ac02c4f227bb7c"}
Jul 27 17:31:18.841189 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:18.841141    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb" podStartSLOduration=1.581079888 podStartE2EDuration="6.841125219s" totalImagesPullingTime="5.260045331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:31:18.839555143 +0000 UTC m=+622.371306121" watchObservedRunningTime="2026-07-27 17:31:18.841125219 +0000 UTC m=+622.372876204"
Jul 27 17:31:22.981010 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:22.980971    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:22.981407 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:22.981039    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:22.994370 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:22.994344    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:23.854745 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:23.854717    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ml6cb"
Jul 27 17:31:34.381499 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.381470    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"]
Jul 27 17:31:34.384969 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.384954    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.387299 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.387276    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 27 17:31:34.394463 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.394408    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"]
Jul 27 17:31:34.516973 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.516939    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce788dac-3a46-4777-8c1b-385172a453bb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.517132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.516978    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce788dac-3a46-4777-8c1b-385172a453bb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.517132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.517010    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce788dac-3a46-4777-8c1b-385172a453bb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.517213 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.517131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce788dac-3a46-4777-8c1b-385172a453bb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.517213 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.517177    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8z6l\" (UniqueName: \"kubernetes.io/projected/ce788dac-3a46-4777-8c1b-385172a453bb-kube-api-access-b8z6l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.517277 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.517227    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce788dac-3a46-4777-8c1b-385172a453bb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.617850 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.617816    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce788dac-3a46-4777-8c1b-385172a453bb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.617850 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.617852    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8z6l\" (UniqueName: \"kubernetes.io/projected/ce788dac-3a46-4777-8c1b-385172a453bb-kube-api-access-b8z6l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.618070 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.617874    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce788dac-3a46-4777-8c1b-385172a453bb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.618070 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.617936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce788dac-3a46-4777-8c1b-385172a453bb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.618070 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.617969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce788dac-3a46-4777-8c1b-385172a453bb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.618070 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.617994    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce788dac-3a46-4777-8c1b-385172a453bb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.619790 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.619762    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce788dac-3a46-4777-8c1b-385172a453bb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.619900 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.619793    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce788dac-3a46-4777-8c1b-385172a453bb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.619900 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.619864    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce788dac-3a46-4777-8c1b-385172a453bb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.622207 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.622182    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce788dac-3a46-4777-8c1b-385172a453bb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.623164 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.623142    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce788dac-3a46-4777-8c1b-385172a453bb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.626531 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.626504    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8z6l\" (UniqueName: \"kubernetes.io/projected/ce788dac-3a46-4777-8c1b-385172a453bb-kube-api-access-b8z6l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9\" (UID: \"ce788dac-3a46-4777-8c1b-385172a453bb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.695508 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.695414    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:34.834042 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.834014    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"]
Jul 27 17:31:34.836693 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:31:34.836671    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce788dac_3a46_4777_8c1b_385172a453bb.slice/crio-bff52cdc9e5f30e1efc7ddea86258e144a6aabf8e44242531bac7087839b25eb WatchSource:0}: Error finding container bff52cdc9e5f30e1efc7ddea86258e144a6aabf8e44242531bac7087839b25eb: Status 404 returned error can't find the container with id bff52cdc9e5f30e1efc7ddea86258e144a6aabf8e44242531bac7087839b25eb
Jul 27 17:31:34.838073 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.838052    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:31:34.900915 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:34.900880    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9" event={"ID":"ce788dac-3a46-4777-8c1b-385172a453bb","Type":"ContainerStarted","Data":"bff52cdc9e5f30e1efc7ddea86258e144a6aabf8e44242531bac7087839b25eb"}
Jul 27 17:31:35.908605 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:35.908564    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9" event={"ID":"ce788dac-3a46-4777-8c1b-385172a453bb","Type":"ContainerStarted","Data":"3a10dd3df9557b3be4ee8f86c154f865d19525761db9236f3ba5a0ea47b000e3"}
Jul 27 17:31:35.927528 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:35.927460    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9" podStartSLOduration=1.732710038 podStartE2EDuration="1.927441298s" totalImagesPullingTime="194.73126ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:31:35.926581019 +0000 UTC m=+639.458332015" watchObservedRunningTime="2026-07-27 17:31:35.927441298 +0000 UTC m=+639.459192279"
Jul 27 17:31:44.696140 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:44.696094    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:44.696615 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:44.696159    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:44.710039 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:44.710013    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:31:44.969130 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:31:44.969037    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9"
Jul 27 17:34:05.524836 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:34:05.524782    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7975dbccc5-vvzxg"]
Jul 27 17:34:05.525372 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:34:05.525103    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7975dbccc5-vvzxg" podUID="51c2bb99-3c39-443d-85cb-8ae33cf2ba28" containerName="manager" containerID="cri-o://133e345a47889fa4fb11c9fd87b4fa46baf31b9ac3a4bca3623a9f4865f25af1" gracePeriod=30
Jul 27 17:34:05.682693 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:34:05.682658    2579 generic.go:356] "Generic (PLEG): container finished" podID="51c2bb99-3c39-443d-85cb-8ae33cf2ba28" containerID="133e345a47889fa4fb11c9fd87b4fa46baf31b9ac3a4bca3623a9f4865f25af1" exitCode=0
Jul 27 17:34:05.682860 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:34:05.682711    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7975dbccc5-vvzxg" event={"ID":"51c2bb99-3c39-443d-85cb-8ae33cf2ba28","Type":"ContainerDied","Data":"133e345a47889fa4fb11c9fd87b4fa46baf31b9ac3a4bca3623a9f4865f25af1"}
Jul 27 17:34:05.786483 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:34:05.786411    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7975dbccc5-vvzxg"
Jul 27 17:34:05.929680 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:34:05.929646    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51c2bb99-3c39-443d-85cb-8ae33cf2ba28-webhook-cert\") pod \"51c2bb99-3c39-443d-85cb-8ae33cf2ba28\" (UID: \"51c2bb99-3c39-443d-85cb-8ae33cf2ba28\") "
Jul 27 17:34:05.929847 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:34:05.929755    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkqbz\" (UniqueName: \"kubernetes.io/projected/51c2bb99-3c39-443d-85cb-8ae33cf2ba28-kube-api-access-jkqbz\") pod \"51c2bb99-3c39-443d-85cb-8ae33cf2ba28\" (UID: \"51c2bb99-3c39-443d-85cb-8ae33cf2ba28\") "
Jul 27 17:34:05.932062 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:34:05.932036    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51c2bb99-3c39-443d-85cb-8ae33cf2ba28-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "51c2bb99-3c39-443d-85cb-8ae33cf2ba28" (UID: "51c2bb99-3c39-443d-85cb-8ae33cf2ba28"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 17:34:05.932167 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:34:05.932084    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51c2bb99-3c39-443d-85cb-8ae33cf2ba28-kube-api-access-jkqbz" (OuterVolumeSpecName: "kube-api-access-jkqbz") pod "51c2bb99-3c39-443d-85cb-8ae33cf2ba28" (UID: "51c2bb99-3c39-443d-85cb-8ae33cf2ba28"). InnerVolumeSpecName "kube-api-access-jkqbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:34:06.031253 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:34:06.031221    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkqbz\" (UniqueName: \"kubernetes.io/projected/51c2bb99-3c39-443d-85cb-8ae33cf2ba28-kube-api-access-jkqbz\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:34:06.031253 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:34:06.031247    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51c2bb99-3c39-443d-85cb-8ae33cf2ba28-webhook-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:34:06.689397 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:34:06.689365    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7975dbccc5-vvzxg" event={"ID":"51c2bb99-3c39-443d-85cb-8ae33cf2ba28","Type":"ContainerDied","Data":"3b5528d26544f1d046acde5d43c4609a618c9bf411b33d80af7de34bbb9bea9b"}
Jul 27 17:34:06.689397 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:34:06.689397    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7975dbccc5-vvzxg"
Jul 27 17:34:06.689988 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:34:06.689440    2579 scope.go:117] "RemoveContainer" containerID="133e345a47889fa4fb11c9fd87b4fa46baf31b9ac3a4bca3623a9f4865f25af1"
Jul 27 17:34:06.711597 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:34:06.711569    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7975dbccc5-vvzxg"]
Jul 27 17:34:06.715446 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:34:06.715413    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7975dbccc5-vvzxg"]
Jul 27 17:34:06.992961 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:34:06.992883    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51c2bb99-3c39-443d-85cb-8ae33cf2ba28" path="/var/lib/kubelet/pods/51c2bb99-3c39-443d-85cb-8ae33cf2ba28/volumes"
Jul 27 17:35:25.835095 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:25.835059    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7975dbccc5-5q85z"]
Jul 27 17:35:25.835603 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:25.835395    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c2bb99-3c39-443d-85cb-8ae33cf2ba28" containerName="manager"
Jul 27 17:35:25.835603 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:25.835405    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c2bb99-3c39-443d-85cb-8ae33cf2ba28" containerName="manager"
Jul 27 17:35:25.835603 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:25.835503    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="51c2bb99-3c39-443d-85cb-8ae33cf2ba28" containerName="manager"
Jul 27 17:35:25.838492 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:25.838472    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7975dbccc5-5q85z"
Jul 27 17:35:25.840568 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:25.840547    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 17:35:25.840685 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:25.840623    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bps2r\""
Jul 27 17:35:25.841148 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:25.841132    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 17:35:25.851161 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:25.851135    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7975dbccc5-5q85z"]
Jul 27 17:35:26.003758 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:26.003716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f84ec536-d025-495a-b326-d5f2ea2de519-webhook-cert\") pod \"maas-controller-7975dbccc5-5q85z\" (UID: \"f84ec536-d025-495a-b326-d5f2ea2de519\") " pod="opendatahub/maas-controller-7975dbccc5-5q85z"
Jul 27 17:35:26.003934 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:26.003766    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5f56\" (UniqueName: \"kubernetes.io/projected/f84ec536-d025-495a-b326-d5f2ea2de519-kube-api-access-h5f56\") pod \"maas-controller-7975dbccc5-5q85z\" (UID: \"f84ec536-d025-495a-b326-d5f2ea2de519\") " pod="opendatahub/maas-controller-7975dbccc5-5q85z"
Jul 27 17:35:26.105368 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:26.105264    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f84ec536-d025-495a-b326-d5f2ea2de519-webhook-cert\") pod \"maas-controller-7975dbccc5-5q85z\" (UID: \"f84ec536-d025-495a-b326-d5f2ea2de519\") " pod="opendatahub/maas-controller-7975dbccc5-5q85z"
Jul 27 17:35:26.105368 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:26.105349    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5f56\" (UniqueName: \"kubernetes.io/projected/f84ec536-d025-495a-b326-d5f2ea2de519-kube-api-access-h5f56\") pod \"maas-controller-7975dbccc5-5q85z\" (UID: \"f84ec536-d025-495a-b326-d5f2ea2de519\") " pod="opendatahub/maas-controller-7975dbccc5-5q85z"
Jul 27 17:35:26.107996 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:26.107972    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f84ec536-d025-495a-b326-d5f2ea2de519-webhook-cert\") pod \"maas-controller-7975dbccc5-5q85z\" (UID: \"f84ec536-d025-495a-b326-d5f2ea2de519\") " pod="opendatahub/maas-controller-7975dbccc5-5q85z"
Jul 27 17:35:26.115238 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:26.115210    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5f56\" (UniqueName: \"kubernetes.io/projected/f84ec536-d025-495a-b326-d5f2ea2de519-kube-api-access-h5f56\") pod \"maas-controller-7975dbccc5-5q85z\" (UID: \"f84ec536-d025-495a-b326-d5f2ea2de519\") " pod="opendatahub/maas-controller-7975dbccc5-5q85z"
Jul 27 17:35:26.149070 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:26.149045    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7975dbccc5-5q85z"
Jul 27 17:35:26.299559 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:26.299517    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7975dbccc5-5q85z"]
Jul 27 17:35:26.306066 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:35:26.306032    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf84ec536_d025_495a_b326_d5f2ea2de519.slice/crio-215b9fbf956673722a80a9b400202dd91335483b1a1f26a94c8417956a4c24bc WatchSource:0}: Error finding container 215b9fbf956673722a80a9b400202dd91335483b1a1f26a94c8417956a4c24bc: Status 404 returned error can't find the container with id 215b9fbf956673722a80a9b400202dd91335483b1a1f26a94c8417956a4c24bc
Jul 27 17:35:27.102770 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:27.102735    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7975dbccc5-5q85z" event={"ID":"f84ec536-d025-495a-b326-d5f2ea2de519","Type":"ContainerStarted","Data":"215b9fbf956673722a80a9b400202dd91335483b1a1f26a94c8417956a4c24bc"}
Jul 27 17:35:28.110356 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:28.110317    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7975dbccc5-5q85z" event={"ID":"f84ec536-d025-495a-b326-d5f2ea2de519","Type":"ContainerStarted","Data":"828009cf77838b6e31d77b5840c117a7b4aaf21492a1990d687f1c6866d0b84e"}
Jul 27 17:35:28.110902 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:28.110442    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7975dbccc5-5q85z"
Jul 27 17:35:28.131260 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:28.131210    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7975dbccc5-5q85z" podStartSLOduration=2.250942009 podStartE2EDuration="3.131194725s" totalImagesPullingTime="880.252716ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:35:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:35:28.128365631 +0000 UTC m=+871.660116617" watchObservedRunningTime="2026-07-27 17:35:28.131194725 +0000 UTC m=+871.662945710"
Jul 27 17:35:39.120021 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:35:39.119991    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7975dbccc5-5q85z"
Jul 27 17:40:15.658091 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:15.658055    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"]
Jul 27 17:40:15.658727 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:15.658264    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf" podUID="2b64cab9-fe5c-496f-84a4-deef7885406d" containerName="manager" containerID="cri-o://0d1d31fbfe290077c82b899fac700fd642f2d21b81f2ba1b61c74f1cff98ccf4" gracePeriod=10
Jul 27 17:40:18.117341 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:18.117317    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"
Jul 27 17:40:18.237449 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:18.237349    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b64cab9-fe5c-496f-84a4-deef7885406d-extensions-socket-volume\") pod \"2b64cab9-fe5c-496f-84a4-deef7885406d\" (UID: \"2b64cab9-fe5c-496f-84a4-deef7885406d\") "
Jul 27 17:40:18.237594 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:18.237480    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lxbd\" (UniqueName: \"kubernetes.io/projected/2b64cab9-fe5c-496f-84a4-deef7885406d-kube-api-access-2lxbd\") pod \"2b64cab9-fe5c-496f-84a4-deef7885406d\" (UID: \"2b64cab9-fe5c-496f-84a4-deef7885406d\") "
Jul 27 17:40:18.237766 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:18.237735    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b64cab9-fe5c-496f-84a4-deef7885406d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2b64cab9-fe5c-496f-84a4-deef7885406d" (UID: "2b64cab9-fe5c-496f-84a4-deef7885406d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:40:18.239717 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:18.239696    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b64cab9-fe5c-496f-84a4-deef7885406d-kube-api-access-2lxbd" (OuterVolumeSpecName: "kube-api-access-2lxbd") pod "2b64cab9-fe5c-496f-84a4-deef7885406d" (UID: "2b64cab9-fe5c-496f-84a4-deef7885406d"). InnerVolumeSpecName "kube-api-access-2lxbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:40:18.338112 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:18.338081    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lxbd\" (UniqueName: \"kubernetes.io/projected/2b64cab9-fe5c-496f-84a4-deef7885406d-kube-api-access-2lxbd\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:40:18.338112 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:18.338114    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b64cab9-fe5c-496f-84a4-deef7885406d-extensions-socket-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:40:18.630856 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:18.630815    2579 generic.go:356] "Generic (PLEG): container finished" podID="2b64cab9-fe5c-496f-84a4-deef7885406d" containerID="0d1d31fbfe290077c82b899fac700fd642f2d21b81f2ba1b61c74f1cff98ccf4" exitCode=0
Jul 27 17:40:18.631032 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:18.630865    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"
Jul 27 17:40:18.631032 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:18.630908    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf" event={"ID":"2b64cab9-fe5c-496f-84a4-deef7885406d","Type":"ContainerDied","Data":"0d1d31fbfe290077c82b899fac700fd642f2d21b81f2ba1b61c74f1cff98ccf4"}
Jul 27 17:40:18.631032 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:18.630970    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf" event={"ID":"2b64cab9-fe5c-496f-84a4-deef7885406d","Type":"ContainerDied","Data":"25e01da53d5730b2850d637384bb6df15a52454359c8c9557682c5cec776a7dc"}
Jul 27 17:40:18.631032 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:18.631002    2579 scope.go:117] "RemoveContainer" containerID="0d1d31fbfe290077c82b899fac700fd642f2d21b81f2ba1b61c74f1cff98ccf4"
Jul 27 17:40:18.641997 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:18.641978    2579 scope.go:117] "RemoveContainer" containerID="0d1d31fbfe290077c82b899fac700fd642f2d21b81f2ba1b61c74f1cff98ccf4"
Jul 27 17:40:18.642256 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:40:18.642238    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d1d31fbfe290077c82b899fac700fd642f2d21b81f2ba1b61c74f1cff98ccf4\": container with ID starting with 0d1d31fbfe290077c82b899fac700fd642f2d21b81f2ba1b61c74f1cff98ccf4 not found: ID does not exist" containerID="0d1d31fbfe290077c82b899fac700fd642f2d21b81f2ba1b61c74f1cff98ccf4"
Jul 27 17:40:18.642307 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:18.642266    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d1d31fbfe290077c82b899fac700fd642f2d21b81f2ba1b61c74f1cff98ccf4"} err="failed to get container status \"0d1d31fbfe290077c82b899fac700fd642f2d21b81f2ba1b61c74f1cff98ccf4\": rpc error: code = NotFound desc = could not find container \"0d1d31fbfe290077c82b899fac700fd642f2d21b81f2ba1b61c74f1cff98ccf4\": container with ID starting with 0d1d31fbfe290077c82b899fac700fd642f2d21b81f2ba1b61c74f1cff98ccf4 not found: ID does not exist"
Jul 27 17:40:18.652352 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:18.652329    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"]
Jul 27 17:40:18.655496 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:18.655475    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d88bf"]
Jul 27 17:40:18.992884 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:40:18.992810    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b64cab9-fe5c-496f-84a4-deef7885406d" path="/var/lib/kubelet/pods/2b64cab9-fe5c-496f-84a4-deef7885406d/volumes"
Jul 27 17:41:16.773665 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:16.773625    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s9r5x"]
Jul 27 17:41:16.774244 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:16.774195    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b64cab9-fe5c-496f-84a4-deef7885406d" containerName="manager"
Jul 27 17:41:16.774244 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:16.774213    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b64cab9-fe5c-496f-84a4-deef7885406d" containerName="manager"
Jul 27 17:41:16.774373 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:16.774318    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b64cab9-fe5c-496f-84a4-deef7885406d" containerName="manager"
Jul 27 17:41:16.780724 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:16.780054    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s9r5x"
Jul 27 17:41:16.783689 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:16.783665    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sr86m\""
Jul 27 17:41:16.796942 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:16.796913    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s9r5x"]
Jul 27 17:41:16.907811 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:16.907772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b2067e3-39b9-47b1-81b1-943736e0d23c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s9r5x\" (UID: \"4b2067e3-39b9-47b1-81b1-943736e0d23c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s9r5x"
Jul 27 17:41:16.907811 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:16.907816    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2qnd\" (UniqueName: \"kubernetes.io/projected/4b2067e3-39b9-47b1-81b1-943736e0d23c-kube-api-access-j2qnd\") pod \"kuadrant-operator-controller-manager-86878c769f-s9r5x\" (UID: \"4b2067e3-39b9-47b1-81b1-943736e0d23c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s9r5x"
Jul 27 17:41:17.008510 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:17.008477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b2067e3-39b9-47b1-81b1-943736e0d23c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s9r5x\" (UID: \"4b2067e3-39b9-47b1-81b1-943736e0d23c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s9r5x"
Jul 27 17:41:17.008692 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:17.008521    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2qnd\" (UniqueName: \"kubernetes.io/projected/4b2067e3-39b9-47b1-81b1-943736e0d23c-kube-api-access-j2qnd\") pod \"kuadrant-operator-controller-manager-86878c769f-s9r5x\" (UID: \"4b2067e3-39b9-47b1-81b1-943736e0d23c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s9r5x"
Jul 27 17:41:17.008835 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:17.008816    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b2067e3-39b9-47b1-81b1-943736e0d23c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s9r5x\" (UID: \"4b2067e3-39b9-47b1-81b1-943736e0d23c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s9r5x"
Jul 27 17:41:17.019709 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:17.019680    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2qnd\" (UniqueName: \"kubernetes.io/projected/4b2067e3-39b9-47b1-81b1-943736e0d23c-kube-api-access-j2qnd\") pod \"kuadrant-operator-controller-manager-86878c769f-s9r5x\" (UID: \"4b2067e3-39b9-47b1-81b1-943736e0d23c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s9r5x"
Jul 27 17:41:17.090443 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:17.090346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s9r5x"
Jul 27 17:41:17.224805 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:17.224753    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s9r5x"]
Jul 27 17:41:17.227526 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:41:17.227494    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b2067e3_39b9_47b1_81b1_943736e0d23c.slice/crio-db677aba9ad039ce869f3435aab83a7e7dd4fe2d8952b49ce1df79e12d6843a2 WatchSource:0}: Error finding container db677aba9ad039ce869f3435aab83a7e7dd4fe2d8952b49ce1df79e12d6843a2: Status 404 returned error can't find the container with id db677aba9ad039ce869f3435aab83a7e7dd4fe2d8952b49ce1df79e12d6843a2
Jul 27 17:41:17.925573 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:17.925535    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s9r5x" event={"ID":"4b2067e3-39b9-47b1-81b1-943736e0d23c","Type":"ContainerStarted","Data":"0f9191706ddb705f5bae8300a9cf18969cbe1fc8e6d5decea74c9bda2c7808cd"}
Jul 27 17:41:17.926011 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:17.925593    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s9r5x" event={"ID":"4b2067e3-39b9-47b1-81b1-943736e0d23c","Type":"ContainerStarted","Data":"db677aba9ad039ce869f3435aab83a7e7dd4fe2d8952b49ce1df79e12d6843a2"}
Jul 27 17:41:17.926011 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:17.925707    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s9r5x"
Jul 27 17:41:17.945171 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:17.945125    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s9r5x" podStartSLOduration=1.945107812 podStartE2EDuration="1.945107812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:41:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:41:17.943607483 +0000 UTC m=+1221.475358468" watchObservedRunningTime="2026-07-27 17:41:17.945107812 +0000 UTC m=+1221.476858801"
Jul 27 17:41:28.933441 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:41:28.933392    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s9r5x"
Jul 27 17:45:00.140500 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:45:00.140403    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29752905-tmvjd"]
Jul 27 17:45:00.143835 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:45:00.143820    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752905-tmvjd"
Jul 27 17:45:00.145654 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:45:00.145634    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ldh7c\""
Jul 27 17:45:00.150480 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:45:00.150459    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29752905-tmvjd"]
Jul 27 17:45:00.155885 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:45:00.155865    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752905-tmvjd"
Jul 27 17:45:00.300752 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:45:00.300728    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29752905-tmvjd"]
Jul 27 17:45:00.303073 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:45:00.303046    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de927d0_0fe7_402e_a75b_f8c14c2a7836.slice/crio-63944bf6cd92a2b605fcf44cdc100e249d06ba37c190224d62f9f1d171c8afea WatchSource:0}: Error finding container 63944bf6cd92a2b605fcf44cdc100e249d06ba37c190224d62f9f1d171c8afea: Status 404 returned error can't find the container with id 63944bf6cd92a2b605fcf44cdc100e249d06ba37c190224d62f9f1d171c8afea
Jul 27 17:45:00.305001 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:45:00.304983    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:45:01.080263 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:45:01.080221    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752905-tmvjd" event={"ID":"6de927d0-0fe7-402e-a75b-f8c14c2a7836","Type":"ContainerStarted","Data":"63944bf6cd92a2b605fcf44cdc100e249d06ba37c190224d62f9f1d171c8afea"}
Jul 27 17:45:04.098535 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:45:04.098499    2579 generic.go:356] "Generic (PLEG): container finished" podID="6de927d0-0fe7-402e-a75b-f8c14c2a7836" containerID="248d2e6d84ba1116306afd1ae312e047eecb7faf1329a8f5f018b7e669baaf04" exitCode=0
Jul 27 17:45:04.098894 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:45:04.098586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752905-tmvjd" event={"ID":"6de927d0-0fe7-402e-a75b-f8c14c2a7836","Type":"ContainerDied","Data":"248d2e6d84ba1116306afd1ae312e047eecb7faf1329a8f5f018b7e669baaf04"}
Jul 27 17:45:05.241525 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:45:05.241499    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752905-tmvjd"
Jul 27 17:45:06.112292 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:45:06.112263    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752905-tmvjd"
Jul 27 17:45:06.112292 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:45:06.112282    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752905-tmvjd" event={"ID":"6de927d0-0fe7-402e-a75b-f8c14c2a7836","Type":"ContainerDied","Data":"63944bf6cd92a2b605fcf44cdc100e249d06ba37c190224d62f9f1d171c8afea"}
Jul 27 17:45:06.112681 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:45:06.112323    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63944bf6cd92a2b605fcf44cdc100e249d06ba37c190224d62f9f1d171c8afea"
Jul 27 17:48:05.569045 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.568965    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"]
Jul 27 17:48:05.571090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.569495    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6de927d0-0fe7-402e-a75b-f8c14c2a7836" containerName="cleanup"
Jul 27 17:48:05.571090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.569510    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6de927d0-0fe7-402e-a75b-f8c14c2a7836" containerName="cleanup"
Jul 27 17:48:05.571090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.569585    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6de927d0-0fe7-402e-a75b-f8c14c2a7836" containerName="cleanup"
Jul 27 17:48:05.572571 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.572553    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.575526 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.575508    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5bebd9b0-openshift-default-dockercfg-pjrzd\""
Jul 27 17:48:05.597720 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.597691    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"]
Jul 27 17:48:05.611768 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.611717    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-envoy\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.611963 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.611795    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-credential-socket\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.611963 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.611824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-workload-socket\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.611963 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.611878    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-workload-certs\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.611963 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.611913    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02d93d08-f006-42c7-b761-41d9fe3c566e-istiod-ca-cert\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.611963 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.611940    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-podinfo\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.612243 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.611971    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzwtt\" (UniqueName: \"kubernetes.io/projected/02d93d08-f006-42c7-b761-41d9fe3c566e-kube-api-access-kzwtt\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.612243 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.612067    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-data\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.612243 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.612109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-token\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.712999 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.712963    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzwtt\" (UniqueName: \"kubernetes.io/projected/02d93d08-f006-42c7-b761-41d9fe3c566e-kube-api-access-kzwtt\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.713198 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.713020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-data\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.713198 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.713063    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-token\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.713198 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.713102    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-envoy\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.713198 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.713150    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-credential-socket\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.713198 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.713177    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-workload-socket\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.713796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.713226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-workload-certs\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.713796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.713258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02d93d08-f006-42c7-b761-41d9fe3c566e-istiod-ca-cert\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.713796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.713286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-podinfo\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.713796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.713731    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-workload-socket\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.713796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.713744    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-data\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.714126 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.713828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-credential-socket\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.714126 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.714026    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-workload-certs\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.714629 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.714563    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02d93d08-f006-42c7-b761-41d9fe3c566e-istiod-ca-cert\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.716113 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.716087    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-envoy\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.716194 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.716132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-podinfo\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.721069 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.721037    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzwtt\" (UniqueName: \"kubernetes.io/projected/02d93d08-f006-42c7-b761-41d9fe3c566e-kube-api-access-kzwtt\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.721235 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.721216    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-token\") pod \"e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") " pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:05.882521 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:05.882398    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:06.027303 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:06.027274    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"]
Jul 27 17:48:06.029514 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:48:06.029477    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02d93d08_f006_42c7_b761_41d9fe3c566e.slice/crio-392d8ad51de8ad5a658cb29330ff1c9380e103b53c5e3c9ec1e23a5d64744258 WatchSource:0}: Error finding container 392d8ad51de8ad5a658cb29330ff1c9380e103b53c5e3c9ec1e23a5d64744258: Status 404 returned error can't find the container with id 392d8ad51de8ad5a658cb29330ff1c9380e103b53c5e3c9ec1e23a5d64744258
Jul 27 17:48:06.032095 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:06.032065    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:48:06.032187 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:06.032142    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:48:06.032187 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:06.032174    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:48:06.039024 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:06.039004    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl" event={"ID":"02d93d08-f006-42c7-b761-41d9fe3c566e","Type":"ContainerStarted","Data":"392d8ad51de8ad5a658cb29330ff1c9380e103b53c5e3c9ec1e23a5d64744258"}
Jul 27 17:48:07.046097 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:07.046064    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl" event={"ID":"02d93d08-f006-42c7-b761-41d9fe3c566e","Type":"ContainerStarted","Data":"368590f89c82159ad024f4dab5aa5e2f33813a164fce248f704bcb67076d36e6"}
Jul 27 17:48:07.066483 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:07.066434    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl" podStartSLOduration=2.0664017709999998 podStartE2EDuration="2.066401771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:48:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:48:07.064948604 +0000 UTC m=+1630.596699608" watchObservedRunningTime="2026-07-27 17:48:07.066401771 +0000 UTC m=+1630.598152756"
Jul 27 17:48:07.882850 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:07.882814    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:07.887950 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:07.887924    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:08.052026 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:08.051995    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:08.053039 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:08.053017    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:09.349969 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:09.349932    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"]
Jul 27 17:48:09.353485 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:09.353470    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"
Jul 27 17:48:09.358033 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:09.358007    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-5bebd9b0-dockercfg-6cpjq\""
Jul 27 17:48:09.358033 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:09.358024    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-5bebd9b0\""
Jul 27 17:48:09.365047 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:09.365025    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"]
Jul 27 17:48:09.446740 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:09.446701    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e6f985d-e4a1-471e-8418-ee65a9d00c91-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs\" (UID: \"0e6f985d-e4a1-471e-8418-ee65a9d00c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"
Jul 27 17:48:09.446910 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:09.446747    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpfnc\" (UniqueName: \"kubernetes.io/projected/0e6f985d-e4a1-471e-8418-ee65a9d00c91-kube-api-access-hpfnc\") pod \"payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs\" (UID: \"0e6f985d-e4a1-471e-8418-ee65a9d00c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"
Jul 27 17:48:09.548001 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:09.547965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e6f985d-e4a1-471e-8418-ee65a9d00c91-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs\" (UID: \"0e6f985d-e4a1-471e-8418-ee65a9d00c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"
Jul 27 17:48:09.548184 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:09.548009    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpfnc\" (UniqueName: \"kubernetes.io/projected/0e6f985d-e4a1-471e-8418-ee65a9d00c91-kube-api-access-hpfnc\") pod \"payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs\" (UID: \"0e6f985d-e4a1-471e-8418-ee65a9d00c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"
Jul 27 17:48:09.548687 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:09.548669    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e6f985d-e4a1-471e-8418-ee65a9d00c91-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs\" (UID: \"0e6f985d-e4a1-471e-8418-ee65a9d00c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"
Jul 27 17:48:09.556659 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:09.556628    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpfnc\" (UniqueName: \"kubernetes.io/projected/0e6f985d-e4a1-471e-8418-ee65a9d00c91-kube-api-access-hpfnc\") pod \"payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs\" (UID: \"0e6f985d-e4a1-471e-8418-ee65a9d00c91\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"
Jul 27 17:48:09.664994 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:09.664908    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"
Jul 27 17:48:09.813763 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:09.813679    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"]
Jul 27 17:48:09.816635 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:48:09.816605    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6f985d_e4a1_471e_8418_ee65a9d00c91.slice/crio-c6133eae01351d44bf8593e3854c23e4fc6da79320279a36a2aa0ecfed7594e2 WatchSource:0}: Error finding container c6133eae01351d44bf8593e3854c23e4fc6da79320279a36a2aa0ecfed7594e2: Status 404 returned error can't find the container with id c6133eae01351d44bf8593e3854c23e4fc6da79320279a36a2aa0ecfed7594e2
Jul 27 17:48:10.062908 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:10.062873    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs" event={"ID":"0e6f985d-e4a1-471e-8418-ee65a9d00c91","Type":"ContainerStarted","Data":"cb3f7656f95afa290fd9a831b21b5a59d383f0f625b68fb1437be7a795b79968"}
Jul 27 17:48:10.063086 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:10.062925    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs" event={"ID":"0e6f985d-e4a1-471e-8418-ee65a9d00c91","Type":"ContainerStarted","Data":"c6133eae01351d44bf8593e3854c23e4fc6da79320279a36a2aa0ecfed7594e2"}
Jul 27 17:48:10.063151 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:10.063113    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"
Jul 27 17:48:10.078824 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:10.078780    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs" podStartSLOduration=1.078766388 podStartE2EDuration="1.078766388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:48:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:48:10.077466378 +0000 UTC m=+1633.609217365" watchObservedRunningTime="2026-07-27 17:48:10.078766388 +0000 UTC m=+1633.610517373"
Jul 27 17:48:21.069955 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:21.069916    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"
Jul 27 17:48:22.127383 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:22.127345    2579 generic.go:356] "Generic (PLEG): container finished" podID="02d93d08-f006-42c7-b761-41d9fe3c566e" containerID="368590f89c82159ad024f4dab5aa5e2f33813a164fce248f704bcb67076d36e6" exitCode=0
Jul 27 17:48:22.127842 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:22.127433    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl" event={"ID":"02d93d08-f006-42c7-b761-41d9fe3c566e","Type":"ContainerDied","Data":"368590f89c82159ad024f4dab5aa5e2f33813a164fce248f704bcb67076d36e6"}
Jul 27 17:48:22.127890 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:22.127847    2579 scope.go:117] "RemoveContainer" containerID="368590f89c82159ad024f4dab5aa5e2f33813a164fce248f704bcb67076d36e6"
Jul 27 17:48:22.128869 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:22.128840    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:48:22.128969 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:22.128923    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:48:22.129040 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:22.128971    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:48:23.052128 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:23.052093    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:23.135188 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:23.135148    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl" event={"ID":"02d93d08-f006-42c7-b761-41d9fe3c566e","Type":"ContainerStarted","Data":"0831850f4156a597ad120679a3f308ad3c15c21c3d5988c52737ff1ed845afbb"}
Jul 27 17:48:23.883020 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:23.882986    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:23.884119 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:23.884094    2579 patch_prober.go:28] interesting pod/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 27 17:48:23.884270 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:23.884144    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl" podUID="02d93d08-f006-42c7-b761-41d9fe3c566e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 27 17:48:24.882850 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:24.882806    2579 patch_prober.go:28] interesting pod/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 27 17:48:24.883334 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:24.882866    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl" podUID="02d93d08-f006-42c7-b761-41d9fe3c566e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 27 17:48:25.883475 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:25.883409    2579 patch_prober.go:28] interesting pod/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 27 17:48:25.883872 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:25.883488    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl" podUID="02d93d08-f006-42c7-b761-41d9fe3c566e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 27 17:48:26.883739 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:26.883700    2579 patch_prober.go:28] interesting pod/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 27 17:48:26.884176 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:26.883787    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl" podUID="02d93d08-f006-42c7-b761-41d9fe3c566e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 27 17:48:27.886968 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:27.886928    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:27.887373 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:27.887188    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:27.887924 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:27.887906    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:44.479576 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:44.479537    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"]
Jul 27 17:48:44.480184 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:44.479785    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs" podUID="0e6f985d-e4a1-471e-8418-ee65a9d00c91" containerName="payload-pre-processing" containerID="cri-o://cb3f7656f95afa290fd9a831b21b5a59d383f0f625b68fb1437be7a795b79968" gracePeriod=30
Jul 27 17:48:44.741709 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:44.741654    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"
Jul 27 17:48:44.761787 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:44.761762    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpfnc\" (UniqueName: \"kubernetes.io/projected/0e6f985d-e4a1-471e-8418-ee65a9d00c91-kube-api-access-hpfnc\") pod \"0e6f985d-e4a1-471e-8418-ee65a9d00c91\" (UID: \"0e6f985d-e4a1-471e-8418-ee65a9d00c91\") "
Jul 27 17:48:44.761932 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:44.761796    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e6f985d-e4a1-471e-8418-ee65a9d00c91-plugins-config-volume\") pod \"0e6f985d-e4a1-471e-8418-ee65a9d00c91\" (UID: \"0e6f985d-e4a1-471e-8418-ee65a9d00c91\") "
Jul 27 17:48:44.762237 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:44.762211    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e6f985d-e4a1-471e-8418-ee65a9d00c91-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0e6f985d-e4a1-471e-8418-ee65a9d00c91" (UID: "0e6f985d-e4a1-471e-8418-ee65a9d00c91"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:48:44.763943 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:44.763922    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e6f985d-e4a1-471e-8418-ee65a9d00c91-kube-api-access-hpfnc" (OuterVolumeSpecName: "kube-api-access-hpfnc") pod "0e6f985d-e4a1-471e-8418-ee65a9d00c91" (UID: "0e6f985d-e4a1-471e-8418-ee65a9d00c91"). InnerVolumeSpecName "kube-api-access-hpfnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:48:44.863971 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:44.863930    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpfnc\" (UniqueName: \"kubernetes.io/projected/0e6f985d-e4a1-471e-8418-ee65a9d00c91-kube-api-access-hpfnc\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:48:44.863971 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:44.863970    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e6f985d-e4a1-471e-8418-ee65a9d00c91-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:48:45.252484 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:45.252374    2579 generic.go:356] "Generic (PLEG): container finished" podID="0e6f985d-e4a1-471e-8418-ee65a9d00c91" containerID="cb3f7656f95afa290fd9a831b21b5a59d383f0f625b68fb1437be7a795b79968" exitCode=0
Jul 27 17:48:45.252484 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:45.252456    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs" event={"ID":"0e6f985d-e4a1-471e-8418-ee65a9d00c91","Type":"ContainerDied","Data":"cb3f7656f95afa290fd9a831b21b5a59d383f0f625b68fb1437be7a795b79968"}
Jul 27 17:48:45.252718 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:45.252513    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs" event={"ID":"0e6f985d-e4a1-471e-8418-ee65a9d00c91","Type":"ContainerDied","Data":"c6133eae01351d44bf8593e3854c23e4fc6da79320279a36a2aa0ecfed7594e2"}
Jul 27 17:48:45.252718 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:45.252534    2579 scope.go:117] "RemoveContainer" containerID="cb3f7656f95afa290fd9a831b21b5a59d383f0f625b68fb1437be7a795b79968"
Jul 27 17:48:45.252718 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:45.252467    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"
Jul 27 17:48:45.261306 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:45.261288    2579 scope.go:117] "RemoveContainer" containerID="cb3f7656f95afa290fd9a831b21b5a59d383f0f625b68fb1437be7a795b79968"
Jul 27 17:48:45.261547 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:48:45.261528    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb3f7656f95afa290fd9a831b21b5a59d383f0f625b68fb1437be7a795b79968\": container with ID starting with cb3f7656f95afa290fd9a831b21b5a59d383f0f625b68fb1437be7a795b79968 not found: ID does not exist" containerID="cb3f7656f95afa290fd9a831b21b5a59d383f0f625b68fb1437be7a795b79968"
Jul 27 17:48:45.261626 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:45.261558    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb3f7656f95afa290fd9a831b21b5a59d383f0f625b68fb1437be7a795b79968"} err="failed to get container status \"cb3f7656f95afa290fd9a831b21b5a59d383f0f625b68fb1437be7a795b79968\": rpc error: code = NotFound desc = could not find container \"cb3f7656f95afa290fd9a831b21b5a59d383f0f625b68fb1437be7a795b79968\": container with ID starting with cb3f7656f95afa290fd9a831b21b5a59d383f0f625b68fb1437be7a795b79968 not found: ID does not exist"
Jul 27 17:48:45.267918 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:45.267894    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"]
Jul 27 17:48:45.271190 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:45.271172    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5bebd9b0-584f5467b-qjphs"]
Jul 27 17:48:46.993591 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:46.993557    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e6f985d-e4a1-471e-8418-ee65a9d00c91" path="/var/lib/kubelet/pods/0e6f985d-e4a1-471e-8418-ee65a9d00c91/volumes"
Jul 27 17:48:49.164433 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:49.164387    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"]
Jul 27 17:48:49.164842 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:49.164627    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl" podUID="02d93d08-f006-42c7-b761-41d9fe3c566e" containerName="istio-proxy" containerID="cri-o://0831850f4156a597ad120679a3f308ad3c15c21c3d5988c52737ff1ed845afbb" gracePeriod=30
Jul 27 17:48:53.433217 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.433182    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"]
Jul 27 17:48:53.433873 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.433852    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e6f985d-e4a1-471e-8418-ee65a9d00c91" containerName="payload-pre-processing"
Jul 27 17:48:53.433981 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.433878    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6f985d-e4a1-471e-8418-ee65a9d00c91" containerName="payload-pre-processing"
Jul 27 17:48:53.433981 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.433977    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e6f985d-e4a1-471e-8418-ee65a9d00c91" containerName="payload-pre-processing"
Jul 27 17:48:53.438582 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.438568    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"
Jul 27 17:48:53.443121 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.443091    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-d1a612f6\""
Jul 27 17:48:53.443372 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.443359    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-d1a612f6-dockercfg-rxmsl\""
Jul 27 17:48:53.448556 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.448530    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"]
Jul 27 17:48:53.458477 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.458453    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"]
Jul 27 17:48:53.461865 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.461845    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"
Jul 27 17:48:53.476636 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.476612    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"]
Jul 27 17:48:53.546265 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.546223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15d54b63-cb82-4972-be2c-a736335a64cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq\" (UID: \"15d54b63-cb82-4972-be2c-a736335a64cb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"
Jul 27 17:48:53.546447 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.546274    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/504f1d6b-e3a9-4aad-81d8-9555219de7cb-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749\" (UID: \"504f1d6b-e3a9-4aad-81d8-9555219de7cb\") " pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"
Jul 27 17:48:53.546447 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.546305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wkj2\" (UniqueName: \"kubernetes.io/projected/15d54b63-cb82-4972-be2c-a736335a64cb-kube-api-access-6wkj2\") pod \"payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq\" (UID: \"15d54b63-cb82-4972-be2c-a736335a64cb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"
Jul 27 17:48:53.546531 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.546457    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gwrm\" (UniqueName: \"kubernetes.io/projected/504f1d6b-e3a9-4aad-81d8-9555219de7cb-kube-api-access-5gwrm\") pod \"payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749\" (UID: \"504f1d6b-e3a9-4aad-81d8-9555219de7cb\") " pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"
Jul 27 17:48:53.647804 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.647771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15d54b63-cb82-4972-be2c-a736335a64cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq\" (UID: \"15d54b63-cb82-4972-be2c-a736335a64cb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"
Jul 27 17:48:53.647804 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.647808    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/504f1d6b-e3a9-4aad-81d8-9555219de7cb-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749\" (UID: \"504f1d6b-e3a9-4aad-81d8-9555219de7cb\") " pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"
Jul 27 17:48:53.648037 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.647828    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wkj2\" (UniqueName: \"kubernetes.io/projected/15d54b63-cb82-4972-be2c-a736335a64cb-kube-api-access-6wkj2\") pod \"payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq\" (UID: \"15d54b63-cb82-4972-be2c-a736335a64cb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"
Jul 27 17:48:53.648096 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.648030    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gwrm\" (UniqueName: \"kubernetes.io/projected/504f1d6b-e3a9-4aad-81d8-9555219de7cb-kube-api-access-5gwrm\") pod \"payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749\" (UID: \"504f1d6b-e3a9-4aad-81d8-9555219de7cb\") " pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"
Jul 27 17:48:53.648520 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.648504    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/504f1d6b-e3a9-4aad-81d8-9555219de7cb-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749\" (UID: \"504f1d6b-e3a9-4aad-81d8-9555219de7cb\") " pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"
Jul 27 17:48:53.648632 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.648615    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15d54b63-cb82-4972-be2c-a736335a64cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq\" (UID: \"15d54b63-cb82-4972-be2c-a736335a64cb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"
Jul 27 17:48:53.656459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.656412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wkj2\" (UniqueName: \"kubernetes.io/projected/15d54b63-cb82-4972-be2c-a736335a64cb-kube-api-access-6wkj2\") pod \"payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq\" (UID: \"15d54b63-cb82-4972-be2c-a736335a64cb\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"
Jul 27 17:48:53.657956 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.657939    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gwrm\" (UniqueName: \"kubernetes.io/projected/504f1d6b-e3a9-4aad-81d8-9555219de7cb-kube-api-access-5gwrm\") pod \"payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749\" (UID: \"504f1d6b-e3a9-4aad-81d8-9555219de7cb\") " pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"
Jul 27 17:48:53.750278 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.750196    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"
Jul 27 17:48:53.772102 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.772076    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"
Jul 27 17:48:53.912205 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.910624    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"]
Jul 27 17:48:53.914753 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:48:53.914708    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d54b63_cb82_4972_be2c_a736335a64cb.slice/crio-01a6ec8be01d87b8ac1eb96c894fd8c10317061636e59414d9cb65b43aa9cf4a WatchSource:0}: Error finding container 01a6ec8be01d87b8ac1eb96c894fd8c10317061636e59414d9cb65b43aa9cf4a: Status 404 returned error can't find the container with id 01a6ec8be01d87b8ac1eb96c894fd8c10317061636e59414d9cb65b43aa9cf4a
Jul 27 17:48:53.939406 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:53.939384    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"]
Jul 27 17:48:53.941864 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:48:53.941834    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod504f1d6b_e3a9_4aad_81d8_9555219de7cb.slice/crio-461512cf75a9753f68103176fcc190020f84470e879fcdc55055a31d16c3351a WatchSource:0}: Error finding container 461512cf75a9753f68103176fcc190020f84470e879fcdc55055a31d16c3351a: Status 404 returned error can't find the container with id 461512cf75a9753f68103176fcc190020f84470e879fcdc55055a31d16c3351a
Jul 27 17:48:54.315858 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.315625    2579 generic.go:356] "Generic (PLEG): container finished" podID="02d93d08-f006-42c7-b761-41d9fe3c566e" containerID="0831850f4156a597ad120679a3f308ad3c15c21c3d5988c52737ff1ed845afbb" exitCode=0
Jul 27 17:48:54.315858 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.315705    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl" event={"ID":"02d93d08-f006-42c7-b761-41d9fe3c566e","Type":"ContainerDied","Data":"0831850f4156a597ad120679a3f308ad3c15c21c3d5988c52737ff1ed845afbb"}
Jul 27 17:48:54.315858 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.315761    2579 scope.go:117] "RemoveContainer" containerID="368590f89c82159ad024f4dab5aa5e2f33813a164fce248f704bcb67076d36e6"
Jul 27 17:48:54.319180 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.318316    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq" event={"ID":"15d54b63-cb82-4972-be2c-a736335a64cb","Type":"ContainerStarted","Data":"7aaef9cb7af5f247a6321af3af1cab359489c4758d10ef0b445d1a95665e4c95"}
Jul 27 17:48:54.319180 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.318370    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq" event={"ID":"15d54b63-cb82-4972-be2c-a736335a64cb","Type":"ContainerStarted","Data":"01a6ec8be01d87b8ac1eb96c894fd8c10317061636e59414d9cb65b43aa9cf4a"}
Jul 27 17:48:54.319180 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.319127    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"
Jul 27 17:48:54.321466 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.320977    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749" event={"ID":"504f1d6b-e3a9-4aad-81d8-9555219de7cb","Type":"ContainerStarted","Data":"11ce701492472ff439cb9ad38f02f8a53f4b03328debe3ed4a1ce0dda79825bf"}
Jul 27 17:48:54.321466 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.321022    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749" event={"ID":"504f1d6b-e3a9-4aad-81d8-9555219de7cb","Type":"ContainerStarted","Data":"461512cf75a9753f68103176fcc190020f84470e879fcdc55055a31d16c3351a"}
Jul 27 17:48:54.321466 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.321131    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"
Jul 27 17:48:54.336744 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.335801    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq" podStartSLOduration=1.335786482 podStartE2EDuration="1.335786482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:48:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:48:54.333386384 +0000 UTC m=+1677.865137369" watchObservedRunningTime="2026-07-27 17:48:54.335786482 +0000 UTC m=+1677.867537467"
Jul 27 17:48:54.351209 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.351163    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749" podStartSLOduration=1.351148188 podStartE2EDuration="1.351148188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:48:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:48:54.348044803 +0000 UTC m=+1677.879795793" watchObservedRunningTime="2026-07-27 17:48:54.351148188 +0000 UTC m=+1677.882899174"
Jul 27 17:48:54.437019 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.436994    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:54.555849 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.555819    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-data\") pod \"02d93d08-f006-42c7-b761-41d9fe3c566e\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") "
Jul 27 17:48:54.555849 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.555854    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-workload-certs\") pod \"02d93d08-f006-42c7-b761-41d9fe3c566e\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") "
Jul 27 17:48:54.556084 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.555883    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-workload-socket\") pod \"02d93d08-f006-42c7-b761-41d9fe3c566e\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") "
Jul 27 17:48:54.556084 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.555925    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02d93d08-f006-42c7-b761-41d9fe3c566e-istiod-ca-cert\") pod \"02d93d08-f006-42c7-b761-41d9fe3c566e\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") "
Jul 27 17:48:54.556084 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.555944    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-podinfo\") pod \"02d93d08-f006-42c7-b761-41d9fe3c566e\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") "
Jul 27 17:48:54.556084 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.555974    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-envoy\") pod \"02d93d08-f006-42c7-b761-41d9fe3c566e\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") "
Jul 27 17:48:54.556084 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.556004    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-token\") pod \"02d93d08-f006-42c7-b761-41d9fe3c566e\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") "
Jul 27 17:48:54.556318 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.556115    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "02d93d08-f006-42c7-b761-41d9fe3c566e" (UID: "02d93d08-f006-42c7-b761-41d9fe3c566e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:48:54.556318 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.556161    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzwtt\" (UniqueName: \"kubernetes.io/projected/02d93d08-f006-42c7-b761-41d9fe3c566e-kube-api-access-kzwtt\") pod \"02d93d08-f006-42c7-b761-41d9fe3c566e\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") "
Jul 27 17:48:54.556318 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.556187    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-credential-socket\") pod \"02d93d08-f006-42c7-b761-41d9fe3c566e\" (UID: \"02d93d08-f006-42c7-b761-41d9fe3c566e\") "
Jul 27 17:48:54.556318 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.556279    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "02d93d08-f006-42c7-b761-41d9fe3c566e" (UID: "02d93d08-f006-42c7-b761-41d9fe3c566e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:48:54.556566 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.556493    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02d93d08-f006-42c7-b761-41d9fe3c566e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "02d93d08-f006-42c7-b761-41d9fe3c566e" (UID: "02d93d08-f006-42c7-b761-41d9fe3c566e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:48:54.556566 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.556520    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "02d93d08-f006-42c7-b761-41d9fe3c566e" (UID: "02d93d08-f006-42c7-b761-41d9fe3c566e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:48:54.556662 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.556567    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-workload-certs\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:48:54.556662 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.556595    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-workload-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:48:54.556878 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.556827    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-data" (OuterVolumeSpecName: "istio-data") pod "02d93d08-f006-42c7-b761-41d9fe3c566e" (UID: "02d93d08-f006-42c7-b761-41d9fe3c566e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:48:54.558459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.558434    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-token" (OuterVolumeSpecName: "istio-token") pod "02d93d08-f006-42c7-b761-41d9fe3c566e" (UID: "02d93d08-f006-42c7-b761-41d9fe3c566e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:48:54.558548 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.558534    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "02d93d08-f006-42c7-b761-41d9fe3c566e" (UID: "02d93d08-f006-42c7-b761-41d9fe3c566e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 17:48:54.558895 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.558877    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "02d93d08-f006-42c7-b761-41d9fe3c566e" (UID: "02d93d08-f006-42c7-b761-41d9fe3c566e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:48:54.558942 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.558931    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02d93d08-f006-42c7-b761-41d9fe3c566e-kube-api-access-kzwtt" (OuterVolumeSpecName: "kube-api-access-kzwtt") pod "02d93d08-f006-42c7-b761-41d9fe3c566e" (UID: "02d93d08-f006-42c7-b761-41d9fe3c566e"). InnerVolumeSpecName "kube-api-access-kzwtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:48:54.657862 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.657828    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzwtt\" (UniqueName: \"kubernetes.io/projected/02d93d08-f006-42c7-b761-41d9fe3c566e-kube-api-access-kzwtt\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:48:54.657862 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.657855    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-credential-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:48:54.657862 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.657866    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-data\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:48:54.658084 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.657876    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02d93d08-f006-42c7-b761-41d9fe3c566e-istiod-ca-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:48:54.658084 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.657884    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-podinfo\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:48:54.658084 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.657891    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-envoy\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:48:54.658084 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:54.657898    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02d93d08-f006-42c7-b761-41d9fe3c566e-istio-token\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:48:55.327455 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:55.327392    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"
Jul 27 17:48:55.327455 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:55.327408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl" event={"ID":"02d93d08-f006-42c7-b761-41d9fe3c566e","Type":"ContainerDied","Data":"392d8ad51de8ad5a658cb29330ff1c9380e103b53c5e3c9ec1e23a5d64744258"}
Jul 27 17:48:55.327710 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:55.327528    2579 scope.go:117] "RemoveContainer" containerID="0831850f4156a597ad120679a3f308ad3c15c21c3d5988c52737ff1ed845afbb"
Jul 27 17:48:55.346142 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:55.346122    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"]
Jul 27 17:48:55.350514 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:55.350491    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5bebd9b0-openshift-default-77b68c7cc8-85ppl"]
Jul 27 17:48:56.994168 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:48:56.994136    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02d93d08-f006-42c7-b761-41d9fe3c566e" path="/var/lib/kubelet/pods/02d93d08-f006-42c7-b761-41d9fe3c566e/volumes"
Jul 27 17:49:05.329311 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:05.329282    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"
Jul 27 17:49:06.340440 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:06.336620    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"
Jul 27 17:49:17.520591 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:17.520511    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw"]
Jul 27 17:49:17.520973 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:17.520875    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02d93d08-f006-42c7-b761-41d9fe3c566e" containerName="istio-proxy"
Jul 27 17:49:17.520973 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:17.520886    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="02d93d08-f006-42c7-b761-41d9fe3c566e" containerName="istio-proxy"
Jul 27 17:49:17.520973 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:17.520894    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02d93d08-f006-42c7-b761-41d9fe3c566e" containerName="istio-proxy"
Jul 27 17:49:17.520973 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:17.520899    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="02d93d08-f006-42c7-b761-41d9fe3c566e" containerName="istio-proxy"
Jul 27 17:49:17.520973 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:17.520957    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="02d93d08-f006-42c7-b761-41d9fe3c566e" containerName="istio-proxy"
Jul 27 17:49:17.525341 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:17.525326    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw"
Jul 27 17:49:17.527386 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:17.527364    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ldh7c\""
Jul 27 17:49:17.532071 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:17.532042    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw"]
Jul 27 17:49:17.657436 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:17.657393    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3739a5aa-238c-4a26-8be6-91c1458d1a15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw\" (UID: \"3739a5aa-238c-4a26-8be6-91c1458d1a15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw"
Jul 27 17:49:17.758924 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:17.758890    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3739a5aa-238c-4a26-8be6-91c1458d1a15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw\" (UID: \"3739a5aa-238c-4a26-8be6-91c1458d1a15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw"
Jul 27 17:49:17.759554 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:17.759535    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3739a5aa-238c-4a26-8be6-91c1458d1a15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw\" (UID: \"3739a5aa-238c-4a26-8be6-91c1458d1a15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw"
Jul 27 17:49:17.837806 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:17.837771    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw"
Jul 27 17:49:17.973645 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:17.973619    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw"]
Jul 27 17:49:17.975765 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:49:17.975738    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3739a5aa_238c_4a26_8be6_91c1458d1a15.slice/crio-e4a9424295a2c77ce2c802c5a2df21443473f2f56f5f2e1d797bbb073c18bcd5 WatchSource:0}: Error finding container e4a9424295a2c77ce2c802c5a2df21443473f2f56f5f2e1d797bbb073c18bcd5: Status 404 returned error can't find the container with id e4a9424295a2c77ce2c802c5a2df21443473f2f56f5f2e1d797bbb073c18bcd5
Jul 27 17:49:18.449792 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:18.449755    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw" event={"ID":"3739a5aa-238c-4a26-8be6-91c1458d1a15","Type":"ContainerStarted","Data":"45006d4f47374a764e581b4af2969f378a87210a8024e95cf038599988c24ff4"}
Jul 27 17:49:18.449961 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:18.449808    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw" event={"ID":"3739a5aa-238c-4a26-8be6-91c1458d1a15","Type":"ContainerStarted","Data":"e4a9424295a2c77ce2c802c5a2df21443473f2f56f5f2e1d797bbb073c18bcd5"}
Jul 27 17:49:18.470829 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:18.470771    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw" podStartSLOduration=1.470755128 podStartE2EDuration="1.470755128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:49:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:49:18.462498596 +0000 UTC m=+1701.994249580" watchObservedRunningTime="2026-07-27 17:49:18.470755128 +0000 UTC m=+1702.002506114"
Jul 27 17:49:19.457469 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:19.457399    2579 generic.go:356] "Generic (PLEG): container finished" podID="3739a5aa-238c-4a26-8be6-91c1458d1a15" containerID="45006d4f47374a764e581b4af2969f378a87210a8024e95cf038599988c24ff4" exitCode=0
Jul 27 17:49:19.457912 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:19.457489    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw" event={"ID":"3739a5aa-238c-4a26-8be6-91c1458d1a15","Type":"ContainerDied","Data":"45006d4f47374a764e581b4af2969f378a87210a8024e95cf038599988c24ff4"}
Jul 27 17:49:20.596894 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:20.596868    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw"
Jul 27 17:49:20.788771 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:20.788746    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3739a5aa-238c-4a26-8be6-91c1458d1a15-maas-api-service-ca\") pod \"3739a5aa-238c-4a26-8be6-91c1458d1a15\" (UID: \"3739a5aa-238c-4a26-8be6-91c1458d1a15\") "
Jul 27 17:49:20.789125 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:20.789098    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3739a5aa-238c-4a26-8be6-91c1458d1a15-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3739a5aa-238c-4a26-8be6-91c1458d1a15" (UID: "3739a5aa-238c-4a26-8be6-91c1458d1a15"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:49:20.890228 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:20.890194    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3739a5aa-238c-4a26-8be6-91c1458d1a15-maas-api-service-ca\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:49:21.469701 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:21.469669    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw"
Jul 27 17:49:21.469701 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:21.469697    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw" event={"ID":"3739a5aa-238c-4a26-8be6-91c1458d1a15","Type":"ContainerDied","Data":"e4a9424295a2c77ce2c802c5a2df21443473f2f56f5f2e1d797bbb073c18bcd5"}
Jul 27 17:49:21.469914 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:21.469737    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4a9424295a2c77ce2c802c5a2df21443473f2f56f5f2e1d797bbb073c18bcd5"
Jul 27 17:49:28.025166 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.025125    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"]
Jul 27 17:49:28.025687 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.025367    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749" podUID="504f1d6b-e3a9-4aad-81d8-9555219de7cb" containerName="payload-processing" containerID="cri-o://11ce701492472ff439cb9ad38f02f8a53f4b03328debe3ed4a1ce0dda79825bf" gracePeriod=30
Jul 27 17:49:28.031770 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.031607    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"]
Jul 27 17:49:28.031909 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.031816    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq" podUID="15d54b63-cb82-4972-be2c-a736335a64cb" containerName="payload-pre-processing" containerID="cri-o://7aaef9cb7af5f247a6321af3af1cab359489c4758d10ef0b445d1a95665e4c95" gracePeriod=30
Jul 27 17:49:28.321253 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.321230    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"
Jul 27 17:49:28.323324 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.323295    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"
Jul 27 17:49:28.345550 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.345523    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gwrm\" (UniqueName: \"kubernetes.io/projected/504f1d6b-e3a9-4aad-81d8-9555219de7cb-kube-api-access-5gwrm\") pod \"504f1d6b-e3a9-4aad-81d8-9555219de7cb\" (UID: \"504f1d6b-e3a9-4aad-81d8-9555219de7cb\") "
Jul 27 17:49:28.345727 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.345569    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wkj2\" (UniqueName: \"kubernetes.io/projected/15d54b63-cb82-4972-be2c-a736335a64cb-kube-api-access-6wkj2\") pod \"15d54b63-cb82-4972-be2c-a736335a64cb\" (UID: \"15d54b63-cb82-4972-be2c-a736335a64cb\") "
Jul 27 17:49:28.345727 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.345635    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15d54b63-cb82-4972-be2c-a736335a64cb-plugins-config-volume\") pod \"15d54b63-cb82-4972-be2c-a736335a64cb\" (UID: \"15d54b63-cb82-4972-be2c-a736335a64cb\") "
Jul 27 17:49:28.345727 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.345674    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/504f1d6b-e3a9-4aad-81d8-9555219de7cb-plugins-config-volume\") pod \"504f1d6b-e3a9-4aad-81d8-9555219de7cb\" (UID: \"504f1d6b-e3a9-4aad-81d8-9555219de7cb\") "
Jul 27 17:49:28.346059 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.346032    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15d54b63-cb82-4972-be2c-a736335a64cb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "15d54b63-cb82-4972-be2c-a736335a64cb" (UID: "15d54b63-cb82-4972-be2c-a736335a64cb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:49:28.346156 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.346051    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/504f1d6b-e3a9-4aad-81d8-9555219de7cb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "504f1d6b-e3a9-4aad-81d8-9555219de7cb" (UID: "504f1d6b-e3a9-4aad-81d8-9555219de7cb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:49:28.348524 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.348498    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15d54b63-cb82-4972-be2c-a736335a64cb-kube-api-access-6wkj2" (OuterVolumeSpecName: "kube-api-access-6wkj2") pod "15d54b63-cb82-4972-be2c-a736335a64cb" (UID: "15d54b63-cb82-4972-be2c-a736335a64cb"). InnerVolumeSpecName "kube-api-access-6wkj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:49:28.348637 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.348529    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504f1d6b-e3a9-4aad-81d8-9555219de7cb-kube-api-access-5gwrm" (OuterVolumeSpecName: "kube-api-access-5gwrm") pod "504f1d6b-e3a9-4aad-81d8-9555219de7cb" (UID: "504f1d6b-e3a9-4aad-81d8-9555219de7cb"). InnerVolumeSpecName "kube-api-access-5gwrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:49:28.446320 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.446284    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15d54b63-cb82-4972-be2c-a736335a64cb-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:49:28.446320 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.446309    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/504f1d6b-e3a9-4aad-81d8-9555219de7cb-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:49:28.446320 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.446319    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gwrm\" (UniqueName: \"kubernetes.io/projected/504f1d6b-e3a9-4aad-81d8-9555219de7cb-kube-api-access-5gwrm\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:49:28.446561 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.446330    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wkj2\" (UniqueName: \"kubernetes.io/projected/15d54b63-cb82-4972-be2c-a736335a64cb-kube-api-access-6wkj2\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:49:28.518375 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.518332    2579 generic.go:356] "Generic (PLEG): container finished" podID="504f1d6b-e3a9-4aad-81d8-9555219de7cb" containerID="11ce701492472ff439cb9ad38f02f8a53f4b03328debe3ed4a1ce0dda79825bf" exitCode=0
Jul 27 17:49:28.518557 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.518444    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"
Jul 27 17:49:28.518662 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.518625    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749" event={"ID":"504f1d6b-e3a9-4aad-81d8-9555219de7cb","Type":"ContainerDied","Data":"11ce701492472ff439cb9ad38f02f8a53f4b03328debe3ed4a1ce0dda79825bf"}
Jul 27 17:49:28.518740 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.518721    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749" event={"ID":"504f1d6b-e3a9-4aad-81d8-9555219de7cb","Type":"ContainerDied","Data":"461512cf75a9753f68103176fcc190020f84470e879fcdc55055a31d16c3351a"}
Jul 27 17:49:28.518800 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.518754    2579 scope.go:117] "RemoveContainer" containerID="11ce701492472ff439cb9ad38f02f8a53f4b03328debe3ed4a1ce0dda79825bf"
Jul 27 17:49:28.520091 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.520069    2579 generic.go:356] "Generic (PLEG): container finished" podID="15d54b63-cb82-4972-be2c-a736335a64cb" containerID="7aaef9cb7af5f247a6321af3af1cab359489c4758d10ef0b445d1a95665e4c95" exitCode=0
Jul 27 17:49:28.520238 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.520117    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq" event={"ID":"15d54b63-cb82-4972-be2c-a736335a64cb","Type":"ContainerDied","Data":"7aaef9cb7af5f247a6321af3af1cab359489c4758d10ef0b445d1a95665e4c95"}
Jul 27 17:49:28.520238 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.520123    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"
Jul 27 17:49:28.520238 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.520151    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq" event={"ID":"15d54b63-cb82-4972-be2c-a736335a64cb","Type":"ContainerDied","Data":"01a6ec8be01d87b8ac1eb96c894fd8c10317061636e59414d9cb65b43aa9cf4a"}
Jul 27 17:49:28.528256 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.528236    2579 scope.go:117] "RemoveContainer" containerID="11ce701492472ff439cb9ad38f02f8a53f4b03328debe3ed4a1ce0dda79825bf"
Jul 27 17:49:28.528551 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:49:28.528527    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11ce701492472ff439cb9ad38f02f8a53f4b03328debe3ed4a1ce0dda79825bf\": container with ID starting with 11ce701492472ff439cb9ad38f02f8a53f4b03328debe3ed4a1ce0dda79825bf not found: ID does not exist" containerID="11ce701492472ff439cb9ad38f02f8a53f4b03328debe3ed4a1ce0dda79825bf"
Jul 27 17:49:28.528657 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.528554    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11ce701492472ff439cb9ad38f02f8a53f4b03328debe3ed4a1ce0dda79825bf"} err="failed to get container status \"11ce701492472ff439cb9ad38f02f8a53f4b03328debe3ed4a1ce0dda79825bf\": rpc error: code = NotFound desc = could not find container \"11ce701492472ff439cb9ad38f02f8a53f4b03328debe3ed4a1ce0dda79825bf\": container with ID starting with 11ce701492472ff439cb9ad38f02f8a53f4b03328debe3ed4a1ce0dda79825bf not found: ID does not exist"
Jul 27 17:49:28.528657 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.528570    2579 scope.go:117] "RemoveContainer" containerID="7aaef9cb7af5f247a6321af3af1cab359489c4758d10ef0b445d1a95665e4c95"
Jul 27 17:49:28.538983 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.538039    2579 scope.go:117] "RemoveContainer" containerID="7aaef9cb7af5f247a6321af3af1cab359489c4758d10ef0b445d1a95665e4c95"
Jul 27 17:49:28.538983 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:49:28.538950    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aaef9cb7af5f247a6321af3af1cab359489c4758d10ef0b445d1a95665e4c95\": container with ID starting with 7aaef9cb7af5f247a6321af3af1cab359489c4758d10ef0b445d1a95665e4c95 not found: ID does not exist" containerID="7aaef9cb7af5f247a6321af3af1cab359489c4758d10ef0b445d1a95665e4c95"
Jul 27 17:49:28.538983 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.538975    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aaef9cb7af5f247a6321af3af1cab359489c4758d10ef0b445d1a95665e4c95"} err="failed to get container status \"7aaef9cb7af5f247a6321af3af1cab359489c4758d10ef0b445d1a95665e4c95\": rpc error: code = NotFound desc = could not find container \"7aaef9cb7af5f247a6321af3af1cab359489c4758d10ef0b445d1a95665e4c95\": container with ID starting with 7aaef9cb7af5f247a6321af3af1cab359489c4758d10ef0b445d1a95665e4c95 not found: ID does not exist"
Jul 27 17:49:28.545381 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.545362    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"]
Jul 27 17:49:28.548651 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.548633    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d1a612f6-5bd794cd8-6wrmq"]
Jul 27 17:49:28.558194 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.558168    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"]
Jul 27 17:49:28.562313 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.562293    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d1a612f6-c69f97457-n7749"]
Jul 27 17:49:28.992845 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.992756    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15d54b63-cb82-4972-be2c-a736335a64cb" path="/var/lib/kubelet/pods/15d54b63-cb82-4972-be2c-a736335a64cb/volumes"
Jul 27 17:49:28.993206 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:28.993185    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="504f1d6b-e3a9-4aad-81d8-9555219de7cb" path="/var/lib/kubelet/pods/504f1d6b-e3a9-4aad-81d8-9555219de7cb/volumes"
Jul 27 17:49:32.611700 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:32.611669    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw"]
Jul 27 17:49:32.616115 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:32.616090    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d1a612f6-8d6cw"]
Jul 27 17:49:32.993588 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:32.993512    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3739a5aa-238c-4a26-8be6-91c1458d1a15" path="/var/lib/kubelet/pods/3739a5aa-238c-4a26-8be6-91c1458d1a15/volumes"
Jul 27 17:49:33.517483 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.517452    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"]
Jul 27 17:49:33.517897 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.517871    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3739a5aa-238c-4a26-8be6-91c1458d1a15" containerName="revoke-keys"
Jul 27 17:49:33.517897 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.517894    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3739a5aa-238c-4a26-8be6-91c1458d1a15" containerName="revoke-keys"
Jul 27 17:49:33.518072 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.517907    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d54b63-cb82-4972-be2c-a736335a64cb" containerName="payload-pre-processing"
Jul 27 17:49:33.518072 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.517916    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d54b63-cb82-4972-be2c-a736335a64cb" containerName="payload-pre-processing"
Jul 27 17:49:33.518072 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.517938    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="504f1d6b-e3a9-4aad-81d8-9555219de7cb" containerName="payload-processing"
Jul 27 17:49:33.518072 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.517947    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="504f1d6b-e3a9-4aad-81d8-9555219de7cb" containerName="payload-processing"
Jul 27 17:49:33.518072 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.518058    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="15d54b63-cb82-4972-be2c-a736335a64cb" containerName="payload-pre-processing"
Jul 27 17:49:33.518072 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.518070    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3739a5aa-238c-4a26-8be6-91c1458d1a15" containerName="revoke-keys"
Jul 27 17:49:33.518072 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.518078    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="504f1d6b-e3a9-4aad-81d8-9555219de7cb" containerName="payload-processing"
Jul 27 17:49:33.518393 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.518084    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="02d93d08-f006-42c7-b761-41d9fe3c566e" containerName="istio-proxy"
Jul 27 17:49:33.522872 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.522845    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.524843 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.524825    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-837a3b5f-openshift-default-dockercfg-kd4jc\""
Jul 27 17:49:33.538272 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.538081    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"]
Jul 27 17:49:33.587550 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.587512    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-data\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.587709 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.587560    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-podinfo\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.587709 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.587642    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-envoy\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.587709 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.587684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-credential-socket\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.587911 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.587719    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-token\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.587911 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.587743    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9n7w\" (UniqueName: \"kubernetes.io/projected/9e49de28-8e0f-45b1-9714-e9d0c458eb93-kube-api-access-k9n7w\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.587911 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.587777    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-workload-socket\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.587911 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.587822    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-workload-certs\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.587911 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.587861    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istiod-ca-cert\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.688942 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.688907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istiod-ca-cert\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.689410 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.688950    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-data\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.689410 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.688974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-podinfo\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.689410 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.689000    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-envoy\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.689410 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.689021    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-credential-socket\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.689410 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.689042    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-token\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.689410 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.689059    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9n7w\" (UniqueName: \"kubernetes.io/projected/9e49de28-8e0f-45b1-9714-e9d0c458eb93-kube-api-access-k9n7w\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.689410 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.689085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-workload-socket\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.689410 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.689131    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-workload-certs\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.689410 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.689380    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-data\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.689823 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.689475    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-credential-socket\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.689823 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.689656    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-workload-certs\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.689823 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.689814    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-workload-socket\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.689943 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.689858    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istiod-ca-cert\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.691710 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.691688    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-envoy\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.691959 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.691930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-podinfo\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.696947 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.696916    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9n7w\" (UniqueName: \"kubernetes.io/projected/9e49de28-8e0f-45b1-9714-e9d0c458eb93-kube-api-access-k9n7w\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.697099 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.697083    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-token\") pod \"e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") " pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.834112 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.834075    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:33.977703 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.977678    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"]
Jul 27 17:49:33.979788 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:49:33.979757    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e49de28_8e0f_45b1_9714_e9d0c458eb93.slice/crio-b735cddbda4b38cc40b2c4da131fe50083bf416b15e0e6eeae4b5410256fd5ec WatchSource:0}: Error finding container b735cddbda4b38cc40b2c4da131fe50083bf416b15e0e6eeae4b5410256fd5ec: Status 404 returned error can't find the container with id b735cddbda4b38cc40b2c4da131fe50083bf416b15e0e6eeae4b5410256fd5ec
Jul 27 17:49:33.981986 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.981949    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:49:33.982068 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.982037    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:49:33.982114 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:33.982078    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:49:34.556164 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:34.556127    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52" event={"ID":"9e49de28-8e0f-45b1-9714-e9d0c458eb93","Type":"ContainerStarted","Data":"f20e97f818458ee66843c2cb4c4d46af6b76e347d9cda924310cb94e48d1e143"}
Jul 27 17:49:34.556353 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:34.556183    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52" event={"ID":"9e49de28-8e0f-45b1-9714-e9d0c458eb93","Type":"ContainerStarted","Data":"b735cddbda4b38cc40b2c4da131fe50083bf416b15e0e6eeae4b5410256fd5ec"}
Jul 27 17:49:34.581380 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:34.581330    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52" podStartSLOduration=1.581315662 podStartE2EDuration="1.581315662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:49:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:49:34.579329768 +0000 UTC m=+1718.111080766" watchObservedRunningTime="2026-07-27 17:49:34.581315662 +0000 UTC m=+1718.113066647"
Jul 27 17:49:34.835118 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:34.835031    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:35.840332 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:35.840293    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:36.566551 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:36.566520    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:36.567601 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:36.567582    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:36.935273 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:36.935176    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"]
Jul 27 17:49:36.938230 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:36.938209    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"]
Jul 27 17:49:36.938371 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:36.938339    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"
Jul 27 17:49:36.940472 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:36.940450    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-837a3b5f\""
Jul 27 17:49:36.940582 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:36.940476    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-837a3b5f-dockercfg-xhkr7\""
Jul 27 17:49:36.941375 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:36.941360    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"
Jul 27 17:49:36.947352 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:36.946786    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"]
Jul 27 17:49:36.950197 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:36.950168    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"]
Jul 27 17:49:37.018655 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.018611    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e0ed5c6-a298-4a91-9e29-270a20ed6fba-plugins-config-volume\") pod \"payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm\" (UID: \"7e0ed5c6-a298-4a91-9e29-270a20ed6fba\") " pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"
Jul 27 17:49:37.018849 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.018670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqtzk\" (UniqueName: \"kubernetes.io/projected/aa29821f-74c9-4920-b12d-f730951bee0b-kube-api-access-fqtzk\") pod \"payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw\" (UID: \"aa29821f-74c9-4920-b12d-f730951bee0b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"
Jul 27 17:49:37.018849 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.018714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa29821f-74c9-4920-b12d-f730951bee0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw\" (UID: \"aa29821f-74c9-4920-b12d-f730951bee0b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"
Jul 27 17:49:37.018849 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.018773    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xrl4\" (UniqueName: \"kubernetes.io/projected/7e0ed5c6-a298-4a91-9e29-270a20ed6fba-kube-api-access-2xrl4\") pod \"payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm\" (UID: \"7e0ed5c6-a298-4a91-9e29-270a20ed6fba\") " pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"
Jul 27 17:49:37.119447 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.119386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa29821f-74c9-4920-b12d-f730951bee0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw\" (UID: \"aa29821f-74c9-4920-b12d-f730951bee0b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"
Jul 27 17:49:37.119631 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.119463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xrl4\" (UniqueName: \"kubernetes.io/projected/7e0ed5c6-a298-4a91-9e29-270a20ed6fba-kube-api-access-2xrl4\") pod \"payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm\" (UID: \"7e0ed5c6-a298-4a91-9e29-270a20ed6fba\") " pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"
Jul 27 17:49:37.119631 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.119517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e0ed5c6-a298-4a91-9e29-270a20ed6fba-plugins-config-volume\") pod \"payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm\" (UID: \"7e0ed5c6-a298-4a91-9e29-270a20ed6fba\") " pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"
Jul 27 17:49:37.119631 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.119566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqtzk\" (UniqueName: \"kubernetes.io/projected/aa29821f-74c9-4920-b12d-f730951bee0b-kube-api-access-fqtzk\") pod \"payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw\" (UID: \"aa29821f-74c9-4920-b12d-f730951bee0b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"
Jul 27 17:49:37.120209 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.120184    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa29821f-74c9-4920-b12d-f730951bee0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw\" (UID: \"aa29821f-74c9-4920-b12d-f730951bee0b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"
Jul 27 17:49:37.120374 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.120353    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e0ed5c6-a298-4a91-9e29-270a20ed6fba-plugins-config-volume\") pod \"payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm\" (UID: \"7e0ed5c6-a298-4a91-9e29-270a20ed6fba\") " pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"
Jul 27 17:49:37.127435 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.127389    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqtzk\" (UniqueName: \"kubernetes.io/projected/aa29821f-74c9-4920-b12d-f730951bee0b-kube-api-access-fqtzk\") pod \"payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw\" (UID: \"aa29821f-74c9-4920-b12d-f730951bee0b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"
Jul 27 17:49:37.127592 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.127573    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xrl4\" (UniqueName: \"kubernetes.io/projected/7e0ed5c6-a298-4a91-9e29-270a20ed6fba-kube-api-access-2xrl4\") pod \"payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm\" (UID: \"7e0ed5c6-a298-4a91-9e29-270a20ed6fba\") " pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"
Jul 27 17:49:37.251824 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.251741    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"
Jul 27 17:49:37.257994 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.257972    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"
Jul 27 17:49:37.404650 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.404546    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"]
Jul 27 17:49:37.444846 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.444807    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"]
Jul 27 17:49:37.574088 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.574051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw" event={"ID":"aa29821f-74c9-4920-b12d-f730951bee0b","Type":"ContainerStarted","Data":"b971364460b72aba759637ef6f0dcdadb6a0b3b1080295bd94c3c90835c8c992"}
Jul 27 17:49:37.574295 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.574106    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw" event={"ID":"aa29821f-74c9-4920-b12d-f730951bee0b","Type":"ContainerStarted","Data":"e8bd5c96cf0c5b7c044c8622226beca3ded9209507e3baca23dcae1076fd348a"}
Jul 27 17:49:37.574295 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.574161    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"
Jul 27 17:49:37.575703 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.575674    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm" event={"ID":"7e0ed5c6-a298-4a91-9e29-270a20ed6fba","Type":"ContainerStarted","Data":"cd20c363f5306a3905d590698ddc65a8233f7cd12c25f2a7e545ee315c836d75"}
Jul 27 17:49:37.575830 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.575719    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm" event={"ID":"7e0ed5c6-a298-4a91-9e29-270a20ed6fba","Type":"ContainerStarted","Data":"cbee5900d25261702d0d3bbc23efdfbc51043611d36b5f785e0839aae4fcb196"}
Jul 27 17:49:37.575830 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.575743    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"
Jul 27 17:49:37.593090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.593028    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw" podStartSLOduration=1.593013568 podStartE2EDuration="1.593013568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:49:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:49:37.589906929 +0000 UTC m=+1721.121657916" watchObservedRunningTime="2026-07-27 17:49:37.593013568 +0000 UTC m=+1721.124764554"
Jul 27 17:49:37.621326 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:37.621261    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm" podStartSLOduration=1.621240976 podStartE2EDuration="1.621240976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:49:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:49:37.618518955 +0000 UTC m=+1721.150269941" watchObservedRunningTime="2026-07-27 17:49:37.621240976 +0000 UTC m=+1721.152991963"
Jul 27 17:49:48.583312 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:48.583282    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"
Jul 27 17:49:48.583745 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:48.583532    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"
Jul 27 17:49:51.568227 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:51.568181    2579 patch_prober.go:28] interesting pod/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 27 17:49:51.568818 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:51.568250    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52" podUID="9e49de28-8e0f-45b1-9714-e9d0c458eb93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 27 17:49:51.665922 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:51.665892    2579 generic.go:356] "Generic (PLEG): container finished" podID="9e49de28-8e0f-45b1-9714-e9d0c458eb93" containerID="f20e97f818458ee66843c2cb4c4d46af6b76e347d9cda924310cb94e48d1e143" exitCode=0
Jul 27 17:49:51.666102 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:51.665933    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52" event={"ID":"9e49de28-8e0f-45b1-9714-e9d0c458eb93","Type":"ContainerDied","Data":"f20e97f818458ee66843c2cb4c4d46af6b76e347d9cda924310cb94e48d1e143"}
Jul 27 17:49:51.666468 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:51.666449    2579 scope.go:117] "RemoveContainer" containerID="f20e97f818458ee66843c2cb4c4d46af6b76e347d9cda924310cb94e48d1e143"
Jul 27 17:49:51.667515 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:51.667487    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:49:51.667610 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:51.667568    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:49:51.667677 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:51.667635    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:49:52.672925 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:52.672889    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52" event={"ID":"9e49de28-8e0f-45b1-9714-e9d0c458eb93","Type":"ContainerStarted","Data":"c3a0e16fe2062008e2b7c8642749c9d9dba3e2cdd600b3b4b6e7ce1bde41d42d"}
Jul 27 17:49:52.834521 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:52.834481    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:52.834908 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:52.834873    2579 patch_prober.go:28] interesting pod/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 27 17:49:52.835011 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:52.834949    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52" podUID="9e49de28-8e0f-45b1-9714-e9d0c458eb93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 27 17:49:53.835327 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:53.835291    2579 patch_prober.go:28] interesting pod/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 27 17:49:53.835746 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:53.835346    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52" podUID="9e49de28-8e0f-45b1-9714-e9d0c458eb93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 27 17:49:54.835051 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:54.835015    2579 patch_prober.go:28] interesting pod/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 27 17:49:54.835233 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:54.835071    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52" podUID="9e49de28-8e0f-45b1-9714-e9d0c458eb93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 27 17:49:55.835016 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:55.834973    2579 patch_prober.go:28] interesting pod/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 27 17:49:55.835406 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:55.835036    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52" podUID="9e49de28-8e0f-45b1-9714-e9d0c458eb93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 27 17:49:56.838054 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:56.838026    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:56.838560 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:56.838545    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:49:56.839118 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:49:56.839097    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:50:12.267490 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.267452    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"]
Jul 27 17:50:12.268017 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.267759    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm" podUID="7e0ed5c6-a298-4a91-9e29-270a20ed6fba" containerName="payload-processing" containerID="cri-o://cd20c363f5306a3905d590698ddc65a8233f7cd12c25f2a7e545ee315c836d75" gracePeriod=30
Jul 27 17:50:12.274747 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.274723    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"]
Jul 27 17:50:12.275190 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.275161    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw" podUID="aa29821f-74c9-4920-b12d-f730951bee0b" containerName="payload-pre-processing" containerID="cri-o://b971364460b72aba759637ef6f0dcdadb6a0b3b1080295bd94c3c90835c8c992" gracePeriod=30
Jul 27 17:50:12.550579 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.550551    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"
Jul 27 17:50:12.582597 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.582570    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"
Jul 27 17:50:12.648948 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.648918    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e0ed5c6-a298-4a91-9e29-270a20ed6fba-plugins-config-volume\") pod \"7e0ed5c6-a298-4a91-9e29-270a20ed6fba\" (UID: \"7e0ed5c6-a298-4a91-9e29-270a20ed6fba\") "
Jul 27 17:50:12.649100 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.648996    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xrl4\" (UniqueName: \"kubernetes.io/projected/7e0ed5c6-a298-4a91-9e29-270a20ed6fba-kube-api-access-2xrl4\") pod \"7e0ed5c6-a298-4a91-9e29-270a20ed6fba\" (UID: \"7e0ed5c6-a298-4a91-9e29-270a20ed6fba\") "
Jul 27 17:50:12.649295 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.649271    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e0ed5c6-a298-4a91-9e29-270a20ed6fba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7e0ed5c6-a298-4a91-9e29-270a20ed6fba" (UID: "7e0ed5c6-a298-4a91-9e29-270a20ed6fba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:50:12.651206 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.651184    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e0ed5c6-a298-4a91-9e29-270a20ed6fba-kube-api-access-2xrl4" (OuterVolumeSpecName: "kube-api-access-2xrl4") pod "7e0ed5c6-a298-4a91-9e29-270a20ed6fba" (UID: "7e0ed5c6-a298-4a91-9e29-270a20ed6fba"). InnerVolumeSpecName "kube-api-access-2xrl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:50:12.749827 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.749788    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa29821f-74c9-4920-b12d-f730951bee0b-plugins-config-volume\") pod \"aa29821f-74c9-4920-b12d-f730951bee0b\" (UID: \"aa29821f-74c9-4920-b12d-f730951bee0b\") "
Jul 27 17:50:12.750016 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.749914    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqtzk\" (UniqueName: \"kubernetes.io/projected/aa29821f-74c9-4920-b12d-f730951bee0b-kube-api-access-fqtzk\") pod \"aa29821f-74c9-4920-b12d-f730951bee0b\" (UID: \"aa29821f-74c9-4920-b12d-f730951bee0b\") "
Jul 27 17:50:12.750146 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.750129    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xrl4\" (UniqueName: \"kubernetes.io/projected/7e0ed5c6-a298-4a91-9e29-270a20ed6fba-kube-api-access-2xrl4\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:12.750210 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.750139    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa29821f-74c9-4920-b12d-f730951bee0b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aa29821f-74c9-4920-b12d-f730951bee0b" (UID: "aa29821f-74c9-4920-b12d-f730951bee0b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:50:12.750210 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.750151    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e0ed5c6-a298-4a91-9e29-270a20ed6fba-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:12.752162 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.752142    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa29821f-74c9-4920-b12d-f730951bee0b-kube-api-access-fqtzk" (OuterVolumeSpecName: "kube-api-access-fqtzk") pod "aa29821f-74c9-4920-b12d-f730951bee0b" (UID: "aa29821f-74c9-4920-b12d-f730951bee0b"). InnerVolumeSpecName "kube-api-access-fqtzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:50:12.782231 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.782155    2579 generic.go:356] "Generic (PLEG): container finished" podID="aa29821f-74c9-4920-b12d-f730951bee0b" containerID="b971364460b72aba759637ef6f0dcdadb6a0b3b1080295bd94c3c90835c8c992" exitCode=0
Jul 27 17:50:12.782231 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.782215    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"
Jul 27 17:50:12.782387 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.782244    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw" event={"ID":"aa29821f-74c9-4920-b12d-f730951bee0b","Type":"ContainerDied","Data":"b971364460b72aba759637ef6f0dcdadb6a0b3b1080295bd94c3c90835c8c992"}
Jul 27 17:50:12.782387 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.782346    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw" event={"ID":"aa29821f-74c9-4920-b12d-f730951bee0b","Type":"ContainerDied","Data":"e8bd5c96cf0c5b7c044c8622226beca3ded9209507e3baca23dcae1076fd348a"}
Jul 27 17:50:12.782511 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.782386    2579 scope.go:117] "RemoveContainer" containerID="b971364460b72aba759637ef6f0dcdadb6a0b3b1080295bd94c3c90835c8c992"
Jul 27 17:50:12.783591 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.783569    2579 generic.go:356] "Generic (PLEG): container finished" podID="7e0ed5c6-a298-4a91-9e29-270a20ed6fba" containerID="cd20c363f5306a3905d590698ddc65a8233f7cd12c25f2a7e545ee315c836d75" exitCode=0
Jul 27 17:50:12.783672 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.783612    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"
Jul 27 17:50:12.783672 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.783648    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm" event={"ID":"7e0ed5c6-a298-4a91-9e29-270a20ed6fba","Type":"ContainerDied","Data":"cd20c363f5306a3905d590698ddc65a8233f7cd12c25f2a7e545ee315c836d75"}
Jul 27 17:50:12.783770 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.783702    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm" event={"ID":"7e0ed5c6-a298-4a91-9e29-270a20ed6fba","Type":"ContainerDied","Data":"cbee5900d25261702d0d3bbc23efdfbc51043611d36b5f785e0839aae4fcb196"}
Jul 27 17:50:12.792034 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.792018    2579 scope.go:117] "RemoveContainer" containerID="b971364460b72aba759637ef6f0dcdadb6a0b3b1080295bd94c3c90835c8c992"
Jul 27 17:50:12.792292 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:50:12.792272    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b971364460b72aba759637ef6f0dcdadb6a0b3b1080295bd94c3c90835c8c992\": container with ID starting with b971364460b72aba759637ef6f0dcdadb6a0b3b1080295bd94c3c90835c8c992 not found: ID does not exist" containerID="b971364460b72aba759637ef6f0dcdadb6a0b3b1080295bd94c3c90835c8c992"
Jul 27 17:50:12.792350 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.792304    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b971364460b72aba759637ef6f0dcdadb6a0b3b1080295bd94c3c90835c8c992"} err="failed to get container status \"b971364460b72aba759637ef6f0dcdadb6a0b3b1080295bd94c3c90835c8c992\": rpc error: code = NotFound desc = could not find container \"b971364460b72aba759637ef6f0dcdadb6a0b3b1080295bd94c3c90835c8c992\": container with ID starting with b971364460b72aba759637ef6f0dcdadb6a0b3b1080295bd94c3c90835c8c992 not found: ID does not exist"
Jul 27 17:50:12.792350 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.792326    2579 scope.go:117] "RemoveContainer" containerID="cd20c363f5306a3905d590698ddc65a8233f7cd12c25f2a7e545ee315c836d75"
Jul 27 17:50:12.800328 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.800312    2579 scope.go:117] "RemoveContainer" containerID="cd20c363f5306a3905d590698ddc65a8233f7cd12c25f2a7e545ee315c836d75"
Jul 27 17:50:12.800582 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:50:12.800564    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd20c363f5306a3905d590698ddc65a8233f7cd12c25f2a7e545ee315c836d75\": container with ID starting with cd20c363f5306a3905d590698ddc65a8233f7cd12c25f2a7e545ee315c836d75 not found: ID does not exist" containerID="cd20c363f5306a3905d590698ddc65a8233f7cd12c25f2a7e545ee315c836d75"
Jul 27 17:50:12.800634 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.800588    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd20c363f5306a3905d590698ddc65a8233f7cd12c25f2a7e545ee315c836d75"} err="failed to get container status \"cd20c363f5306a3905d590698ddc65a8233f7cd12c25f2a7e545ee315c836d75\": rpc error: code = NotFound desc = could not find container \"cd20c363f5306a3905d590698ddc65a8233f7cd12c25f2a7e545ee315c836d75\": container with ID starting with cd20c363f5306a3905d590698ddc65a8233f7cd12c25f2a7e545ee315c836d75 not found: ID does not exist"
Jul 27 17:50:12.806057 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.806037    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"]
Jul 27 17:50:12.812379 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.812358    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-837a3b5f-5877b4f64-5ffrw"]
Jul 27 17:50:12.821362 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.821335    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"]
Jul 27 17:50:12.826856 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.826831    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-837a3b5f-7d74744bb-7ntpm"]
Jul 27 17:50:12.851127 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.851100    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa29821f-74c9-4920-b12d-f730951bee0b-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:12.851127 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.851126    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqtzk\" (UniqueName: \"kubernetes.io/projected/aa29821f-74c9-4920-b12d-f730951bee0b-kube-api-access-fqtzk\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:12.993337 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.993304    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e0ed5c6-a298-4a91-9e29-270a20ed6fba" path="/var/lib/kubelet/pods/7e0ed5c6-a298-4a91-9e29-270a20ed6fba/volumes"
Jul 27 17:50:12.993701 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:12.993686    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa29821f-74c9-4920-b12d-f730951bee0b" path="/var/lib/kubelet/pods/aa29821f-74c9-4920-b12d-f730951bee0b/volumes"
Jul 27 17:50:17.843820 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:17.843782    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"]
Jul 27 17:50:17.844281 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:17.844066    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52" podUID="9e49de28-8e0f-45b1-9714-e9d0c458eb93" containerName="istio-proxy" containerID="cri-o://c3a0e16fe2062008e2b7c8642749c9d9dba3e2cdd600b3b4b6e7ce1bde41d42d" gracePeriod=30
Jul 27 17:50:21.745688 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.745656    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"]
Jul 27 17:50:21.746164 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.745994    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa29821f-74c9-4920-b12d-f730951bee0b" containerName="payload-pre-processing"
Jul 27 17:50:21.746164 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.746004    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa29821f-74c9-4920-b12d-f730951bee0b" containerName="payload-pre-processing"
Jul 27 17:50:21.746164 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.746013    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e0ed5c6-a298-4a91-9e29-270a20ed6fba" containerName="payload-processing"
Jul 27 17:50:21.746164 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.746018    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e0ed5c6-a298-4a91-9e29-270a20ed6fba" containerName="payload-processing"
Jul 27 17:50:21.746164 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.746086    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e0ed5c6-a298-4a91-9e29-270a20ed6fba" containerName="payload-processing"
Jul 27 17:50:21.746164 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.746095    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa29821f-74c9-4920-b12d-f730951bee0b" containerName="payload-pre-processing"
Jul 27 17:50:21.750740 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.750721    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"
Jul 27 17:50:21.753128 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.753105    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-d5de8abc\""
Jul 27 17:50:21.753245 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.753153    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-d5de8abc-dockercfg-j65sc\""
Jul 27 17:50:21.758735 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.758713    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"]
Jul 27 17:50:21.764516 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.764494    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"]
Jul 27 17:50:21.767831 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.767814    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"
Jul 27 17:50:21.776852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.776828    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"]
Jul 27 17:50:21.825260 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.825223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e1683db-7bba-4c26-aea6-e72684055abf-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6\" (UID: \"5e1683db-7bba-4c26-aea6-e72684055abf\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"
Jul 27 17:50:21.825450 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.825304    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsg7v\" (UniqueName: \"kubernetes.io/projected/e5f61f57-184b-4ec2-9500-a7ee2abca727-kube-api-access-lsg7v\") pod \"payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc\" (UID: \"e5f61f57-184b-4ec2-9500-a7ee2abca727\") " pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"
Jul 27 17:50:21.825450 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.825329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5f61f57-184b-4ec2-9500-a7ee2abca727-plugins-config-volume\") pod \"payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc\" (UID: \"e5f61f57-184b-4ec2-9500-a7ee2abca727\") " pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"
Jul 27 17:50:21.825450 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.825351    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4vm5\" (UniqueName: \"kubernetes.io/projected/5e1683db-7bba-4c26-aea6-e72684055abf-kube-api-access-h4vm5\") pod \"payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6\" (UID: \"5e1683db-7bba-4c26-aea6-e72684055abf\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"
Jul 27 17:50:21.926147 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.926107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsg7v\" (UniqueName: \"kubernetes.io/projected/e5f61f57-184b-4ec2-9500-a7ee2abca727-kube-api-access-lsg7v\") pod \"payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc\" (UID: \"e5f61f57-184b-4ec2-9500-a7ee2abca727\") " pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"
Jul 27 17:50:21.926353 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.926157    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5f61f57-184b-4ec2-9500-a7ee2abca727-plugins-config-volume\") pod \"payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc\" (UID: \"e5f61f57-184b-4ec2-9500-a7ee2abca727\") " pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"
Jul 27 17:50:21.926353 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.926197    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4vm5\" (UniqueName: \"kubernetes.io/projected/5e1683db-7bba-4c26-aea6-e72684055abf-kube-api-access-h4vm5\") pod \"payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6\" (UID: \"5e1683db-7bba-4c26-aea6-e72684055abf\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"
Jul 27 17:50:21.926353 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.926245    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e1683db-7bba-4c26-aea6-e72684055abf-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6\" (UID: \"5e1683db-7bba-4c26-aea6-e72684055abf\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"
Jul 27 17:50:21.926960 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.926936    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5f61f57-184b-4ec2-9500-a7ee2abca727-plugins-config-volume\") pod \"payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc\" (UID: \"e5f61f57-184b-4ec2-9500-a7ee2abca727\") " pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"
Jul 27 17:50:21.927051 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.926958    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e1683db-7bba-4c26-aea6-e72684055abf-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6\" (UID: \"5e1683db-7bba-4c26-aea6-e72684055abf\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"
Jul 27 17:50:21.934526 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.934500    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4vm5\" (UniqueName: \"kubernetes.io/projected/5e1683db-7bba-4c26-aea6-e72684055abf-kube-api-access-h4vm5\") pod \"payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6\" (UID: \"5e1683db-7bba-4c26-aea6-e72684055abf\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"
Jul 27 17:50:21.934919 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:21.934901    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsg7v\" (UniqueName: \"kubernetes.io/projected/e5f61f57-184b-4ec2-9500-a7ee2abca727-kube-api-access-lsg7v\") pod \"payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc\" (UID: \"e5f61f57-184b-4ec2-9500-a7ee2abca727\") " pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"
Jul 27 17:50:22.061487 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:22.061447    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"
Jul 27 17:50:22.078728 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:22.078703    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"
Jul 27 17:50:22.415960 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:22.415843    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"]
Jul 27 17:50:22.418222 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:50:22.418188    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e1683db_7bba_4c26_aea6_e72684055abf.slice/crio-58c6470df8e68667454f8ebbfa6bd5de406da8ccae281205c3ef509aece38690 WatchSource:0}: Error finding container 58c6470df8e68667454f8ebbfa6bd5de406da8ccae281205c3ef509aece38690: Status 404 returned error can't find the container with id 58c6470df8e68667454f8ebbfa6bd5de406da8ccae281205c3ef509aece38690
Jul 27 17:50:22.448797 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:22.448776    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"]
Jul 27 17:50:22.454448 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:50:22.454408    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f61f57_184b_4ec2_9500_a7ee2abca727.slice/crio-d332a5060fcdfb8983fe99be68131b915b50c8d0b7948211dd3034457c731992 WatchSource:0}: Error finding container d332a5060fcdfb8983fe99be68131b915b50c8d0b7948211dd3034457c731992: Status 404 returned error can't find the container with id d332a5060fcdfb8983fe99be68131b915b50c8d0b7948211dd3034457c731992
Jul 27 17:50:22.843931 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:22.843892    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6" event={"ID":"5e1683db-7bba-4c26-aea6-e72684055abf","Type":"ContainerStarted","Data":"6c9af0701f89eb82586a3e089d948955e1713eded5d41abaa09e6e66363c8f96"}
Jul 27 17:50:22.844412 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:22.843964    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"
Jul 27 17:50:22.844412 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:22.843991    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6" event={"ID":"5e1683db-7bba-4c26-aea6-e72684055abf","Type":"ContainerStarted","Data":"58c6470df8e68667454f8ebbfa6bd5de406da8ccae281205c3ef509aece38690"}
Jul 27 17:50:22.845389 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:22.845362    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc" event={"ID":"e5f61f57-184b-4ec2-9500-a7ee2abca727","Type":"ContainerStarted","Data":"3c45c5ed2a42e9e7ff2ef8b613135cdf0643d2fb6d289b8b484cc0681206a9de"}
Jul 27 17:50:22.845538 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:22.845400    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc" event={"ID":"e5f61f57-184b-4ec2-9500-a7ee2abca727","Type":"ContainerStarted","Data":"d332a5060fcdfb8983fe99be68131b915b50c8d0b7948211dd3034457c731992"}
Jul 27 17:50:22.845590 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:22.845535    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"
Jul 27 17:50:22.875688 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:22.875641    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6" podStartSLOduration=1.875626137 podStartE2EDuration="1.875626137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:50:22.868270083 +0000 UTC m=+1766.400021068" watchObservedRunningTime="2026-07-27 17:50:22.875626137 +0000 UTC m=+1766.407377123"
Jul 27 17:50:22.962992 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:22.962944    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc" podStartSLOduration=1.962928008 podStartE2EDuration="1.962928008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:50:22.960752096 +0000 UTC m=+1766.492503082" watchObservedRunningTime="2026-07-27 17:50:22.962928008 +0000 UTC m=+1766.494678994"
Jul 27 17:50:23.117240 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.117196    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:50:23.137253 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.137220    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-token\") pod \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") "
Jul 27 17:50:23.137405 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.137269    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-credential-socket\") pod \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") "
Jul 27 17:50:23.137405 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.137304    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-envoy\") pod \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") "
Jul 27 17:50:23.137405 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.137335    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-podinfo\") pod \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") "
Jul 27 17:50:23.137405 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.137361    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istiod-ca-cert\") pod \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") "
Jul 27 17:50:23.137405 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.137403    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-data\") pod \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") "
Jul 27 17:50:23.137709 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.137465    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9n7w\" (UniqueName: \"kubernetes.io/projected/9e49de28-8e0f-45b1-9714-e9d0c458eb93-kube-api-access-k9n7w\") pod \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") "
Jul 27 17:50:23.137709 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.137550    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-workload-certs\") pod \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") "
Jul 27 17:50:23.137709 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.137634    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e49de28-8e0f-45b1-9714-e9d0c458eb93" (UID: "9e49de28-8e0f-45b1-9714-e9d0c458eb93"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:50:23.138000 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.137947    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e49de28-8e0f-45b1-9714-e9d0c458eb93" (UID: "9e49de28-8e0f-45b1-9714-e9d0c458eb93"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:50:23.138000 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.138001    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e49de28-8e0f-45b1-9714-e9d0c458eb93" (UID: "9e49de28-8e0f-45b1-9714-e9d0c458eb93"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:50:23.138254 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.138112    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-workload-socket\") pod \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\" (UID: \"9e49de28-8e0f-45b1-9714-e9d0c458eb93\") "
Jul 27 17:50:23.138337 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.138309    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e49de28-8e0f-45b1-9714-e9d0c458eb93" (UID: "9e49de28-8e0f-45b1-9714-e9d0c458eb93"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:50:23.138411 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.138393    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e49de28-8e0f-45b1-9714-e9d0c458eb93" (UID: "9e49de28-8e0f-45b1-9714-e9d0c458eb93"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:50:23.138504 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.138485    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-workload-certs\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:23.138504 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.138500    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-credential-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:23.138614 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.138508    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istiod-ca-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:23.138614 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.138520    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-data\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:23.139958 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.139929    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e49de28-8e0f-45b1-9714-e9d0c458eb93" (UID: "9e49de28-8e0f-45b1-9714-e9d0c458eb93"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:50:23.140141 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.140120    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e49de28-8e0f-45b1-9714-e9d0c458eb93" (UID: "9e49de28-8e0f-45b1-9714-e9d0c458eb93"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 17:50:23.140661 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.140627    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e49de28-8e0f-45b1-9714-e9d0c458eb93" (UID: "9e49de28-8e0f-45b1-9714-e9d0c458eb93"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:50:23.141263 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.141221    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e49de28-8e0f-45b1-9714-e9d0c458eb93-kube-api-access-k9n7w" (OuterVolumeSpecName: "kube-api-access-k9n7w") pod "9e49de28-8e0f-45b1-9714-e9d0c458eb93" (UID: "9e49de28-8e0f-45b1-9714-e9d0c458eb93"). InnerVolumeSpecName "kube-api-access-k9n7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:50:23.239322 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.239290    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-envoy\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:23.239322 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.239321    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-podinfo\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:23.239564 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.239333    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9n7w\" (UniqueName: \"kubernetes.io/projected/9e49de28-8e0f-45b1-9714-e9d0c458eb93-kube-api-access-k9n7w\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:23.239564 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.239343    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e49de28-8e0f-45b1-9714-e9d0c458eb93-workload-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:23.239564 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.239353    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e49de28-8e0f-45b1-9714-e9d0c458eb93-istio-token\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:23.853556 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.853520    2579 generic.go:356] "Generic (PLEG): container finished" podID="9e49de28-8e0f-45b1-9714-e9d0c458eb93" containerID="c3a0e16fe2062008e2b7c8642749c9d9dba3e2cdd600b3b4b6e7ce1bde41d42d" exitCode=0
Jul 27 17:50:23.853968 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.853573    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"
Jul 27 17:50:23.853968 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.853606    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52" event={"ID":"9e49de28-8e0f-45b1-9714-e9d0c458eb93","Type":"ContainerDied","Data":"c3a0e16fe2062008e2b7c8642749c9d9dba3e2cdd600b3b4b6e7ce1bde41d42d"}
Jul 27 17:50:23.853968 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.853672    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52" event={"ID":"9e49de28-8e0f-45b1-9714-e9d0c458eb93","Type":"ContainerDied","Data":"b735cddbda4b38cc40b2c4da131fe50083bf416b15e0e6eeae4b5410256fd5ec"}
Jul 27 17:50:23.853968 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.853696    2579 scope.go:117] "RemoveContainer" containerID="c3a0e16fe2062008e2b7c8642749c9d9dba3e2cdd600b3b4b6e7ce1bde41d42d"
Jul 27 17:50:23.863941 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.863924    2579 scope.go:117] "RemoveContainer" containerID="f20e97f818458ee66843c2cb4c4d46af6b76e347d9cda924310cb94e48d1e143"
Jul 27 17:50:23.871991 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.871972    2579 scope.go:117] "RemoveContainer" containerID="c3a0e16fe2062008e2b7c8642749c9d9dba3e2cdd600b3b4b6e7ce1bde41d42d"
Jul 27 17:50:23.872226 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:50:23.872211    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3a0e16fe2062008e2b7c8642749c9d9dba3e2cdd600b3b4b6e7ce1bde41d42d\": container with ID starting with c3a0e16fe2062008e2b7c8642749c9d9dba3e2cdd600b3b4b6e7ce1bde41d42d not found: ID does not exist" containerID="c3a0e16fe2062008e2b7c8642749c9d9dba3e2cdd600b3b4b6e7ce1bde41d42d"
Jul 27 17:50:23.872276 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.872235    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3a0e16fe2062008e2b7c8642749c9d9dba3e2cdd600b3b4b6e7ce1bde41d42d"} err="failed to get container status \"c3a0e16fe2062008e2b7c8642749c9d9dba3e2cdd600b3b4b6e7ce1bde41d42d\": rpc error: code = NotFound desc = could not find container \"c3a0e16fe2062008e2b7c8642749c9d9dba3e2cdd600b3b4b6e7ce1bde41d42d\": container with ID starting with c3a0e16fe2062008e2b7c8642749c9d9dba3e2cdd600b3b4b6e7ce1bde41d42d not found: ID does not exist"
Jul 27 17:50:23.872276 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.872250    2579 scope.go:117] "RemoveContainer" containerID="f20e97f818458ee66843c2cb4c4d46af6b76e347d9cda924310cb94e48d1e143"
Jul 27 17:50:23.872477 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:50:23.872460    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f20e97f818458ee66843c2cb4c4d46af6b76e347d9cda924310cb94e48d1e143\": container with ID starting with f20e97f818458ee66843c2cb4c4d46af6b76e347d9cda924310cb94e48d1e143 not found: ID does not exist" containerID="f20e97f818458ee66843c2cb4c4d46af6b76e347d9cda924310cb94e48d1e143"
Jul 27 17:50:23.872525 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.872484    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f20e97f818458ee66843c2cb4c4d46af6b76e347d9cda924310cb94e48d1e143"} err="failed to get container status \"f20e97f818458ee66843c2cb4c4d46af6b76e347d9cda924310cb94e48d1e143\": rpc error: code = NotFound desc = could not find container \"f20e97f818458ee66843c2cb4c4d46af6b76e347d9cda924310cb94e48d1e143\": container with ID starting with f20e97f818458ee66843c2cb4c4d46af6b76e347d9cda924310cb94e48d1e143 not found: ID does not exist"
Jul 27 17:50:23.878516 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.878494    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"]
Jul 27 17:50:23.882251 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:23.882218    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-837a3b5f-openshift-default-5dd5865d4b-f5j52"]
Jul 27 17:50:24.993462 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:24.993406    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e49de28-8e0f-45b1-9714-e9d0c458eb93" path="/var/lib/kubelet/pods/9e49de28-8e0f-45b1-9714-e9d0c458eb93/volumes"
Jul 27 17:50:33.856021 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:33.855988    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"
Jul 27 17:50:33.856394 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:33.856067    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"
Jul 27 17:50:45.764657 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:45.764623    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq"]
Jul 27 17:50:45.765105 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:45.764981    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e49de28-8e0f-45b1-9714-e9d0c458eb93" containerName="istio-proxy"
Jul 27 17:50:45.765105 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:45.764992    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e49de28-8e0f-45b1-9714-e9d0c458eb93" containerName="istio-proxy"
Jul 27 17:50:45.765105 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:45.765055    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e49de28-8e0f-45b1-9714-e9d0c458eb93" containerName="istio-proxy"
Jul 27 17:50:45.767640 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:45.767622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq"
Jul 27 17:50:45.774575 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:45.774546    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ldh7c\""
Jul 27 17:50:45.788485 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:45.788453    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq"]
Jul 27 17:50:45.841625 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:45.841591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78af7d7b-c893-45d2-813d-19f9eed61e68-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq\" (UID: \"78af7d7b-c893-45d2-813d-19f9eed61e68\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq"
Jul 27 17:50:45.942504 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:45.942471    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78af7d7b-c893-45d2-813d-19f9eed61e68-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq\" (UID: \"78af7d7b-c893-45d2-813d-19f9eed61e68\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq"
Jul 27 17:50:45.943098 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:45.943077    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78af7d7b-c893-45d2-813d-19f9eed61e68-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq\" (UID: \"78af7d7b-c893-45d2-813d-19f9eed61e68\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq"
Jul 27 17:50:46.077673 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:46.077643    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq"
Jul 27 17:50:46.216638 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:46.216605    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq"]
Jul 27 17:50:46.217955 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:50:46.217923    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78af7d7b_c893_45d2_813d_19f9eed61e68.slice/crio-48606e44a75869407b0fd3ccdbb64015128bbfcd32e27a57d7711769e1d7462c WatchSource:0}: Error finding container 48606e44a75869407b0fd3ccdbb64015128bbfcd32e27a57d7711769e1d7462c: Status 404 returned error can't find the container with id 48606e44a75869407b0fd3ccdbb64015128bbfcd32e27a57d7711769e1d7462c
Jul 27 17:50:46.982231 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:46.982150    2579 generic.go:356] "Generic (PLEG): container finished" podID="78af7d7b-c893-45d2-813d-19f9eed61e68" containerID="938c85eb48c6d2d0691991322452cd283ca58113456ddf264be7c76d4612dc33" exitCode=0
Jul 27 17:50:46.982231 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:46.982215    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq" event={"ID":"78af7d7b-c893-45d2-813d-19f9eed61e68","Type":"ContainerDied","Data":"938c85eb48c6d2d0691991322452cd283ca58113456ddf264be7c76d4612dc33"}
Jul 27 17:50:46.982657 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:46.982279    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq" event={"ID":"78af7d7b-c893-45d2-813d-19f9eed61e68","Type":"ContainerStarted","Data":"48606e44a75869407b0fd3ccdbb64015128bbfcd32e27a57d7711769e1d7462c"}
Jul 27 17:50:48.121457 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:48.121412    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq"
Jul 27 17:50:48.263440 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:48.263323    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78af7d7b-c893-45d2-813d-19f9eed61e68-maas-api-service-ca\") pod \"78af7d7b-c893-45d2-813d-19f9eed61e68\" (UID: \"78af7d7b-c893-45d2-813d-19f9eed61e68\") "
Jul 27 17:50:48.263711 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:48.263689    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78af7d7b-c893-45d2-813d-19f9eed61e68-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "78af7d7b-c893-45d2-813d-19f9eed61e68" (UID: "78af7d7b-c893-45d2-813d-19f9eed61e68"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:50:48.364336 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:48.364306    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78af7d7b-c893-45d2-813d-19f9eed61e68-maas-api-service-ca\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:48.993868 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:48.993838    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq"
Jul 27 17:50:48.993868 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:48.993857    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq" event={"ID":"78af7d7b-c893-45d2-813d-19f9eed61e68","Type":"ContainerDied","Data":"48606e44a75869407b0fd3ccdbb64015128bbfcd32e27a57d7711769e1d7462c"}
Jul 27 17:50:48.994071 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:48.993910    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48606e44a75869407b0fd3ccdbb64015128bbfcd32e27a57d7711769e1d7462c"
Jul 27 17:50:56.596435 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:56.596395    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"]
Jul 27 17:50:56.596864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:56.596650    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc" podUID="e5f61f57-184b-4ec2-9500-a7ee2abca727" containerName="payload-processing" containerID="cri-o://3c45c5ed2a42e9e7ff2ef8b613135cdf0643d2fb6d289b8b484cc0681206a9de" gracePeriod=30
Jul 27 17:50:56.601799 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:56.601774    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"]
Jul 27 17:50:56.601983 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:56.601962    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6" podUID="5e1683db-7bba-4c26-aea6-e72684055abf" containerName="payload-pre-processing" containerID="cri-o://6c9af0701f89eb82586a3e089d948955e1713eded5d41abaa09e6e66363c8f96" gracePeriod=30
Jul 27 17:50:56.890431 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:56.890395    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"
Jul 27 17:50:56.893057 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:56.893034    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"
Jul 27 17:50:57.035367 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.035330    2579 generic.go:356] "Generic (PLEG): container finished" podID="e5f61f57-184b-4ec2-9500-a7ee2abca727" containerID="3c45c5ed2a42e9e7ff2ef8b613135cdf0643d2fb6d289b8b484cc0681206a9de" exitCode=0
Jul 27 17:50:57.035580 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.035374    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"
Jul 27 17:50:57.035580 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.035408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc" event={"ID":"e5f61f57-184b-4ec2-9500-a7ee2abca727","Type":"ContainerDied","Data":"3c45c5ed2a42e9e7ff2ef8b613135cdf0643d2fb6d289b8b484cc0681206a9de"}
Jul 27 17:50:57.035580 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.035491    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc" event={"ID":"e5f61f57-184b-4ec2-9500-a7ee2abca727","Type":"ContainerDied","Data":"d332a5060fcdfb8983fe99be68131b915b50c8d0b7948211dd3034457c731992"}
Jul 27 17:50:57.035580 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.035513    2579 scope.go:117] "RemoveContainer" containerID="3c45c5ed2a42e9e7ff2ef8b613135cdf0643d2fb6d289b8b484cc0681206a9de"
Jul 27 17:50:57.036754 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.036733    2579 generic.go:356] "Generic (PLEG): container finished" podID="5e1683db-7bba-4c26-aea6-e72684055abf" containerID="6c9af0701f89eb82586a3e089d948955e1713eded5d41abaa09e6e66363c8f96" exitCode=0
Jul 27 17:50:57.036863 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.036759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6" event={"ID":"5e1683db-7bba-4c26-aea6-e72684055abf","Type":"ContainerDied","Data":"6c9af0701f89eb82586a3e089d948955e1713eded5d41abaa09e6e66363c8f96"}
Jul 27 17:50:57.036863 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.036787    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"
Jul 27 17:50:57.036863 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.036805    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6" event={"ID":"5e1683db-7bba-4c26-aea6-e72684055abf","Type":"ContainerDied","Data":"58c6470df8e68667454f8ebbfa6bd5de406da8ccae281205c3ef509aece38690"}
Jul 27 17:50:57.042894 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.042870    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5f61f57-184b-4ec2-9500-a7ee2abca727-plugins-config-volume\") pod \"e5f61f57-184b-4ec2-9500-a7ee2abca727\" (UID: \"e5f61f57-184b-4ec2-9500-a7ee2abca727\") "
Jul 27 17:50:57.043000 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.042969    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4vm5\" (UniqueName: \"kubernetes.io/projected/5e1683db-7bba-4c26-aea6-e72684055abf-kube-api-access-h4vm5\") pod \"5e1683db-7bba-4c26-aea6-e72684055abf\" (UID: \"5e1683db-7bba-4c26-aea6-e72684055abf\") "
Jul 27 17:50:57.043082 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.043007    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsg7v\" (UniqueName: \"kubernetes.io/projected/e5f61f57-184b-4ec2-9500-a7ee2abca727-kube-api-access-lsg7v\") pod \"e5f61f57-184b-4ec2-9500-a7ee2abca727\" (UID: \"e5f61f57-184b-4ec2-9500-a7ee2abca727\") "
Jul 27 17:50:57.043082 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.043034    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e1683db-7bba-4c26-aea6-e72684055abf-plugins-config-volume\") pod \"5e1683db-7bba-4c26-aea6-e72684055abf\" (UID: \"5e1683db-7bba-4c26-aea6-e72684055abf\") "
Jul 27 17:50:57.043368 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.043342    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5f61f57-184b-4ec2-9500-a7ee2abca727-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e5f61f57-184b-4ec2-9500-a7ee2abca727" (UID: "e5f61f57-184b-4ec2-9500-a7ee2abca727"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:50:57.043647 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.043616    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e1683db-7bba-4c26-aea6-e72684055abf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5e1683db-7bba-4c26-aea6-e72684055abf" (UID: "5e1683db-7bba-4c26-aea6-e72684055abf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:50:57.045173 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.045107    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e1683db-7bba-4c26-aea6-e72684055abf-kube-api-access-h4vm5" (OuterVolumeSpecName: "kube-api-access-h4vm5") pod "5e1683db-7bba-4c26-aea6-e72684055abf" (UID: "5e1683db-7bba-4c26-aea6-e72684055abf"). InnerVolumeSpecName "kube-api-access-h4vm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:50:57.045265 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.045220    2579 scope.go:117] "RemoveContainer" containerID="3c45c5ed2a42e9e7ff2ef8b613135cdf0643d2fb6d289b8b484cc0681206a9de"
Jul 27 17:50:57.045577 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.045552    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5f61f57-184b-4ec2-9500-a7ee2abca727-kube-api-access-lsg7v" (OuterVolumeSpecName: "kube-api-access-lsg7v") pod "e5f61f57-184b-4ec2-9500-a7ee2abca727" (UID: "e5f61f57-184b-4ec2-9500-a7ee2abca727"). InnerVolumeSpecName "kube-api-access-lsg7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:50:57.045668 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:50:57.045558    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c45c5ed2a42e9e7ff2ef8b613135cdf0643d2fb6d289b8b484cc0681206a9de\": container with ID starting with 3c45c5ed2a42e9e7ff2ef8b613135cdf0643d2fb6d289b8b484cc0681206a9de not found: ID does not exist" containerID="3c45c5ed2a42e9e7ff2ef8b613135cdf0643d2fb6d289b8b484cc0681206a9de"
Jul 27 17:50:57.045668 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.045601    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c45c5ed2a42e9e7ff2ef8b613135cdf0643d2fb6d289b8b484cc0681206a9de"} err="failed to get container status \"3c45c5ed2a42e9e7ff2ef8b613135cdf0643d2fb6d289b8b484cc0681206a9de\": rpc error: code = NotFound desc = could not find container \"3c45c5ed2a42e9e7ff2ef8b613135cdf0643d2fb6d289b8b484cc0681206a9de\": container with ID starting with 3c45c5ed2a42e9e7ff2ef8b613135cdf0643d2fb6d289b8b484cc0681206a9de not found: ID does not exist"
Jul 27 17:50:57.045668 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.045618    2579 scope.go:117] "RemoveContainer" containerID="6c9af0701f89eb82586a3e089d948955e1713eded5d41abaa09e6e66363c8f96"
Jul 27 17:50:57.056181 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.056163    2579 scope.go:117] "RemoveContainer" containerID="6c9af0701f89eb82586a3e089d948955e1713eded5d41abaa09e6e66363c8f96"
Jul 27 17:50:57.056486 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:50:57.056462    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c9af0701f89eb82586a3e089d948955e1713eded5d41abaa09e6e66363c8f96\": container with ID starting with 6c9af0701f89eb82586a3e089d948955e1713eded5d41abaa09e6e66363c8f96 not found: ID does not exist" containerID="6c9af0701f89eb82586a3e089d948955e1713eded5d41abaa09e6e66363c8f96"
Jul 27 17:50:57.056551 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.056494    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c9af0701f89eb82586a3e089d948955e1713eded5d41abaa09e6e66363c8f96"} err="failed to get container status \"6c9af0701f89eb82586a3e089d948955e1713eded5d41abaa09e6e66363c8f96\": rpc error: code = NotFound desc = could not find container \"6c9af0701f89eb82586a3e089d948955e1713eded5d41abaa09e6e66363c8f96\": container with ID starting with 6c9af0701f89eb82586a3e089d948955e1713eded5d41abaa09e6e66363c8f96 not found: ID does not exist"
Jul 27 17:50:57.143844 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.143821    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4vm5\" (UniqueName: \"kubernetes.io/projected/5e1683db-7bba-4c26-aea6-e72684055abf-kube-api-access-h4vm5\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:57.143844 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.143845    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsg7v\" (UniqueName: \"kubernetes.io/projected/e5f61f57-184b-4ec2-9500-a7ee2abca727-kube-api-access-lsg7v\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:57.143989 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.143856    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e1683db-7bba-4c26-aea6-e72684055abf-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:57.143989 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.143864    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5f61f57-184b-4ec2-9500-a7ee2abca727-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:50:57.357833 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.357803    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"]
Jul 27 17:50:57.361366 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.361339    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d5de8abc-6745fbdf58-jcftc"]
Jul 27 17:50:57.371274 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.371213    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"]
Jul 27 17:50:57.375806 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:57.375786    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d5de8abc-9dc6f4948-cskm6"]
Jul 27 17:50:58.993037 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:58.993003    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e1683db-7bba-4c26-aea6-e72684055abf" path="/var/lib/kubelet/pods/5e1683db-7bba-4c26-aea6-e72684055abf/volumes"
Jul 27 17:50:58.993440 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:50:58.993343    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5f61f57-184b-4ec2-9500-a7ee2abca727" path="/var/lib/kubelet/pods/e5f61f57-184b-4ec2-9500-a7ee2abca727/volumes"
Jul 27 17:51:00.844608 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:51:00.844577    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq"]
Jul 27 17:51:00.846840 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:51:00.846814    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d5de8abc-srjdq"]
Jul 27 17:51:00.993280 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:51:00.993249    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78af7d7b-c893-45d2-813d-19f9eed61e68" path="/var/lib/kubelet/pods/78af7d7b-c893-45d2-813d-19f9eed61e68/volumes"
Jul 27 17:52:39.729910 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.729817    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"]
Jul 27 17:52:39.730534 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.730165    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e49de28-8e0f-45b1-9714-e9d0c458eb93" containerName="istio-proxy"
Jul 27 17:52:39.730534 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.730177    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e49de28-8e0f-45b1-9714-e9d0c458eb93" containerName="istio-proxy"
Jul 27 17:52:39.730534 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.730203    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78af7d7b-c893-45d2-813d-19f9eed61e68" containerName="revoke-keys"
Jul 27 17:52:39.730534 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.730209    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="78af7d7b-c893-45d2-813d-19f9eed61e68" containerName="revoke-keys"
Jul 27 17:52:39.730534 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.730221    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5f61f57-184b-4ec2-9500-a7ee2abca727" containerName="payload-processing"
Jul 27 17:52:39.730534 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.730227    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5f61f57-184b-4ec2-9500-a7ee2abca727" containerName="payload-processing"
Jul 27 17:52:39.730534 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.730237    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e1683db-7bba-4c26-aea6-e72684055abf" containerName="payload-pre-processing"
Jul 27 17:52:39.730534 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.730243    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e1683db-7bba-4c26-aea6-e72684055abf" containerName="payload-pre-processing"
Jul 27 17:52:39.730534 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.730298    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e1683db-7bba-4c26-aea6-e72684055abf" containerName="payload-pre-processing"
Jul 27 17:52:39.730534 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.730307    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="78af7d7b-c893-45d2-813d-19f9eed61e68" containerName="revoke-keys"
Jul 27 17:52:39.730534 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.730315    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5f61f57-184b-4ec2-9500-a7ee2abca727" containerName="payload-processing"
Jul 27 17:52:39.730534 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.730320    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e49de28-8e0f-45b1-9714-e9d0c458eb93" containerName="istio-proxy"
Jul 27 17:52:39.733404 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.733381    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.735573 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.735552    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3852632a-openshift-default-dockercfg-kgw2k\""
Jul 27 17:52:39.751228 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.751199    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"]
Jul 27 17:52:39.822349 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.822318    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istiod-ca-cert\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.822541 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.822358    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-data\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.822541 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.822390    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-workload-certs\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.822541 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.822453    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-workload-socket\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.822541 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.822498    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-envoy\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.822702 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.822559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-token\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.822702 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.822591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrd8f\" (UniqueName: \"kubernetes.io/projected/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-kube-api-access-xrd8f\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.822702 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.822630    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-podinfo\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.822702 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.822650    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-credential-socket\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.923329 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.923295    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-podinfo\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.923329 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.923331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-credential-socket\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.923612 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.923356    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istiod-ca-cert\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.923612 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.923378    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-data\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.923728 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.923605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-workload-certs\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.923728 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.923649    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-workload-socket\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.923728 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.923695    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-envoy\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.923877 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.923760    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-token\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.923877 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.923790    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrd8f\" (UniqueName: \"kubernetes.io/projected/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-kube-api-access-xrd8f\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.923981 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.923904    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-credential-socket\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.924139 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.924109    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-workload-certs\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.924465 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.924234    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istiod-ca-cert\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.924465 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.924328    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-workload-socket\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.924465 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.924344    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-data\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.926117 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.926097    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-podinfo\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.926218 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.926162    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-envoy\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.934704 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.934682    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-token\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:39.934822 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:39.934802    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrd8f\" (UniqueName: \"kubernetes.io/projected/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-kube-api-access-xrd8f\") pod \"e2e-mt-3852632a-openshift-default-5998c8c6-r5whq\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") " pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:40.044068 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:40.044034    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:40.187061 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:40.187033    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"]
Jul 27 17:52:40.188759 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:52:40.188724    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4456a6_9402_4ab4_86e9_1c35ee6fe28b.slice/crio-7772ece0793aefaa27abe00c7853336f1eb12ad2e66c1970776bfcbf4ec587ca WatchSource:0}: Error finding container 7772ece0793aefaa27abe00c7853336f1eb12ad2e66c1970776bfcbf4ec587ca: Status 404 returned error can't find the container with id 7772ece0793aefaa27abe00c7853336f1eb12ad2e66c1970776bfcbf4ec587ca
Jul 27 17:52:40.190867 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:40.190836    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:52:40.190955 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:40.190899    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:52:40.190955 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:40.190927    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:52:40.585609 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:40.585571    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq" event={"ID":"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b","Type":"ContainerStarted","Data":"d2d617f90abf48beb129dc96bbffba5ab942a4a7266a5b18c4f16c61fc66c1c3"}
Jul 27 17:52:40.585834 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:40.585631    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq" event={"ID":"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b","Type":"ContainerStarted","Data":"7772ece0793aefaa27abe00c7853336f1eb12ad2e66c1970776bfcbf4ec587ca"}
Jul 27 17:52:40.616154 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:40.616086    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq" podStartSLOduration=1.616070159 podStartE2EDuration="1.616070159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:52:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:52:40.613907215 +0000 UTC m=+1904.145658200" watchObservedRunningTime="2026-07-27 17:52:40.616070159 +0000 UTC m=+1904.147821144"
Jul 27 17:52:41.044803 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:41.044768    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:41.049900 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:41.049877    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:41.590879 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:41.590842    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:41.591688 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:41.591671    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:43.604897 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.604871    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"]
Jul 27 17:52:43.608403 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.608381    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"
Jul 27 17:52:43.610553 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.610529    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-3852632a\""
Jul 27 17:52:43.610703 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.610569    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-3852632a-dockercfg-cwrmx\""
Jul 27 17:52:43.619589 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.619567    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"]
Jul 27 17:52:43.630225 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.630198    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"]
Jul 27 17:52:43.633811 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.633788    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"
Jul 27 17:52:43.643480 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.643452    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"]
Jul 27 17:52:43.761137 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.761102    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z947\" (UniqueName: \"kubernetes.io/projected/0b9ca27f-b3e3-4ec6-a360-792c09312ce3-kube-api-access-2z947\") pod \"payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch\" (UID: \"0b9ca27f-b3e3-4ec6-a360-792c09312ce3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"
Jul 27 17:52:43.761288 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.761140    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll98l\" (UniqueName: \"kubernetes.io/projected/1e9c8e1c-aa1d-4036-97d9-96f260d2589e-kube-api-access-ll98l\") pod \"payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z\" (UID: \"1e9c8e1c-aa1d-4036-97d9-96f260d2589e\") " pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"
Jul 27 17:52:43.761377 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.761349    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b9ca27f-b3e3-4ec6-a360-792c09312ce3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch\" (UID: \"0b9ca27f-b3e3-4ec6-a360-792c09312ce3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"
Jul 27 17:52:43.761458 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.761393    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e9c8e1c-aa1d-4036-97d9-96f260d2589e-plugins-config-volume\") pod \"payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z\" (UID: \"1e9c8e1c-aa1d-4036-97d9-96f260d2589e\") " pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"
Jul 27 17:52:43.862793 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.862698    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b9ca27f-b3e3-4ec6-a360-792c09312ce3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch\" (UID: \"0b9ca27f-b3e3-4ec6-a360-792c09312ce3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"
Jul 27 17:52:43.862793 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.862747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e9c8e1c-aa1d-4036-97d9-96f260d2589e-plugins-config-volume\") pod \"payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z\" (UID: \"1e9c8e1c-aa1d-4036-97d9-96f260d2589e\") " pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"
Jul 27 17:52:43.863004 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.862806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z947\" (UniqueName: \"kubernetes.io/projected/0b9ca27f-b3e3-4ec6-a360-792c09312ce3-kube-api-access-2z947\") pod \"payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch\" (UID: \"0b9ca27f-b3e3-4ec6-a360-792c09312ce3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"
Jul 27 17:52:43.863004 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.862825    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll98l\" (UniqueName: \"kubernetes.io/projected/1e9c8e1c-aa1d-4036-97d9-96f260d2589e-kube-api-access-ll98l\") pod \"payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z\" (UID: \"1e9c8e1c-aa1d-4036-97d9-96f260d2589e\") " pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"
Jul 27 17:52:43.863520 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.863500    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b9ca27f-b3e3-4ec6-a360-792c09312ce3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch\" (UID: \"0b9ca27f-b3e3-4ec6-a360-792c09312ce3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"
Jul 27 17:52:43.863582 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.863517    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e9c8e1c-aa1d-4036-97d9-96f260d2589e-plugins-config-volume\") pod \"payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z\" (UID: \"1e9c8e1c-aa1d-4036-97d9-96f260d2589e\") " pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"
Jul 27 17:52:43.874752 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.874729    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll98l\" (UniqueName: \"kubernetes.io/projected/1e9c8e1c-aa1d-4036-97d9-96f260d2589e-kube-api-access-ll98l\") pod \"payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z\" (UID: \"1e9c8e1c-aa1d-4036-97d9-96f260d2589e\") " pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"
Jul 27 17:52:43.874885 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.874797    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z947\" (UniqueName: \"kubernetes.io/projected/0b9ca27f-b3e3-4ec6-a360-792c09312ce3-kube-api-access-2z947\") pod \"payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch\" (UID: \"0b9ca27f-b3e3-4ec6-a360-792c09312ce3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"
Jul 27 17:52:43.920678 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.920647    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"
Jul 27 17:52:43.945528 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:43.945502    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"
Jul 27 17:52:44.279576 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:44.279551    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"]
Jul 27 17:52:44.281374 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:52:44.281336    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b9ca27f_b3e3_4ec6_a360_792c09312ce3.slice/crio-89c4e36ebc43adc62a40017f3d27d2242032d5283046f667d214fc193fbe966f WatchSource:0}: Error finding container 89c4e36ebc43adc62a40017f3d27d2242032d5283046f667d214fc193fbe966f: Status 404 returned error can't find the container with id 89c4e36ebc43adc62a40017f3d27d2242032d5283046f667d214fc193fbe966f
Jul 27 17:52:44.310564 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:44.310539    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"]
Jul 27 17:52:44.312644 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:52:44.312616    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e9c8e1c_aa1d_4036_97d9_96f260d2589e.slice/crio-d7e913f6bbb32293cf4b0163be06beefd692357efe8357b71ed06b0cc944d923 WatchSource:0}: Error finding container d7e913f6bbb32293cf4b0163be06beefd692357efe8357b71ed06b0cc944d923: Status 404 returned error can't find the container with id d7e913f6bbb32293cf4b0163be06beefd692357efe8357b71ed06b0cc944d923
Jul 27 17:52:44.610370 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:44.610259    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z" event={"ID":"1e9c8e1c-aa1d-4036-97d9-96f260d2589e","Type":"ContainerStarted","Data":"455624a6f7e45d3dfdb98e1b1113dd182cfaa485897d9b22a500838a2715f01e"}
Jul 27 17:52:44.610370 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:44.610334    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z" event={"ID":"1e9c8e1c-aa1d-4036-97d9-96f260d2589e","Type":"ContainerStarted","Data":"d7e913f6bbb32293cf4b0163be06beefd692357efe8357b71ed06b0cc944d923"}
Jul 27 17:52:44.610370 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:44.610366    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"
Jul 27 17:52:44.612392 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:44.612365    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch" event={"ID":"0b9ca27f-b3e3-4ec6-a360-792c09312ce3","Type":"ContainerStarted","Data":"b1b8cb86caf63c14c617b20bdaac6ebdcfeeb0b2d4bdef0db47f155cac86633f"}
Jul 27 17:52:44.612539 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:44.612411    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch" event={"ID":"0b9ca27f-b3e3-4ec6-a360-792c09312ce3","Type":"ContainerStarted","Data":"89c4e36ebc43adc62a40017f3d27d2242032d5283046f667d214fc193fbe966f"}
Jul 27 17:52:44.612539 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:44.612453    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"
Jul 27 17:52:44.640855 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:44.640797    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z" podStartSLOduration=1.640779593 podStartE2EDuration="1.640779593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:52:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:52:44.636643154 +0000 UTC m=+1908.168394139" watchObservedRunningTime="2026-07-27 17:52:44.640779593 +0000 UTC m=+1908.172530582"
Jul 27 17:52:44.654113 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:44.654067    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch" podStartSLOduration=1.6540514640000001 podStartE2EDuration="1.654051464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:52:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:52:44.65145393 +0000 UTC m=+1908.183204913" watchObservedRunningTime="2026-07-27 17:52:44.654051464 +0000 UTC m=+1908.185802451"
Jul 27 17:52:54.673588 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:54.673490    2579 generic.go:356] "Generic (PLEG): container finished" podID="6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" containerID="d2d617f90abf48beb129dc96bbffba5ab942a4a7266a5b18c4f16c61fc66c1c3" exitCode=0
Jul 27 17:52:54.673588 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:54.673566    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq" event={"ID":"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b","Type":"ContainerDied","Data":"d2d617f90abf48beb129dc96bbffba5ab942a4a7266a5b18c4f16c61fc66c1c3"}
Jul 27 17:52:54.674097 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:54.673965    2579 scope.go:117] "RemoveContainer" containerID="d2d617f90abf48beb129dc96bbffba5ab942a4a7266a5b18c4f16c61fc66c1c3"
Jul 27 17:52:54.674990 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:54.674962    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:52:54.675084 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:54.675027    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:52:54.675084 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:54.675063    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:52:55.622398 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:55.622362    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"
Jul 27 17:52:55.623626 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:55.623597    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"
Jul 27 17:52:55.685285 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:55.685252    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq" event={"ID":"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b","Type":"ContainerStarted","Data":"f021225ec03e2b16647130769ed5e5b220e0436b405e7fb6f033057935be84b3"}
Jul 27 17:52:56.044931 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:56.044893    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:56.046204 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:56.046168    2579 patch_prober.go:28] interesting pod/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 27 17:52:56.046345 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:56.046232    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq" podUID="6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 27 17:52:56.591214 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:56.591168    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:52:57.045025 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:57.044989    2579 patch_prober.go:28] interesting pod/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 27 17:52:57.045382 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:57.045059    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq" podUID="6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 27 17:52:58.044965 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:58.044922    2579 patch_prober.go:28] interesting pod/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 27 17:52:58.045161 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:58.044995    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq" podUID="6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 27 17:52:59.045402 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:59.045363    2579 patch_prober.go:28] interesting pod/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 27 17:52:59.045811 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:52:59.045445    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq" podUID="6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 27 17:53:00.048396 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:00.048366    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:53:00.049318 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:00.049300    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:53:04.889660 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:04.889624    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"]
Jul 27 17:53:04.890123 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:04.889887    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z" podUID="1e9c8e1c-aa1d-4036-97d9-96f260d2589e" containerName="payload-processing" containerID="cri-o://455624a6f7e45d3dfdb98e1b1113dd182cfaa485897d9b22a500838a2715f01e" gracePeriod=30
Jul 27 17:53:04.897706 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:04.897677    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"]
Jul 27 17:53:04.898014 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:04.897960    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch" podUID="0b9ca27f-b3e3-4ec6-a360-792c09312ce3" containerName="payload-pre-processing" containerID="cri-o://b1b8cb86caf63c14c617b20bdaac6ebdcfeeb0b2d4bdef0db47f155cac86633f" gracePeriod=30
Jul 27 17:53:05.162164 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.162131    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"
Jul 27 17:53:05.188675 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.188652    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"
Jul 27 17:53:05.258601 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.258570    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e9c8e1c-aa1d-4036-97d9-96f260d2589e-plugins-config-volume\") pod \"1e9c8e1c-aa1d-4036-97d9-96f260d2589e\" (UID: \"1e9c8e1c-aa1d-4036-97d9-96f260d2589e\") "
Jul 27 17:53:05.258776 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.258637    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll98l\" (UniqueName: \"kubernetes.io/projected/1e9c8e1c-aa1d-4036-97d9-96f260d2589e-kube-api-access-ll98l\") pod \"1e9c8e1c-aa1d-4036-97d9-96f260d2589e\" (UID: \"1e9c8e1c-aa1d-4036-97d9-96f260d2589e\") "
Jul 27 17:53:05.258776 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.258670    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b9ca27f-b3e3-4ec6-a360-792c09312ce3-plugins-config-volume\") pod \"0b9ca27f-b3e3-4ec6-a360-792c09312ce3\" (UID: \"0b9ca27f-b3e3-4ec6-a360-792c09312ce3\") "
Jul 27 17:53:05.258776 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.258731    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z947\" (UniqueName: \"kubernetes.io/projected/0b9ca27f-b3e3-4ec6-a360-792c09312ce3-kube-api-access-2z947\") pod \"0b9ca27f-b3e3-4ec6-a360-792c09312ce3\" (UID: \"0b9ca27f-b3e3-4ec6-a360-792c09312ce3\") "
Jul 27 17:53:05.259084 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.259055    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e9c8e1c-aa1d-4036-97d9-96f260d2589e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1e9c8e1c-aa1d-4036-97d9-96f260d2589e" (UID: "1e9c8e1c-aa1d-4036-97d9-96f260d2589e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:53:05.259162 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.259084    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b9ca27f-b3e3-4ec6-a360-792c09312ce3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0b9ca27f-b3e3-4ec6-a360-792c09312ce3" (UID: "0b9ca27f-b3e3-4ec6-a360-792c09312ce3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:53:05.260962 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.260939    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e9c8e1c-aa1d-4036-97d9-96f260d2589e-kube-api-access-ll98l" (OuterVolumeSpecName: "kube-api-access-ll98l") pod "1e9c8e1c-aa1d-4036-97d9-96f260d2589e" (UID: "1e9c8e1c-aa1d-4036-97d9-96f260d2589e"). InnerVolumeSpecName "kube-api-access-ll98l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:53:05.261041 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.260952    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b9ca27f-b3e3-4ec6-a360-792c09312ce3-kube-api-access-2z947" (OuterVolumeSpecName: "kube-api-access-2z947") pod "0b9ca27f-b3e3-4ec6-a360-792c09312ce3" (UID: "0b9ca27f-b3e3-4ec6-a360-792c09312ce3"). InnerVolumeSpecName "kube-api-access-2z947". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:53:05.360365 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.360330    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z947\" (UniqueName: \"kubernetes.io/projected/0b9ca27f-b3e3-4ec6-a360-792c09312ce3-kube-api-access-2z947\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:53:05.360365 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.360360    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e9c8e1c-aa1d-4036-97d9-96f260d2589e-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:53:05.360602 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.360373    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll98l\" (UniqueName: \"kubernetes.io/projected/1e9c8e1c-aa1d-4036-97d9-96f260d2589e-kube-api-access-ll98l\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:53:05.360602 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.360386    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b9ca27f-b3e3-4ec6-a360-792c09312ce3-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:53:05.742888 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.742853    2579 generic.go:356] "Generic (PLEG): container finished" podID="1e9c8e1c-aa1d-4036-97d9-96f260d2589e" containerID="455624a6f7e45d3dfdb98e1b1113dd182cfaa485897d9b22a500838a2715f01e" exitCode=0
Jul 27 17:53:05.743090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.742898    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"
Jul 27 17:53:05.743090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.742948    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z" event={"ID":"1e9c8e1c-aa1d-4036-97d9-96f260d2589e","Type":"ContainerDied","Data":"455624a6f7e45d3dfdb98e1b1113dd182cfaa485897d9b22a500838a2715f01e"}
Jul 27 17:53:05.743090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.743006    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z" event={"ID":"1e9c8e1c-aa1d-4036-97d9-96f260d2589e","Type":"ContainerDied","Data":"d7e913f6bbb32293cf4b0163be06beefd692357efe8357b71ed06b0cc944d923"}
Jul 27 17:53:05.743090 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.743035    2579 scope.go:117] "RemoveContainer" containerID="455624a6f7e45d3dfdb98e1b1113dd182cfaa485897d9b22a500838a2715f01e"
Jul 27 17:53:05.744283 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.744263    2579 generic.go:356] "Generic (PLEG): container finished" podID="0b9ca27f-b3e3-4ec6-a360-792c09312ce3" containerID="b1b8cb86caf63c14c617b20bdaac6ebdcfeeb0b2d4bdef0db47f155cac86633f" exitCode=0
Jul 27 17:53:05.744360 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.744313    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"
Jul 27 17:53:05.744442 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.744359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch" event={"ID":"0b9ca27f-b3e3-4ec6-a360-792c09312ce3","Type":"ContainerDied","Data":"b1b8cb86caf63c14c617b20bdaac6ebdcfeeb0b2d4bdef0db47f155cac86633f"}
Jul 27 17:53:05.744499 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.744443    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch" event={"ID":"0b9ca27f-b3e3-4ec6-a360-792c09312ce3","Type":"ContainerDied","Data":"89c4e36ebc43adc62a40017f3d27d2242032d5283046f667d214fc193fbe966f"}
Jul 27 17:53:05.753199 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.753171    2579 scope.go:117] "RemoveContainer" containerID="455624a6f7e45d3dfdb98e1b1113dd182cfaa485897d9b22a500838a2715f01e"
Jul 27 17:53:05.753580 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:53:05.753557    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"455624a6f7e45d3dfdb98e1b1113dd182cfaa485897d9b22a500838a2715f01e\": container with ID starting with 455624a6f7e45d3dfdb98e1b1113dd182cfaa485897d9b22a500838a2715f01e not found: ID does not exist" containerID="455624a6f7e45d3dfdb98e1b1113dd182cfaa485897d9b22a500838a2715f01e"
Jul 27 17:53:05.753675 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.753592    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"455624a6f7e45d3dfdb98e1b1113dd182cfaa485897d9b22a500838a2715f01e"} err="failed to get container status \"455624a6f7e45d3dfdb98e1b1113dd182cfaa485897d9b22a500838a2715f01e\": rpc error: code = NotFound desc = could not find container \"455624a6f7e45d3dfdb98e1b1113dd182cfaa485897d9b22a500838a2715f01e\": container with ID starting with 455624a6f7e45d3dfdb98e1b1113dd182cfaa485897d9b22a500838a2715f01e not found: ID does not exist"
Jul 27 17:53:05.753675 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.753616    2579 scope.go:117] "RemoveContainer" containerID="b1b8cb86caf63c14c617b20bdaac6ebdcfeeb0b2d4bdef0db47f155cac86633f"
Jul 27 17:53:05.765791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.765771    2579 scope.go:117] "RemoveContainer" containerID="b1b8cb86caf63c14c617b20bdaac6ebdcfeeb0b2d4bdef0db47f155cac86633f"
Jul 27 17:53:05.766057 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:53:05.766037    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1b8cb86caf63c14c617b20bdaac6ebdcfeeb0b2d4bdef0db47f155cac86633f\": container with ID starting with b1b8cb86caf63c14c617b20bdaac6ebdcfeeb0b2d4bdef0db47f155cac86633f not found: ID does not exist" containerID="b1b8cb86caf63c14c617b20bdaac6ebdcfeeb0b2d4bdef0db47f155cac86633f"
Jul 27 17:53:05.766122 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.766064    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1b8cb86caf63c14c617b20bdaac6ebdcfeeb0b2d4bdef0db47f155cac86633f"} err="failed to get container status \"b1b8cb86caf63c14c617b20bdaac6ebdcfeeb0b2d4bdef0db47f155cac86633f\": rpc error: code = NotFound desc = could not find container \"b1b8cb86caf63c14c617b20bdaac6ebdcfeeb0b2d4bdef0db47f155cac86633f\": container with ID starting with b1b8cb86caf63c14c617b20bdaac6ebdcfeeb0b2d4bdef0db47f155cac86633f not found: ID does not exist"
Jul 27 17:53:05.773432 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.773393    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"]
Jul 27 17:53:05.777618 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.777598    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3852632a-645c6dfd86-zcn7z"]
Jul 27 17:53:05.785508 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.785487    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"]
Jul 27 17:53:05.789665 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:05.789644    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3852632a-55898956dd-dzhch"]
Jul 27 17:53:06.993142 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:06.993108    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b9ca27f-b3e3-4ec6-a360-792c09312ce3" path="/var/lib/kubelet/pods/0b9ca27f-b3e3-4ec6-a360-792c09312ce3/volumes"
Jul 27 17:53:06.993519 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:06.993488    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e9c8e1c-aa1d-4036-97d9-96f260d2589e" path="/var/lib/kubelet/pods/1e9c8e1c-aa1d-4036-97d9-96f260d2589e/volumes"
Jul 27 17:53:16.303244 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:16.303209    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"]
Jul 27 17:53:16.303878 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:16.303459    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq" podUID="6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" containerName="istio-proxy" containerID="cri-o://f021225ec03e2b16647130769ed5e5b220e0436b405e7fb6f033057935be84b3" gracePeriod=30
Jul 27 17:53:21.560056 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.560032    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:53:21.707493 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.707392    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-envoy\") pod \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") "
Jul 27 17:53:21.707493 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.707474    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-workload-certs\") pod \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") "
Jul 27 17:53:21.707493 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.707497    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-workload-socket\") pod \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") "
Jul 27 17:53:21.707784 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.707538    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrd8f\" (UniqueName: \"kubernetes.io/projected/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-kube-api-access-xrd8f\") pod \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") "
Jul 27 17:53:21.707784 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.707566    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-data\") pod \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") "
Jul 27 17:53:21.707784 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.707584    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istiod-ca-cert\") pod \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") "
Jul 27 17:53:21.707784 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.707622    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-token\") pod \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") "
Jul 27 17:53:21.707784 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.707640    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-podinfo\") pod \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") "
Jul 27 17:53:21.707784 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.707657    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-credential-socket\") pod \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\" (UID: \"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b\") "
Jul 27 17:53:21.707784 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.707767    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" (UID: "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:53:21.708103 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.707818    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" (UID: "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:53:21.708103 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.707980    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" (UID: "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:53:21.708103 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.707985    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-workload-certs\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:53:21.708103 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.708022    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-workload-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:53:21.708103 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.708074    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" (UID: "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:53:21.708741 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.708703    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" (UID: "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:53:21.709943 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.709916    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" (UID: "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:53:21.710095 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.710073    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" (UID: "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 17:53:21.710343 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.710313    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-kube-api-access-xrd8f" (OuterVolumeSpecName: "kube-api-access-xrd8f") pod "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" (UID: "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b"). InnerVolumeSpecName "kube-api-access-xrd8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:53:21.710409 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.710369    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" (UID: "6f4456a6-9402-4ab4-86e9-1c35ee6fe28b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:53:21.809028 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.808990    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrd8f\" (UniqueName: \"kubernetes.io/projected/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-kube-api-access-xrd8f\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:53:21.809028 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.809022    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-data\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:53:21.809028 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.809032    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istiod-ca-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:53:21.809028 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.809041    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-token\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:53:21.809293 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.809049    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-podinfo\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:53:21.809293 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.809057    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-credential-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:53:21.809293 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.809065    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b-istio-envoy\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:53:21.841242 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.841210    2579 generic.go:356] "Generic (PLEG): container finished" podID="6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" containerID="f021225ec03e2b16647130769ed5e5b220e0436b405e7fb6f033057935be84b3" exitCode=0
Jul 27 17:53:21.841387 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.841258    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"
Jul 27 17:53:21.841387 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.841283    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq" event={"ID":"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b","Type":"ContainerDied","Data":"f021225ec03e2b16647130769ed5e5b220e0436b405e7fb6f033057935be84b3"}
Jul 27 17:53:21.841387 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.841326    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq" event={"ID":"6f4456a6-9402-4ab4-86e9-1c35ee6fe28b","Type":"ContainerDied","Data":"7772ece0793aefaa27abe00c7853336f1eb12ad2e66c1970776bfcbf4ec587ca"}
Jul 27 17:53:21.841387 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.841346    2579 scope.go:117] "RemoveContainer" containerID="f021225ec03e2b16647130769ed5e5b220e0436b405e7fb6f033057935be84b3"
Jul 27 17:53:21.850840 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.850821    2579 scope.go:117] "RemoveContainer" containerID="d2d617f90abf48beb129dc96bbffba5ab942a4a7266a5b18c4f16c61fc66c1c3"
Jul 27 17:53:21.858968 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.858951    2579 scope.go:117] "RemoveContainer" containerID="f021225ec03e2b16647130769ed5e5b220e0436b405e7fb6f033057935be84b3"
Jul 27 17:53:21.859230 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:53:21.859210    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f021225ec03e2b16647130769ed5e5b220e0436b405e7fb6f033057935be84b3\": container with ID starting with f021225ec03e2b16647130769ed5e5b220e0436b405e7fb6f033057935be84b3 not found: ID does not exist" containerID="f021225ec03e2b16647130769ed5e5b220e0436b405e7fb6f033057935be84b3"
Jul 27 17:53:21.859308 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.859242    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f021225ec03e2b16647130769ed5e5b220e0436b405e7fb6f033057935be84b3"} err="failed to get container status \"f021225ec03e2b16647130769ed5e5b220e0436b405e7fb6f033057935be84b3\": rpc error: code = NotFound desc = could not find container \"f021225ec03e2b16647130769ed5e5b220e0436b405e7fb6f033057935be84b3\": container with ID starting with f021225ec03e2b16647130769ed5e5b220e0436b405e7fb6f033057935be84b3 not found: ID does not exist"
Jul 27 17:53:21.859308 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.859268    2579 scope.go:117] "RemoveContainer" containerID="d2d617f90abf48beb129dc96bbffba5ab942a4a7266a5b18c4f16c61fc66c1c3"
Jul 27 17:53:21.859943 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:53:21.859921    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2d617f90abf48beb129dc96bbffba5ab942a4a7266a5b18c4f16c61fc66c1c3\": container with ID starting with d2d617f90abf48beb129dc96bbffba5ab942a4a7266a5b18c4f16c61fc66c1c3 not found: ID does not exist" containerID="d2d617f90abf48beb129dc96bbffba5ab942a4a7266a5b18c4f16c61fc66c1c3"
Jul 27 17:53:21.859998 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.859951    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2d617f90abf48beb129dc96bbffba5ab942a4a7266a5b18c4f16c61fc66c1c3"} err="failed to get container status \"d2d617f90abf48beb129dc96bbffba5ab942a4a7266a5b18c4f16c61fc66c1c3\": rpc error: code = NotFound desc = could not find container \"d2d617f90abf48beb129dc96bbffba5ab942a4a7266a5b18c4f16c61fc66c1c3\": container with ID starting with d2d617f90abf48beb129dc96bbffba5ab942a4a7266a5b18c4f16c61fc66c1c3 not found: ID does not exist"
Jul 27 17:53:21.862989 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.862969    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"]
Jul 27 17:53:21.866775 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:21.866756    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3852632a-openshift-default-5998c8c6-r5whq"]
Jul 27 17:53:22.993960 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:22.993926    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" path="/var/lib/kubelet/pods/6f4456a6-9402-4ab4-86e9-1c35ee6fe28b/volumes"
Jul 27 17:53:36.163302 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.163263    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"]
Jul 27 17:53:36.163791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.163625    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" containerName="istio-proxy"
Jul 27 17:53:36.163791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.163635    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" containerName="istio-proxy"
Jul 27 17:53:36.163791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.163644    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b9ca27f-b3e3-4ec6-a360-792c09312ce3" containerName="payload-pre-processing"
Jul 27 17:53:36.163791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.163651    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b9ca27f-b3e3-4ec6-a360-792c09312ce3" containerName="payload-pre-processing"
Jul 27 17:53:36.163791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.163658    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" containerName="istio-proxy"
Jul 27 17:53:36.163791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.163663    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" containerName="istio-proxy"
Jul 27 17:53:36.163791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.163675    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e9c8e1c-aa1d-4036-97d9-96f260d2589e" containerName="payload-processing"
Jul 27 17:53:36.163791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.163680    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e9c8e1c-aa1d-4036-97d9-96f260d2589e" containerName="payload-processing"
Jul 27 17:53:36.163791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.163757    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b9ca27f-b3e3-4ec6-a360-792c09312ce3" containerName="payload-pre-processing"
Jul 27 17:53:36.163791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.163763    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" containerName="istio-proxy"
Jul 27 17:53:36.163791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.163770    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e9c8e1c-aa1d-4036-97d9-96f260d2589e" containerName="payload-processing"
Jul 27 17:53:36.163791 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.163778    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f4456a6-9402-4ab4-86e9-1c35ee6fe28b" containerName="istio-proxy"
Jul 27 17:53:36.166778 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.166762    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.168707 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.168687    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1b693e0c-openshift-default-dockercfg-wvjfm\""
Jul 27 17:53:36.176061 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.176039    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"]
Jul 27 17:53:36.340077 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.340046    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngqgk\" (UniqueName: \"kubernetes.io/projected/694ee30e-b4ff-496c-9684-5c1c9bf0d459-kube-api-access-ngqgk\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.340251 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.340089    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-envoy\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.340251 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.340114    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-credential-socket\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.340251 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.340200    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-workload-socket\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.340465 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.340254    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-workload-certs\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.340465 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.340276    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-data\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.340465 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.340296    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-token\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.340465 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.340324    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istiod-ca-cert\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.340465 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.340362    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-podinfo\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.441588 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.441504    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-envoy\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.441588 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.441541    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-credential-socket\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.441588 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.441560    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-workload-socket\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.441875 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.441691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-workload-certs\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.441875 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.441728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-data\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.441875 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.441756    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-token\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.441875 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.441783    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istiod-ca-cert\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.441875 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.441841    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-podinfo\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.442132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.441918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngqgk\" (UniqueName: \"kubernetes.io/projected/694ee30e-b4ff-496c-9684-5c1c9bf0d459-kube-api-access-ngqgk\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.442132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.442028    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-workload-socket\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.442132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.442045    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-data\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.442132 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.442106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-workload-certs\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.442396 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.442376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-credential-socket\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.442600 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.442584    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istiod-ca-cert\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.443976 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.443951    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-envoy\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.444532 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.444515    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-podinfo\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.449477 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.449454    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-token\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.449477 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.449467    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngqgk\" (UniqueName: \"kubernetes.io/projected/694ee30e-b4ff-496c-9684-5c1c9bf0d459-kube-api-access-ngqgk\") pod \"e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") " pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.479048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.479021    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:36.620468 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.620436    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"]
Jul 27 17:53:36.621374 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:53:36.621348    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694ee30e_b4ff_496c_9684_5c1c9bf0d459.slice/crio-944e93a6c94103b689d0c339d780a8251d941786b1674a547b400a49fb36ea6b WatchSource:0}: Error finding container 944e93a6c94103b689d0c339d780a8251d941786b1674a547b400a49fb36ea6b: Status 404 returned error can't find the container with id 944e93a6c94103b689d0c339d780a8251d941786b1674a547b400a49fb36ea6b
Jul 27 17:53:36.623610 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.623572    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:53:36.623697 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.623655    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:53:36.623738 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.623698    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:53:36.925524 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.925484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js" event={"ID":"694ee30e-b4ff-496c-9684-5c1c9bf0d459","Type":"ContainerStarted","Data":"a2d219fdb3e936b6ba2f6f3b08c0ff4e886b5b318cb17faf4ac6ec5e4e6cc890"}
Jul 27 17:53:36.925697 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.925559    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js" event={"ID":"694ee30e-b4ff-496c-9684-5c1c9bf0d459","Type":"ContainerStarted","Data":"944e93a6c94103b689d0c339d780a8251d941786b1674a547b400a49fb36ea6b"}
Jul 27 17:53:36.959463 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:36.959362    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js" podStartSLOduration=0.959341682 podStartE2EDuration="959.341682ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:53:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:53:36.958303086 +0000 UTC m=+1960.490054072" watchObservedRunningTime="2026-07-27 17:53:36.959341682 +0000 UTC m=+1960.491092668"
Jul 27 17:53:37.480168 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:37.480139    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:37.484956 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:37.484934    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:37.930493 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:37.930456    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:37.931540 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:37.931517    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:39.763683 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:39.763644    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"]
Jul 27 17:53:39.767268 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:39.767243    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"
Jul 27 17:53:39.769292 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:39.769272    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-1b693e0c-dockercfg-7xsp4\""
Jul 27 17:53:39.769459 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:39.769444    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-1b693e0c\""
Jul 27 17:53:39.776260 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:39.776239    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"]
Jul 27 17:53:39.810104 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:39.810061    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"]
Jul 27 17:53:39.814332 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:39.814309    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"
Jul 27 17:53:39.827581 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:39.827554    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"]
Jul 27 17:53:39.870580 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:39.870546    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt4tg\" (UniqueName: \"kubernetes.io/projected/e1e0d523-27b5-42e6-92ad-b97af9db60f5-kube-api-access-wt4tg\") pod \"payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj\" (UID: \"e1e0d523-27b5-42e6-92ad-b97af9db60f5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"
Jul 27 17:53:39.870580 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:39.870581    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1e0d523-27b5-42e6-92ad-b97af9db60f5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj\" (UID: \"e1e0d523-27b5-42e6-92ad-b97af9db60f5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"
Jul 27 17:53:39.972045 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:39.972007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eee8006f-f16f-463b-a4a6-8dc9506a7fbb-plugins-config-volume\") pod \"payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh\" (UID: \"eee8006f-f16f-463b-a4a6-8dc9506a7fbb\") " pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"
Jul 27 17:53:39.972229 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:39.972104    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt4tg\" (UniqueName: \"kubernetes.io/projected/e1e0d523-27b5-42e6-92ad-b97af9db60f5-kube-api-access-wt4tg\") pod \"payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj\" (UID: \"e1e0d523-27b5-42e6-92ad-b97af9db60f5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"
Jul 27 17:53:39.972229 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:39.972136    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1e0d523-27b5-42e6-92ad-b97af9db60f5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj\" (UID: \"e1e0d523-27b5-42e6-92ad-b97af9db60f5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"
Jul 27 17:53:39.972229 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:39.972167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9lt6\" (UniqueName: \"kubernetes.io/projected/eee8006f-f16f-463b-a4a6-8dc9506a7fbb-kube-api-access-c9lt6\") pod \"payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh\" (UID: \"eee8006f-f16f-463b-a4a6-8dc9506a7fbb\") " pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"
Jul 27 17:53:39.972892 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:39.972870    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1e0d523-27b5-42e6-92ad-b97af9db60f5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj\" (UID: \"e1e0d523-27b5-42e6-92ad-b97af9db60f5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"
Jul 27 17:53:39.984979 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:39.984958    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt4tg\" (UniqueName: \"kubernetes.io/projected/e1e0d523-27b5-42e6-92ad-b97af9db60f5-kube-api-access-wt4tg\") pod \"payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj\" (UID: \"e1e0d523-27b5-42e6-92ad-b97af9db60f5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"
Jul 27 17:53:40.072703 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:40.072661    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9lt6\" (UniqueName: \"kubernetes.io/projected/eee8006f-f16f-463b-a4a6-8dc9506a7fbb-kube-api-access-c9lt6\") pod \"payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh\" (UID: \"eee8006f-f16f-463b-a4a6-8dc9506a7fbb\") " pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"
Jul 27 17:53:40.072917 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:40.072719    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eee8006f-f16f-463b-a4a6-8dc9506a7fbb-plugins-config-volume\") pod \"payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh\" (UID: \"eee8006f-f16f-463b-a4a6-8dc9506a7fbb\") " pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"
Jul 27 17:53:40.073473 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:40.073414    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eee8006f-f16f-463b-a4a6-8dc9506a7fbb-plugins-config-volume\") pod \"payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh\" (UID: \"eee8006f-f16f-463b-a4a6-8dc9506a7fbb\") " pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"
Jul 27 17:53:40.078543 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:40.078525    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"
Jul 27 17:53:40.090891 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:40.090866    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9lt6\" (UniqueName: \"kubernetes.io/projected/eee8006f-f16f-463b-a4a6-8dc9506a7fbb-kube-api-access-c9lt6\") pod \"payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh\" (UID: \"eee8006f-f16f-463b-a4a6-8dc9506a7fbb\") " pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"
Jul 27 17:53:40.124480 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:40.124444    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"
Jul 27 17:53:40.266388 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:40.266352    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"]
Jul 27 17:53:40.267097 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:53:40.267064    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1e0d523_27b5_42e6_92ad_b97af9db60f5.slice/crio-e66269ba18b9ec7a04d62a0b6f6bca184201efda461eee5065cd530c2fb8323b WatchSource:0}: Error finding container e66269ba18b9ec7a04d62a0b6f6bca184201efda461eee5065cd530c2fb8323b: Status 404 returned error can't find the container with id e66269ba18b9ec7a04d62a0b6f6bca184201efda461eee5065cd530c2fb8323b
Jul 27 17:53:40.312056 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:40.312014    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"]
Jul 27 17:53:40.314904 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:53:40.314880    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeee8006f_f16f_463b_a4a6_8dc9506a7fbb.slice/crio-f652d0a90285df3daff7e61eeb2a0c547f382851ebdac83dddb5902a8f34a02a WatchSource:0}: Error finding container f652d0a90285df3daff7e61eeb2a0c547f382851ebdac83dddb5902a8f34a02a: Status 404 returned error can't find the container with id f652d0a90285df3daff7e61eeb2a0c547f382851ebdac83dddb5902a8f34a02a
Jul 27 17:53:40.951461 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:40.951406    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj" event={"ID":"e1e0d523-27b5-42e6-92ad-b97af9db60f5","Type":"ContainerStarted","Data":"368f56e8a5a524763fbb14c9f32b9b399ef7ceb725e9cb2aaecb74814521f461"}
Jul 27 17:53:40.951941 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:40.951492    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"
Jul 27 17:53:40.951941 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:40.951513    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj" event={"ID":"e1e0d523-27b5-42e6-92ad-b97af9db60f5","Type":"ContainerStarted","Data":"e66269ba18b9ec7a04d62a0b6f6bca184201efda461eee5065cd530c2fb8323b"}
Jul 27 17:53:40.953008 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:40.952984    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh" event={"ID":"eee8006f-f16f-463b-a4a6-8dc9506a7fbb","Type":"ContainerStarted","Data":"6c9a5896534eed19af6cdacbc0802154cb3b8a3a44ab7dba157385e97b55c91a"}
Jul 27 17:53:40.953106 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:40.953040    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"
Jul 27 17:53:40.953106 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:40.953060    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh" event={"ID":"eee8006f-f16f-463b-a4a6-8dc9506a7fbb","Type":"ContainerStarted","Data":"f652d0a90285df3daff7e61eeb2a0c547f382851ebdac83dddb5902a8f34a02a"}
Jul 27 17:53:40.977009 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:40.976959    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj" podStartSLOduration=1.976943227 podStartE2EDuration="1.976943227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:53:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:53:40.975722445 +0000 UTC m=+1964.507473432" watchObservedRunningTime="2026-07-27 17:53:40.976943227 +0000 UTC m=+1964.508694262"
Jul 27 17:53:40.999038 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:40.998988    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh" podStartSLOduration=1.998972117 podStartE2EDuration="1.998972117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:53:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:53:40.995674626 +0000 UTC m=+1964.527425612" watchObservedRunningTime="2026-07-27 17:53:40.998972117 +0000 UTC m=+1964.530723103"
Jul 27 17:53:51.962246 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:51.962214    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"
Jul 27 17:53:51.962755 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:51.962487    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"
Jul 27 17:53:52.932527 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:52.932488    2579 patch_prober.go:28] interesting pod/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 27 17:53:52.932743 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:52.932552    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js" podUID="694ee30e-b4ff-496c-9684-5c1c9bf0d459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 27 17:53:53.019815 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:53.019778    2579 generic.go:356] "Generic (PLEG): container finished" podID="694ee30e-b4ff-496c-9684-5c1c9bf0d459" containerID="a2d219fdb3e936b6ba2f6f3b08c0ff4e886b5b318cb17faf4ac6ec5e4e6cc890" exitCode=0
Jul 27 17:53:53.020183 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:53.019852    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js" event={"ID":"694ee30e-b4ff-496c-9684-5c1c9bf0d459","Type":"ContainerDied","Data":"a2d219fdb3e936b6ba2f6f3b08c0ff4e886b5b318cb17faf4ac6ec5e4e6cc890"}
Jul 27 17:53:53.020225 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:53.020208    2579 scope.go:117] "RemoveContainer" containerID="a2d219fdb3e936b6ba2f6f3b08c0ff4e886b5b318cb17faf4ac6ec5e4e6cc890"
Jul 27 17:53:53.021238 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:53.021214    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:53:53.021301 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:53.021274    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:53:53.021338 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:53.021303    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:53:54.027546 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:54.027516    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js" event={"ID":"694ee30e-b4ff-496c-9684-5c1c9bf0d459","Type":"ContainerStarted","Data":"6167f0d3a42115f701e26c16a1e4ad59de370ee84e5677ac64d5f099d29d4318"}
Jul 27 17:53:54.479891 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:54.479794    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:54.480058 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:54.480015    2579 patch_prober.go:28] interesting pod/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 27 17:53:54.480105 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:54.480061    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js" podUID="694ee30e-b4ff-496c-9684-5c1c9bf0d459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 27 17:53:55.480291 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:55.480255    2579 patch_prober.go:28] interesting pod/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 27 17:53:55.480726 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:55.480315    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js" podUID="694ee30e-b4ff-496c-9684-5c1c9bf0d459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 27 17:53:56.479625 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:56.479588    2579 patch_prober.go:28] interesting pod/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 27 17:53:56.479826 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:56.479658    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js" podUID="694ee30e-b4ff-496c-9684-5c1c9bf0d459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 27 17:53:57.480269 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:57.480187    2579 patch_prober.go:28] interesting pod/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 27 17:53:57.480269 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:57.480246    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js" podUID="694ee30e-b4ff-496c-9684-5c1c9bf0d459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 27 17:53:58.483761 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:58.483730    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:58.484125 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:58.484020    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:53:58.484689 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:53:58.484672    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:55:04.106040 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.106003    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"]
Jul 27 17:55:04.106651 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.106263    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh" podUID="eee8006f-f16f-463b-a4a6-8dc9506a7fbb" containerName="payload-processing" containerID="cri-o://6c9a5896534eed19af6cdacbc0802154cb3b8a3a44ab7dba157385e97b55c91a" gracePeriod=30
Jul 27 17:55:04.114940 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.114888    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"]
Jul 27 17:55:04.115136 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.115108    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj" podUID="e1e0d523-27b5-42e6-92ad-b97af9db60f5" containerName="payload-pre-processing" containerID="cri-o://368f56e8a5a524763fbb14c9f32b9b399ef7ceb725e9cb2aaecb74814521f461" gracePeriod=30
Jul 27 17:55:04.391595 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.391574    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"
Jul 27 17:55:04.394528 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.394503    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"
Jul 27 17:55:04.417471 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.417442    2579 generic.go:356] "Generic (PLEG): container finished" podID="eee8006f-f16f-463b-a4a6-8dc9506a7fbb" containerID="6c9a5896534eed19af6cdacbc0802154cb3b8a3a44ab7dba157385e97b55c91a" exitCode=0
Jul 27 17:55:04.417612 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.417491    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"
Jul 27 17:55:04.417612 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.417516    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh" event={"ID":"eee8006f-f16f-463b-a4a6-8dc9506a7fbb","Type":"ContainerDied","Data":"6c9a5896534eed19af6cdacbc0802154cb3b8a3a44ab7dba157385e97b55c91a"}
Jul 27 17:55:04.417612 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.417578    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh" event={"ID":"eee8006f-f16f-463b-a4a6-8dc9506a7fbb","Type":"ContainerDied","Data":"f652d0a90285df3daff7e61eeb2a0c547f382851ebdac83dddb5902a8f34a02a"}
Jul 27 17:55:04.417761 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.417610    2579 scope.go:117] "RemoveContainer" containerID="6c9a5896534eed19af6cdacbc0802154cb3b8a3a44ab7dba157385e97b55c91a"
Jul 27 17:55:04.419016 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.418996    2579 generic.go:356] "Generic (PLEG): container finished" podID="e1e0d523-27b5-42e6-92ad-b97af9db60f5" containerID="368f56e8a5a524763fbb14c9f32b9b399ef7ceb725e9cb2aaecb74814521f461" exitCode=0
Jul 27 17:55:04.419146 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.419044    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"
Jul 27 17:55:04.419146 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.419061    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj" event={"ID":"e1e0d523-27b5-42e6-92ad-b97af9db60f5","Type":"ContainerDied","Data":"368f56e8a5a524763fbb14c9f32b9b399ef7ceb725e9cb2aaecb74814521f461"}
Jul 27 17:55:04.419146 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.419103    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj" event={"ID":"e1e0d523-27b5-42e6-92ad-b97af9db60f5","Type":"ContainerDied","Data":"e66269ba18b9ec7a04d62a0b6f6bca184201efda461eee5065cd530c2fb8323b"}
Jul 27 17:55:04.428330 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.428314    2579 scope.go:117] "RemoveContainer" containerID="6c9a5896534eed19af6cdacbc0802154cb3b8a3a44ab7dba157385e97b55c91a"
Jul 27 17:55:04.428633 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:55:04.428609    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c9a5896534eed19af6cdacbc0802154cb3b8a3a44ab7dba157385e97b55c91a\": container with ID starting with 6c9a5896534eed19af6cdacbc0802154cb3b8a3a44ab7dba157385e97b55c91a not found: ID does not exist" containerID="6c9a5896534eed19af6cdacbc0802154cb3b8a3a44ab7dba157385e97b55c91a"
Jul 27 17:55:04.428704 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.428648    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c9a5896534eed19af6cdacbc0802154cb3b8a3a44ab7dba157385e97b55c91a"} err="failed to get container status \"6c9a5896534eed19af6cdacbc0802154cb3b8a3a44ab7dba157385e97b55c91a\": rpc error: code = NotFound desc = could not find container \"6c9a5896534eed19af6cdacbc0802154cb3b8a3a44ab7dba157385e97b55c91a\": container with ID starting with 6c9a5896534eed19af6cdacbc0802154cb3b8a3a44ab7dba157385e97b55c91a not found: ID does not exist"
Jul 27 17:55:04.428704 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.428671    2579 scope.go:117] "RemoveContainer" containerID="368f56e8a5a524763fbb14c9f32b9b399ef7ceb725e9cb2aaecb74814521f461"
Jul 27 17:55:04.436959 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.436936    2579 scope.go:117] "RemoveContainer" containerID="368f56e8a5a524763fbb14c9f32b9b399ef7ceb725e9cb2aaecb74814521f461"
Jul 27 17:55:04.437251 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:55:04.437227    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"368f56e8a5a524763fbb14c9f32b9b399ef7ceb725e9cb2aaecb74814521f461\": container with ID starting with 368f56e8a5a524763fbb14c9f32b9b399ef7ceb725e9cb2aaecb74814521f461 not found: ID does not exist" containerID="368f56e8a5a524763fbb14c9f32b9b399ef7ceb725e9cb2aaecb74814521f461"
Jul 27 17:55:04.437311 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.437264    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"368f56e8a5a524763fbb14c9f32b9b399ef7ceb725e9cb2aaecb74814521f461"} err="failed to get container status \"368f56e8a5a524763fbb14c9f32b9b399ef7ceb725e9cb2aaecb74814521f461\": rpc error: code = NotFound desc = could not find container \"368f56e8a5a524763fbb14c9f32b9b399ef7ceb725e9cb2aaecb74814521f461\": container with ID starting with 368f56e8a5a524763fbb14c9f32b9b399ef7ceb725e9cb2aaecb74814521f461 not found: ID does not exist"
Jul 27 17:55:04.526056 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.526025    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9lt6\" (UniqueName: \"kubernetes.io/projected/eee8006f-f16f-463b-a4a6-8dc9506a7fbb-kube-api-access-c9lt6\") pod \"eee8006f-f16f-463b-a4a6-8dc9506a7fbb\" (UID: \"eee8006f-f16f-463b-a4a6-8dc9506a7fbb\") "
Jul 27 17:55:04.526229 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.526070    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1e0d523-27b5-42e6-92ad-b97af9db60f5-plugins-config-volume\") pod \"e1e0d523-27b5-42e6-92ad-b97af9db60f5\" (UID: \"e1e0d523-27b5-42e6-92ad-b97af9db60f5\") "
Jul 27 17:55:04.526229 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.526096    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eee8006f-f16f-463b-a4a6-8dc9506a7fbb-plugins-config-volume\") pod \"eee8006f-f16f-463b-a4a6-8dc9506a7fbb\" (UID: \"eee8006f-f16f-463b-a4a6-8dc9506a7fbb\") "
Jul 27 17:55:04.526229 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.526152    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wt4tg\" (UniqueName: \"kubernetes.io/projected/e1e0d523-27b5-42e6-92ad-b97af9db60f5-kube-api-access-wt4tg\") pod \"e1e0d523-27b5-42e6-92ad-b97af9db60f5\" (UID: \"e1e0d523-27b5-42e6-92ad-b97af9db60f5\") "
Jul 27 17:55:04.526434 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.526398    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1e0d523-27b5-42e6-92ad-b97af9db60f5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e1e0d523-27b5-42e6-92ad-b97af9db60f5" (UID: "e1e0d523-27b5-42e6-92ad-b97af9db60f5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:55:04.526505 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.526485    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eee8006f-f16f-463b-a4a6-8dc9506a7fbb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eee8006f-f16f-463b-a4a6-8dc9506a7fbb" (UID: "eee8006f-f16f-463b-a4a6-8dc9506a7fbb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:55:04.528263 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.528243    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1e0d523-27b5-42e6-92ad-b97af9db60f5-kube-api-access-wt4tg" (OuterVolumeSpecName: "kube-api-access-wt4tg") pod "e1e0d523-27b5-42e6-92ad-b97af9db60f5" (UID: "e1e0d523-27b5-42e6-92ad-b97af9db60f5"). InnerVolumeSpecName "kube-api-access-wt4tg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:55:04.528465 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.528445    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eee8006f-f16f-463b-a4a6-8dc9506a7fbb-kube-api-access-c9lt6" (OuterVolumeSpecName: "kube-api-access-c9lt6") pod "eee8006f-f16f-463b-a4a6-8dc9506a7fbb" (UID: "eee8006f-f16f-463b-a4a6-8dc9506a7fbb"). InnerVolumeSpecName "kube-api-access-c9lt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:55:04.627564 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.627493    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt4tg\" (UniqueName: \"kubernetes.io/projected/e1e0d523-27b5-42e6-92ad-b97af9db60f5-kube-api-access-wt4tg\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:55:04.627564 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.627518    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9lt6\" (UniqueName: \"kubernetes.io/projected/eee8006f-f16f-463b-a4a6-8dc9506a7fbb-kube-api-access-c9lt6\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:55:04.627564 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.627528    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e1e0d523-27b5-42e6-92ad-b97af9db60f5-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:55:04.627564 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.627536    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eee8006f-f16f-463b-a4a6-8dc9506a7fbb-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:55:04.741595 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.741566    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"]
Jul 27 17:55:04.744954 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.744933    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1b693e0c-5c9dbb566-75txh"]
Jul 27 17:55:04.753492 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.753474    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"]
Jul 27 17:55:04.757178 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.757158    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1b693e0c-5b5488774d-6kvgj"]
Jul 27 17:55:04.992993 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.992912    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1e0d523-27b5-42e6-92ad-b97af9db60f5" path="/var/lib/kubelet/pods/e1e0d523-27b5-42e6-92ad-b97af9db60f5/volumes"
Jul 27 17:55:04.993261 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:04.993247    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eee8006f-f16f-463b-a4a6-8dc9506a7fbb" path="/var/lib/kubelet/pods/eee8006f-f16f-463b-a4a6-8dc9506a7fbb/volumes"
Jul 27 17:55:57.178301 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:55:57.178271    2579 scope.go:117] "RemoveContainer" containerID="45006d4f47374a764e581b4af2969f378a87210a8024e95cf038599988c24ff4"
Jul 27 17:56:22.786055 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:22.786024    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"]
Jul 27 17:56:22.786646 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:22.786263    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js" podUID="694ee30e-b4ff-496c-9684-5c1c9bf0d459" containerName="istio-proxy" containerID="cri-o://6167f0d3a42115f701e26c16a1e4ad59de370ee84e5677ac64d5f099d29d4318" gracePeriod=30
Jul 27 17:56:28.050533 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.050504    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:56:28.159632 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.159538    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-token\") pod \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") "
Jul 27 17:56:28.159632 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.159579    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istiod-ca-cert\") pod \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") "
Jul 27 17:56:28.159632 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.159596    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-podinfo\") pod \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") "
Jul 27 17:56:28.159982 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.159635    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-envoy\") pod \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") "
Jul 27 17:56:28.159982 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.159661    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-credential-socket\") pod \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") "
Jul 27 17:56:28.159982 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.159679    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngqgk\" (UniqueName: \"kubernetes.io/projected/694ee30e-b4ff-496c-9684-5c1c9bf0d459-kube-api-access-ngqgk\") pod \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") "
Jul 27 17:56:28.159982 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.159730    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-workload-socket\") pod \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") "
Jul 27 17:56:28.159982 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.159756    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-data\") pod \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") "
Jul 27 17:56:28.159982 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.159854    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-workload-certs\") pod \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\" (UID: \"694ee30e-b4ff-496c-9684-5c1c9bf0d459\") "
Jul 27 17:56:28.160304 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.160126    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "694ee30e-b4ff-496c-9684-5c1c9bf0d459" (UID: "694ee30e-b4ff-496c-9684-5c1c9bf0d459"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:56:28.160304 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.160253    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "694ee30e-b4ff-496c-9684-5c1c9bf0d459" (UID: "694ee30e-b4ff-496c-9684-5c1c9bf0d459"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:56:28.160412 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.160285    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "694ee30e-b4ff-496c-9684-5c1c9bf0d459" (UID: "694ee30e-b4ff-496c-9684-5c1c9bf0d459"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:56:28.160683 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.160593    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "694ee30e-b4ff-496c-9684-5c1c9bf0d459" (UID: "694ee30e-b4ff-496c-9684-5c1c9bf0d459"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:56:28.161356 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.161327    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-data" (OuterVolumeSpecName: "istio-data") pod "694ee30e-b4ff-496c-9684-5c1c9bf0d459" (UID: "694ee30e-b4ff-496c-9684-5c1c9bf0d459"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:56:28.162073 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.162044    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-token" (OuterVolumeSpecName: "istio-token") pod "694ee30e-b4ff-496c-9684-5c1c9bf0d459" (UID: "694ee30e-b4ff-496c-9684-5c1c9bf0d459"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:56:28.162218 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.162199    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "694ee30e-b4ff-496c-9684-5c1c9bf0d459" (UID: "694ee30e-b4ff-496c-9684-5c1c9bf0d459"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:56:28.162272 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.162215    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/694ee30e-b4ff-496c-9684-5c1c9bf0d459-kube-api-access-ngqgk" (OuterVolumeSpecName: "kube-api-access-ngqgk") pod "694ee30e-b4ff-496c-9684-5c1c9bf0d459" (UID: "694ee30e-b4ff-496c-9684-5c1c9bf0d459"). InnerVolumeSpecName "kube-api-access-ngqgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:56:28.162309 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.162288    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "694ee30e-b4ff-496c-9684-5c1c9bf0d459" (UID: "694ee30e-b4ff-496c-9684-5c1c9bf0d459"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 17:56:28.261088 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.261053    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-token\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:56:28.261088 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.261084    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istiod-ca-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:56:28.261304 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.261099    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-podinfo\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:56:28.261304 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.261109    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-envoy\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:56:28.261304 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.261120    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-credential-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:56:28.261304 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.261132    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngqgk\" (UniqueName: \"kubernetes.io/projected/694ee30e-b4ff-496c-9684-5c1c9bf0d459-kube-api-access-ngqgk\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:56:28.261304 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.261145    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-workload-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:56:28.261304 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.261156    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-istio-data\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:56:28.261304 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.261168    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/694ee30e-b4ff-496c-9684-5c1c9bf0d459-workload-certs\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:56:28.880609 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.880573    2579 generic.go:356] "Generic (PLEG): container finished" podID="694ee30e-b4ff-496c-9684-5c1c9bf0d459" containerID="6167f0d3a42115f701e26c16a1e4ad59de370ee84e5677ac64d5f099d29d4318" exitCode=0
Jul 27 17:56:28.880793 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.880629    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"
Jul 27 17:56:28.880793 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.880632    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js" event={"ID":"694ee30e-b4ff-496c-9684-5c1c9bf0d459","Type":"ContainerDied","Data":"6167f0d3a42115f701e26c16a1e4ad59de370ee84e5677ac64d5f099d29d4318"}
Jul 27 17:56:28.880793 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.880687    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js" event={"ID":"694ee30e-b4ff-496c-9684-5c1c9bf0d459","Type":"ContainerDied","Data":"944e93a6c94103b689d0c339d780a8251d941786b1674a547b400a49fb36ea6b"}
Jul 27 17:56:28.880793 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.880718    2579 scope.go:117] "RemoveContainer" containerID="6167f0d3a42115f701e26c16a1e4ad59de370ee84e5677ac64d5f099d29d4318"
Jul 27 17:56:28.890195 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.890177    2579 scope.go:117] "RemoveContainer" containerID="a2d219fdb3e936b6ba2f6f3b08c0ff4e886b5b318cb17faf4ac6ec5e4e6cc890"
Jul 27 17:56:28.901581 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.901554    2579 scope.go:117] "RemoveContainer" containerID="6167f0d3a42115f701e26c16a1e4ad59de370ee84e5677ac64d5f099d29d4318"
Jul 27 17:56:28.902000 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:56:28.901968    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6167f0d3a42115f701e26c16a1e4ad59de370ee84e5677ac64d5f099d29d4318\": container with ID starting with 6167f0d3a42115f701e26c16a1e4ad59de370ee84e5677ac64d5f099d29d4318 not found: ID does not exist" containerID="6167f0d3a42115f701e26c16a1e4ad59de370ee84e5677ac64d5f099d29d4318"
Jul 27 17:56:28.902121 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.902010    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6167f0d3a42115f701e26c16a1e4ad59de370ee84e5677ac64d5f099d29d4318"} err="failed to get container status \"6167f0d3a42115f701e26c16a1e4ad59de370ee84e5677ac64d5f099d29d4318\": rpc error: code = NotFound desc = could not find container \"6167f0d3a42115f701e26c16a1e4ad59de370ee84e5677ac64d5f099d29d4318\": container with ID starting with 6167f0d3a42115f701e26c16a1e4ad59de370ee84e5677ac64d5f099d29d4318 not found: ID does not exist"
Jul 27 17:56:28.902121 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.902034    2579 scope.go:117] "RemoveContainer" containerID="a2d219fdb3e936b6ba2f6f3b08c0ff4e886b5b318cb17faf4ac6ec5e4e6cc890"
Jul 27 17:56:28.902458 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:56:28.902406    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2d219fdb3e936b6ba2f6f3b08c0ff4e886b5b318cb17faf4ac6ec5e4e6cc890\": container with ID starting with a2d219fdb3e936b6ba2f6f3b08c0ff4e886b5b318cb17faf4ac6ec5e4e6cc890 not found: ID does not exist" containerID="a2d219fdb3e936b6ba2f6f3b08c0ff4e886b5b318cb17faf4ac6ec5e4e6cc890"
Jul 27 17:56:28.902554 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.902464    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2d219fdb3e936b6ba2f6f3b08c0ff4e886b5b318cb17faf4ac6ec5e4e6cc890"} err="failed to get container status \"a2d219fdb3e936b6ba2f6f3b08c0ff4e886b5b318cb17faf4ac6ec5e4e6cc890\": rpc error: code = NotFound desc = could not find container \"a2d219fdb3e936b6ba2f6f3b08c0ff4e886b5b318cb17faf4ac6ec5e4e6cc890\": container with ID starting with a2d219fdb3e936b6ba2f6f3b08c0ff4e886b5b318cb17faf4ac6ec5e4e6cc890 not found: ID does not exist"
Jul 27 17:56:28.913045 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.913020    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"]
Jul 27 17:56:28.916524 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.916502    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1b693e0c-openshift-default-6cbb8f7644-8x4js"]
Jul 27 17:56:28.993235 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:28.993203    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="694ee30e-b4ff-496c-9684-5c1c9bf0d459" path="/var/lib/kubelet/pods/694ee30e-b4ff-496c-9684-5c1c9bf0d459/volumes"
Jul 27 17:56:57.206428 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:56:57.206395    2579 scope.go:117] "RemoveContainer" containerID="938c85eb48c6d2d0691991322452cd283ca58113456ddf264be7c76d4612dc33"
Jul 27 17:57:18.241432 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.241383    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"]
Jul 27 17:57:18.241801 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.241770    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1e0d523-27b5-42e6-92ad-b97af9db60f5" containerName="payload-pre-processing"
Jul 27 17:57:18.241801 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.241782    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1e0d523-27b5-42e6-92ad-b97af9db60f5" containerName="payload-pre-processing"
Jul 27 17:57:18.241801 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.241799    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eee8006f-f16f-463b-a4a6-8dc9506a7fbb" containerName="payload-processing"
Jul 27 17:57:18.241906 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.241805    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="eee8006f-f16f-463b-a4a6-8dc9506a7fbb" containerName="payload-processing"
Jul 27 17:57:18.241906 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.241813    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="694ee30e-b4ff-496c-9684-5c1c9bf0d459" containerName="istio-proxy"
Jul 27 17:57:18.241906 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.241822    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="694ee30e-b4ff-496c-9684-5c1c9bf0d459" containerName="istio-proxy"
Jul 27 17:57:18.241906 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.241839    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="694ee30e-b4ff-496c-9684-5c1c9bf0d459" containerName="istio-proxy"
Jul 27 17:57:18.241906 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.241845    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="694ee30e-b4ff-496c-9684-5c1c9bf0d459" containerName="istio-proxy"
Jul 27 17:57:18.241906 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.241902    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1e0d523-27b5-42e6-92ad-b97af9db60f5" containerName="payload-pre-processing"
Jul 27 17:57:18.242089 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.241912    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="694ee30e-b4ff-496c-9684-5c1c9bf0d459" containerName="istio-proxy"
Jul 27 17:57:18.242089 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.241917    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="694ee30e-b4ff-496c-9684-5c1c9bf0d459" containerName="istio-proxy"
Jul 27 17:57:18.242089 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.241923    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="eee8006f-f16f-463b-a4a6-8dc9506a7fbb" containerName="payload-processing"
Jul 27 17:57:18.245126 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.245105    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.246993 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.246971    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a155ed-openshift-default-dockercfg-ptqp7\""
Jul 27 17:57:18.257252 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.257229    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"]
Jul 27 17:57:18.301370 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.301341    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-token\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.301535 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.301375    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-podinfo\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.301535 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.301447    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8zq6\" (UniqueName: \"kubernetes.io/projected/cd8b62de-bfac-472a-bda0-6979e4d6383b-kube-api-access-s8zq6\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.301535 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.301484    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-workload-certs\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.301535 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.301523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-credential-socket\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.301921 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.301897    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-data\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.302145 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.302090    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-envoy\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.302244 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.302191    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-workload-socket\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.302303 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.302240    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd8b62de-bfac-472a-bda0-6979e4d6383b-istiod-ca-cert\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.402985 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.402946    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-token\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.402985 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.402987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-podinfo\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.403247 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.403122    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8zq6\" (UniqueName: \"kubernetes.io/projected/cd8b62de-bfac-472a-bda0-6979e4d6383b-kube-api-access-s8zq6\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.403247 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.403212    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-workload-certs\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.403351 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.403264    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-credential-socket\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.403351 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.403288    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-data\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.403351 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.403320    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-envoy\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.403351 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.403346    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-workload-socket\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.403586 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.403379    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd8b62de-bfac-472a-bda0-6979e4d6383b-istiod-ca-cert\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.403752 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.403723    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-workload-certs\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.403878 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.403727    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-credential-socket\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.403878 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.403830    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-data\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.403878 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.403853    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-workload-socket\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.404124 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.404106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd8b62de-bfac-472a-bda0-6979e4d6383b-istiod-ca-cert\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.405688 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.405666    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-podinfo\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.405808 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.405744    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-envoy\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.410883 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.410865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-token\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.411399 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.411379    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8zq6\" (UniqueName: \"kubernetes.io/projected/cd8b62de-bfac-472a-bda0-6979e4d6383b-kube-api-access-s8zq6\") pod \"e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") " pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.556335 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.556301    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:18.699504 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.699475    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"]
Jul 27 17:57:18.701137 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:57:18.701112    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd8b62de_bfac_472a_bda0_6979e4d6383b.slice/crio-c76e90e9ade32bcfaa9555eba508c2227c9355bfbdfc6adbfc34a7a15e6d47d5 WatchSource:0}: Error finding container c76e90e9ade32bcfaa9555eba508c2227c9355bfbdfc6adbfc34a7a15e6d47d5: Status 404 returned error can't find the container with id c76e90e9ade32bcfaa9555eba508c2227c9355bfbdfc6adbfc34a7a15e6d47d5
Jul 27 17:57:18.703311 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.703273    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:57:18.703394 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.703346    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:57:18.703394 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:18.703379    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:57:19.143027 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:19.142988    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls" event={"ID":"cd8b62de-bfac-472a-bda0-6979e4d6383b","Type":"ContainerStarted","Data":"ebcf467abf14e2502e96a2eb11d7ca4bd208a5755176a372c24c6259fdb82503"}
Jul 27 17:57:19.143254 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:19.143051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls" event={"ID":"cd8b62de-bfac-472a-bda0-6979e4d6383b","Type":"ContainerStarted","Data":"c76e90e9ade32bcfaa9555eba508c2227c9355bfbdfc6adbfc34a7a15e6d47d5"}
Jul 27 17:57:19.164880 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:19.164828    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls" podStartSLOduration=1.164808748 podStartE2EDuration="1.164808748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:57:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:57:19.16159196 +0000 UTC m=+2182.693342946" watchObservedRunningTime="2026-07-27 17:57:19.164808748 +0000 UTC m=+2182.696559738"
Jul 27 17:57:19.556503 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:19.556468    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:19.561254 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:19.561232    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:20.149833 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:20.149801    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:20.150774 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:20.150749    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:22.001654 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:22.001619    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"]
Jul 27 17:57:22.005144 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:22.005127    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"
Jul 27 17:57:22.007240 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:22.007217    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-a155ed\""
Jul 27 17:57:22.007601 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:22.007217    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-a155ed-dockercfg-hg8vh\""
Jul 27 17:57:22.016615 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:22.016587    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"]
Jul 27 17:57:22.037044 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:22.037013    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca092ad7-6609-4b83-bc2c-bb62319b8f78-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx\" (UID: \"ca092ad7-6609-4b83-bc2c-bb62319b8f78\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"
Jul 27 17:57:22.037196 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:22.037091    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jmjh\" (UniqueName: \"kubernetes.io/projected/ca092ad7-6609-4b83-bc2c-bb62319b8f78-kube-api-access-5jmjh\") pod \"payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx\" (UID: \"ca092ad7-6609-4b83-bc2c-bb62319b8f78\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"
Jul 27 17:57:22.137652 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:22.137612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jmjh\" (UniqueName: \"kubernetes.io/projected/ca092ad7-6609-4b83-bc2c-bb62319b8f78-kube-api-access-5jmjh\") pod \"payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx\" (UID: \"ca092ad7-6609-4b83-bc2c-bb62319b8f78\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"
Jul 27 17:57:22.137852 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:22.137735    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca092ad7-6609-4b83-bc2c-bb62319b8f78-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx\" (UID: \"ca092ad7-6609-4b83-bc2c-bb62319b8f78\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"
Jul 27 17:57:22.138506 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:22.138482    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca092ad7-6609-4b83-bc2c-bb62319b8f78-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx\" (UID: \"ca092ad7-6609-4b83-bc2c-bb62319b8f78\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"
Jul 27 17:57:22.145487 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:22.145462    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jmjh\" (UniqueName: \"kubernetes.io/projected/ca092ad7-6609-4b83-bc2c-bb62319b8f78-kube-api-access-5jmjh\") pod \"payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx\" (UID: \"ca092ad7-6609-4b83-bc2c-bb62319b8f78\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"
Jul 27 17:57:22.318814 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:22.318776    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"
Jul 27 17:57:22.462718 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:22.462600    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"]
Jul 27 17:57:23.167300 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:23.167257    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx" event={"ID":"ca092ad7-6609-4b83-bc2c-bb62319b8f78","Type":"ContainerStarted","Data":"0c4618de7c7da8bad8f46b2f67d0f63095c5bb00e277aa8a7ed2d3c50661f7a8"}
Jul 27 17:57:23.167767 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:23.167308    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx" event={"ID":"ca092ad7-6609-4b83-bc2c-bb62319b8f78","Type":"ContainerStarted","Data":"9d8f72cbdc5fcb10c06fe2af30a07710ca5a9891f826c22f5fbc4c4666945f0f"}
Jul 27 17:57:23.167767 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:23.167345    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"
Jul 27 17:57:23.185720 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:23.185659    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx" podStartSLOduration=2.185644799 podStartE2EDuration="2.185644799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:57:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:57:23.183773971 +0000 UTC m=+2186.715524957" watchObservedRunningTime="2026-07-27 17:57:23.185644799 +0000 UTC m=+2186.717395784"
Jul 27 17:57:26.274120 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.274087    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"]
Jul 27 17:57:26.278355 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.278331    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.280311 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.280294    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-ab2501-openshift-default-dockercfg-m8rdm\""
Jul 27 17:57:26.290830 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.290806    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"]
Jul 27 17:57:26.373119 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.373083    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/869a2145-4043-42b5-ab8d-6e453ab383a4-istiod-ca-cert\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.373119 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.373118    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-workload-certs\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.373321 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.373137    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-podinfo\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.373321 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.373221    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-data\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.373321 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.373254    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-token\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.373321 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.373306    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-credential-socket\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.373492 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.373327    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-workload-socket\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.373492 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.373345    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-envoy\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.373492 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.373390    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scckw\" (UniqueName: \"kubernetes.io/projected/869a2145-4043-42b5-ab8d-6e453ab383a4-kube-api-access-scckw\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.474544 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.474511    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-workload-certs\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.474544 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.474545    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-podinfo\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.474796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.474578    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-data\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.474796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.474607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-token\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.474796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.474662    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-credential-socket\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.474796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.474689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-workload-socket\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.474796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.474711    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-envoy\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.474796 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.474759    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scckw\" (UniqueName: \"kubernetes.io/projected/869a2145-4043-42b5-ab8d-6e453ab383a4-kube-api-access-scckw\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.475208 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.474829    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/869a2145-4043-42b5-ab8d-6e453ab383a4-istiod-ca-cert\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.475208 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.474960    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-workload-certs\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.475208 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.475024    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-data\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.475208 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.475111    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-workload-socket\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.475208 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.475168    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-credential-socket\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.475542 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.475523    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/869a2145-4043-42b5-ab8d-6e453ab383a4-istiod-ca-cert\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.477248 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.477223    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-podinfo\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.477357 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.477293    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-envoy\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.483271 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.483246    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-token\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.483410 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.483246    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scckw\" (UniqueName: \"kubernetes.io/projected/869a2145-4043-42b5-ab8d-6e453ab383a4-kube-api-access-scckw\") pod \"e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") " pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.588564 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.588480    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:26.731256 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.731223    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"]
Jul 27 17:57:26.732288 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:57:26.732260    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod869a2145_4043_42b5_ab8d_6e453ab383a4.slice/crio-88cd1a6076b6e9f7692a1262f476538f0844757a9ceaadedef3942599ed4d7a8 WatchSource:0}: Error finding container 88cd1a6076b6e9f7692a1262f476538f0844757a9ceaadedef3942599ed4d7a8: Status 404 returned error can't find the container with id 88cd1a6076b6e9f7692a1262f476538f0844757a9ceaadedef3942599ed4d7a8
Jul 27 17:57:26.734657 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.734628    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:57:26.734753 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.734694    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:57:26.734753 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:26.734720    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:57:27.191436 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:27.191384    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9" event={"ID":"869a2145-4043-42b5-ab8d-6e453ab383a4","Type":"ContainerStarted","Data":"6f5658d84037b09c77a16a8dbc1c088c6d80e9bde4822e390d11d952e175592e"}
Jul 27 17:57:27.191601 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:27.191464    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9" event={"ID":"869a2145-4043-42b5-ab8d-6e453ab383a4","Type":"ContainerStarted","Data":"88cd1a6076b6e9f7692a1262f476538f0844757a9ceaadedef3942599ed4d7a8"}
Jul 27 17:57:27.589491 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:27.589459    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:27.594407 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:27.594379    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:27.615484 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:27.615407    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9" podStartSLOduration=1.6153869749999998 podStartE2EDuration="1.615386975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:57:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:57:27.212709561 +0000 UTC m=+2190.744460560" watchObservedRunningTime="2026-07-27 17:57:27.615386975 +0000 UTC m=+2191.147137964"
Jul 27 17:57:28.196476 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:28.196449    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:28.197544 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:28.197518    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:30.275025 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:30.274986    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"]
Jul 27 17:57:30.278333 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:30.278312    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"
Jul 27 17:57:30.281157 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:30.281126    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-ab2501-dockercfg-gcp4c\""
Jul 27 17:57:30.281339 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:30.281323    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-ab2501\""
Jul 27 17:57:30.288780 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:30.288756    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"]
Jul 27 17:57:30.417442 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:30.416925    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vp9z\" (UniqueName: \"kubernetes.io/projected/54ab8281-d775-465d-938b-1c572ff1da8a-kube-api-access-7vp9z\") pod \"payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v\" (UID: \"54ab8281-d775-465d-938b-1c572ff1da8a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"
Jul 27 17:57:30.417442 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:30.417014    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54ab8281-d775-465d-938b-1c572ff1da8a-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v\" (UID: \"54ab8281-d775-465d-938b-1c572ff1da8a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"
Jul 27 17:57:30.517950 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:30.517897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54ab8281-d775-465d-938b-1c572ff1da8a-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v\" (UID: \"54ab8281-d775-465d-938b-1c572ff1da8a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"
Jul 27 17:57:30.518154 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:30.518036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vp9z\" (UniqueName: \"kubernetes.io/projected/54ab8281-d775-465d-938b-1c572ff1da8a-kube-api-access-7vp9z\") pod \"payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v\" (UID: \"54ab8281-d775-465d-938b-1c572ff1da8a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"
Jul 27 17:57:30.519402 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:30.519366    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54ab8281-d775-465d-938b-1c572ff1da8a-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v\" (UID: \"54ab8281-d775-465d-938b-1c572ff1da8a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"
Jul 27 17:57:30.532445 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:30.532348    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vp9z\" (UniqueName: \"kubernetes.io/projected/54ab8281-d775-465d-938b-1c572ff1da8a-kube-api-access-7vp9z\") pod \"payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v\" (UID: \"54ab8281-d775-465d-938b-1c572ff1da8a\") " pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"
Jul 27 17:57:30.590579 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:30.590544    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"
Jul 27 17:57:30.784154 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:30.784131    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"]
Jul 27 17:57:30.785847 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:57:30.785810    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ab8281_d775_465d_938b_1c572ff1da8a.slice/crio-22f69b747dd59a7ec30f482b50a978cdb54badb7aec2d1c5dfbe04821696bdb4 WatchSource:0}: Error finding container 22f69b747dd59a7ec30f482b50a978cdb54badb7aec2d1c5dfbe04821696bdb4: Status 404 returned error can't find the container with id 22f69b747dd59a7ec30f482b50a978cdb54badb7aec2d1c5dfbe04821696bdb4
Jul 27 17:57:31.222949 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:31.222850    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v" event={"ID":"54ab8281-d775-465d-938b-1c572ff1da8a","Type":"ContainerStarted","Data":"6ac0e10b11b355c5b640d9c0f9c4399c53033127d3c33bddf100ecbc284d70fc"}
Jul 27 17:57:31.223178 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:31.223151    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v" event={"ID":"54ab8281-d775-465d-938b-1c572ff1da8a","Type":"ContainerStarted","Data":"22f69b747dd59a7ec30f482b50a978cdb54badb7aec2d1c5dfbe04821696bdb4"}
Jul 27 17:57:31.223254 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:31.223201    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"
Jul 27 17:57:31.240201 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:31.240149    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v" podStartSLOduration=1.240134024 podStartE2EDuration="1.240134024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:57:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:57:31.236748315 +0000 UTC m=+2194.768499301" watchObservedRunningTime="2026-07-27 17:57:31.240134024 +0000 UTC m=+2194.771885011"
Jul 27 17:57:34.176068 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:34.176037    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"
Jul 27 17:57:36.191581 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:36.191541    2579 patch_prober.go:28] interesting pod/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 17:57:36.192797 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:36.191608    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls" podUID="cd8b62de-bfac-472a-bda0-6979e4d6383b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 17:57:36.255695 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:36.255663    2579 generic.go:356] "Generic (PLEG): container finished" podID="cd8b62de-bfac-472a-bda0-6979e4d6383b" containerID="ebcf467abf14e2502e96a2eb11d7ca4bd208a5755176a372c24c6259fdb82503" exitCode=0
Jul 27 17:57:36.255868 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:36.255745    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls" event={"ID":"cd8b62de-bfac-472a-bda0-6979e4d6383b","Type":"ContainerDied","Data":"ebcf467abf14e2502e96a2eb11d7ca4bd208a5755176a372c24c6259fdb82503"}
Jul 27 17:57:36.256212 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:36.256193    2579 scope.go:117] "RemoveContainer" containerID="ebcf467abf14e2502e96a2eb11d7ca4bd208a5755176a372c24c6259fdb82503"
Jul 27 17:57:36.257258 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:36.257233    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:57:36.257312 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:36.257302    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:57:36.257354 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:36.257333    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:57:37.264172 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:37.264122    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls" event={"ID":"cd8b62de-bfac-472a-bda0-6979e4d6383b","Type":"ContainerStarted","Data":"f1057cfc9703bea71d89f6db02ebd048d1a01c149608da9f273a80672238e674"}
Jul 27 17:57:37.556793 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:37.556752    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:37.557012 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:37.556891    2579 patch_prober.go:28] interesting pod/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 27 17:57:37.557012 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:37.556937    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls" podUID="cd8b62de-bfac-472a-bda0-6979e4d6383b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 27 17:57:38.557804 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:38.557755    2579 patch_prober.go:28] interesting pod/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 27 17:57:38.558324 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:38.557836    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls" podUID="cd8b62de-bfac-472a-bda0-6979e4d6383b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 27 17:57:39.557070 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:39.557033    2579 patch_prober.go:28] interesting pod/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 27 17:57:39.557391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:39.557358    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls" podUID="cd8b62de-bfac-472a-bda0-6979e4d6383b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 27 17:57:40.557357 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:40.557317    2579 patch_prober.go:28] interesting pod/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 27 17:57:40.557945 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:40.557914    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls" podUID="cd8b62de-bfac-472a-bda0-6979e4d6383b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 27 17:57:41.560675 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:41.560643    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:41.561046 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:41.560934    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:41.561515 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:41.561501    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:57:42.233916 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:42.233889    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"
Jul 27 17:57:44.238622 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:44.238573    2579 patch_prober.go:28] interesting pod/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 17:57:44.239152 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:44.238642    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9" podUID="869a2145-4043-42b5-ab8d-6e453ab383a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 17:57:45.310267 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:45.310227    2579 generic.go:356] "Generic (PLEG): container finished" podID="869a2145-4043-42b5-ab8d-6e453ab383a4" containerID="6f5658d84037b09c77a16a8dbc1c088c6d80e9bde4822e390d11d952e175592e" exitCode=0
Jul 27 17:57:45.310775 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:45.310262    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9" event={"ID":"869a2145-4043-42b5-ab8d-6e453ab383a4","Type":"ContainerDied","Data":"6f5658d84037b09c77a16a8dbc1c088c6d80e9bde4822e390d11d952e175592e"}
Jul 27 17:57:45.310775 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:45.310708    2579 scope.go:117] "RemoveContainer" containerID="6f5658d84037b09c77a16a8dbc1c088c6d80e9bde4822e390d11d952e175592e"
Jul 27 17:57:45.311832 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:45.311801    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:57:45.311906 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:45.311888    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:57:45.311961 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:45.311935    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:57:46.322919 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:46.322879    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9" event={"ID":"869a2145-4043-42b5-ab8d-6e453ab383a4","Type":"ContainerStarted","Data":"4c8a3dfd1ddc0ceb6d9b4c56370493c169c9e5db4568e8c41abafaeb1ca59b8f"}
Jul 27 17:57:46.588957 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:46.588872    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:46.589106 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:46.589077    2579 patch_prober.go:28] interesting pod/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 27 17:57:46.589195 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:46.589130    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9" podUID="869a2145-4043-42b5-ab8d-6e453ab383a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 27 17:57:47.589199 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:47.589163    2579 patch_prober.go:28] interesting pod/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 27 17:57:47.589636 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:47.589216    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9" podUID="869a2145-4043-42b5-ab8d-6e453ab383a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 27 17:57:48.589685 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:48.589645    2579 patch_prober.go:28] interesting pod/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 27 17:57:48.590084 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:48.589719    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9" podUID="869a2145-4043-42b5-ab8d-6e453ab383a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 27 17:57:49.589518 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:49.589486    2579 patch_prober.go:28] interesting pod/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Jul 27 17:57:49.589713 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:49.589544    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9" podUID="869a2145-4043-42b5-ab8d-6e453ab383a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Jul 27 17:57:50.592689 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:50.592661    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:50.593060 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:50.592987    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:57:50.593628 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:57:50.593610    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:58:54.495501 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:54.495471    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms"]
Jul 27 17:58:54.499102 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:54.499086    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms"
Jul 27 17:58:54.503451 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:54.501063    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ldh7c\""
Jul 27 17:58:54.507001 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:54.506980    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms"]
Jul 27 17:58:54.591868 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:54.591830    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a751ba99-2f24-45ff-91db-8ce83553e9b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms\" (UID: \"a751ba99-2f24-45ff-91db-8ce83553e9b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms"
Jul 27 17:58:54.693188 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:54.693147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a751ba99-2f24-45ff-91db-8ce83553e9b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms\" (UID: \"a751ba99-2f24-45ff-91db-8ce83553e9b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms"
Jul 27 17:58:54.693828 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:54.693809    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a751ba99-2f24-45ff-91db-8ce83553e9b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms\" (UID: \"a751ba99-2f24-45ff-91db-8ce83553e9b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms"
Jul 27 17:58:54.822824 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:54.822790    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms"
Jul 27 17:58:54.960864 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:54.960832    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms"]
Jul 27 17:58:54.961996 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:58:54.961956    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda751ba99_2f24_45ff_91db_8ce83553e9b2.slice/crio-dc5f68a5f3ba91693b2ddddcb04016b2c28cbfaae249b1375f9fd83b23f2876d WatchSource:0}: Error finding container dc5f68a5f3ba91693b2ddddcb04016b2c28cbfaae249b1375f9fd83b23f2876d: Status 404 returned error can't find the container with id dc5f68a5f3ba91693b2ddddcb04016b2c28cbfaae249b1375f9fd83b23f2876d
Jul 27 17:58:55.710696 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:55.710653    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms" event={"ID":"a751ba99-2f24-45ff-91db-8ce83553e9b2","Type":"ContainerStarted","Data":"25ab5a3761f5e40f3a11eae2dd9ed21f6ebbed19a026d8df59262a76ea08be33"}
Jul 27 17:58:55.711190 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:55.710722    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms" event={"ID":"a751ba99-2f24-45ff-91db-8ce83553e9b2","Type":"ContainerStarted","Data":"dc5f68a5f3ba91693b2ddddcb04016b2c28cbfaae249b1375f9fd83b23f2876d"}
Jul 27 17:58:55.723943 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:55.723899    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms" podStartSLOduration=1.7238815600000001 podStartE2EDuration="1.72388156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:58:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:58:55.722722824 +0000 UTC m=+2279.254473810" watchObservedRunningTime="2026-07-27 17:58:55.72388156 +0000 UTC m=+2279.255632569"
Jul 27 17:58:56.717849 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:56.717809    2579 generic.go:356] "Generic (PLEG): container finished" podID="a751ba99-2f24-45ff-91db-8ce83553e9b2" containerID="25ab5a3761f5e40f3a11eae2dd9ed21f6ebbed19a026d8df59262a76ea08be33" exitCode=0
Jul 27 17:58:56.718270 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:56.717896    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms" event={"ID":"a751ba99-2f24-45ff-91db-8ce83553e9b2","Type":"ContainerDied","Data":"25ab5a3761f5e40f3a11eae2dd9ed21f6ebbed19a026d8df59262a76ea08be33"}
Jul 27 17:58:57.861527 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:57.861505    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms"
Jul 27 17:58:57.920858 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:57.920819    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a751ba99-2f24-45ff-91db-8ce83553e9b2-maas-api-service-ca\") pod \"a751ba99-2f24-45ff-91db-8ce83553e9b2\" (UID: \"a751ba99-2f24-45ff-91db-8ce83553e9b2\") "
Jul 27 17:58:57.921180 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:57.921159    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a751ba99-2f24-45ff-91db-8ce83553e9b2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a751ba99-2f24-45ff-91db-8ce83553e9b2" (UID: "a751ba99-2f24-45ff-91db-8ce83553e9b2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:58:58.022019 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:58.021995    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a751ba99-2f24-45ff-91db-8ce83553e9b2-maas-api-service-ca\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:58:58.732671 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:58.732636    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms"
Jul 27 17:58:58.732882 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:58.732664    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms" event={"ID":"a751ba99-2f24-45ff-91db-8ce83553e9b2","Type":"ContainerDied","Data":"dc5f68a5f3ba91693b2ddddcb04016b2c28cbfaae249b1375f9fd83b23f2876d"}
Jul 27 17:58:58.732882 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:58:58.732728    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc5f68a5f3ba91693b2ddddcb04016b2c28cbfaae249b1375f9fd83b23f2876d"
Jul 27 17:59:04.975543 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:04.975492    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"]
Jul 27 17:59:04.976567 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:04.976534    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx" podUID="ca092ad7-6609-4b83-bc2c-bb62319b8f78" containerName="payload-pre-processing" containerID="cri-o://0c4618de7c7da8bad8f46b2f67d0f63095c5bb00e277aa8a7ed2d3c50661f7a8" gracePeriod=30
Jul 27 17:59:05.252931 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:05.252906    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"
Jul 27 17:59:05.391293 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:05.391262    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jmjh\" (UniqueName: \"kubernetes.io/projected/ca092ad7-6609-4b83-bc2c-bb62319b8f78-kube-api-access-5jmjh\") pod \"ca092ad7-6609-4b83-bc2c-bb62319b8f78\" (UID: \"ca092ad7-6609-4b83-bc2c-bb62319b8f78\") "
Jul 27 17:59:05.391500 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:05.391329    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca092ad7-6609-4b83-bc2c-bb62319b8f78-plugins-config-volume\") pod \"ca092ad7-6609-4b83-bc2c-bb62319b8f78\" (UID: \"ca092ad7-6609-4b83-bc2c-bb62319b8f78\") "
Jul 27 17:59:05.391670 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:05.391648    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca092ad7-6609-4b83-bc2c-bb62319b8f78-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ca092ad7-6609-4b83-bc2c-bb62319b8f78" (UID: "ca092ad7-6609-4b83-bc2c-bb62319b8f78"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:59:05.393534 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:05.393513    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca092ad7-6609-4b83-bc2c-bb62319b8f78-kube-api-access-5jmjh" (OuterVolumeSpecName: "kube-api-access-5jmjh") pod "ca092ad7-6609-4b83-bc2c-bb62319b8f78" (UID: "ca092ad7-6609-4b83-bc2c-bb62319b8f78"). InnerVolumeSpecName "kube-api-access-5jmjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:59:05.492800 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:05.492706    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jmjh\" (UniqueName: \"kubernetes.io/projected/ca092ad7-6609-4b83-bc2c-bb62319b8f78-kube-api-access-5jmjh\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:05.492800 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:05.492738    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca092ad7-6609-4b83-bc2c-bb62319b8f78-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:05.772723 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:05.772689    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca092ad7-6609-4b83-bc2c-bb62319b8f78" containerID="0c4618de7c7da8bad8f46b2f67d0f63095c5bb00e277aa8a7ed2d3c50661f7a8" exitCode=0
Jul 27 17:59:05.772911 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:05.772741    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"
Jul 27 17:59:05.772911 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:05.772772    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx" event={"ID":"ca092ad7-6609-4b83-bc2c-bb62319b8f78","Type":"ContainerDied","Data":"0c4618de7c7da8bad8f46b2f67d0f63095c5bb00e277aa8a7ed2d3c50661f7a8"}
Jul 27 17:59:05.772911 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:05.772827    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx" event={"ID":"ca092ad7-6609-4b83-bc2c-bb62319b8f78","Type":"ContainerDied","Data":"9d8f72cbdc5fcb10c06fe2af30a07710ca5a9891f826c22f5fbc4c4666945f0f"}
Jul 27 17:59:05.772911 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:05.772850    2579 scope.go:117] "RemoveContainer" containerID="0c4618de7c7da8bad8f46b2f67d0f63095c5bb00e277aa8a7ed2d3c50661f7a8"
Jul 27 17:59:05.782094 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:05.782078    2579 scope.go:117] "RemoveContainer" containerID="0c4618de7c7da8bad8f46b2f67d0f63095c5bb00e277aa8a7ed2d3c50661f7a8"
Jul 27 17:59:05.782366 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:59:05.782345    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c4618de7c7da8bad8f46b2f67d0f63095c5bb00e277aa8a7ed2d3c50661f7a8\": container with ID starting with 0c4618de7c7da8bad8f46b2f67d0f63095c5bb00e277aa8a7ed2d3c50661f7a8 not found: ID does not exist" containerID="0c4618de7c7da8bad8f46b2f67d0f63095c5bb00e277aa8a7ed2d3c50661f7a8"
Jul 27 17:59:05.782473 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:05.782378    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c4618de7c7da8bad8f46b2f67d0f63095c5bb00e277aa8a7ed2d3c50661f7a8"} err="failed to get container status \"0c4618de7c7da8bad8f46b2f67d0f63095c5bb00e277aa8a7ed2d3c50661f7a8\": rpc error: code = NotFound desc = could not find container \"0c4618de7c7da8bad8f46b2f67d0f63095c5bb00e277aa8a7ed2d3c50661f7a8\": container with ID starting with 0c4618de7c7da8bad8f46b2f67d0f63095c5bb00e277aa8a7ed2d3c50661f7a8 not found: ID does not exist"
Jul 27 17:59:05.792667 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:05.792646    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"]
Jul 27 17:59:05.796157 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:05.796137    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a155ed-56d6468c84-94lzx"]
Jul 27 17:59:06.993649 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:06.993614    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca092ad7-6609-4b83-bc2c-bb62319b8f78" path="/var/lib/kubelet/pods/ca092ad7-6609-4b83-bc2c-bb62319b8f78/volumes"
Jul 27 17:59:09.585903 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:09.585864    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms"]
Jul 27 17:59:09.589797 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:09.589775    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a155ed-8kvms"]
Jul 27 17:59:10.999431 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:10.999384    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a751ba99-2f24-45ff-91db-8ce83553e9b2" path="/var/lib/kubelet/pods/a751ba99-2f24-45ff-91db-8ce83553e9b2/volumes"
Jul 27 17:59:16.121651 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:16.121615    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"]
Jul 27 17:59:16.122107 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:16.121873    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls" podUID="cd8b62de-bfac-472a-bda0-6979e4d6383b" containerName="istio-proxy" containerID="cri-o://f1057cfc9703bea71d89f6db02ebd048d1a01c149608da9f273a80672238e674" gracePeriod=30
Jul 27 17:59:21.387352 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.387293    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:59:21.532906 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.532871    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-workload-socket\") pod \"cd8b62de-bfac-472a-bda0-6979e4d6383b\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") "
Jul 27 17:59:21.533099 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.532954    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-podinfo\") pod \"cd8b62de-bfac-472a-bda0-6979e4d6383b\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") "
Jul 27 17:59:21.533099 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.533019    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-data\") pod \"cd8b62de-bfac-472a-bda0-6979e4d6383b\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") "
Jul 27 17:59:21.533099 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.533043    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd8b62de-bfac-472a-bda0-6979e4d6383b-istiod-ca-cert\") pod \"cd8b62de-bfac-472a-bda0-6979e4d6383b\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") "
Jul 27 17:59:21.533099 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.533091    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-workload-certs\") pod \"cd8b62de-bfac-472a-bda0-6979e4d6383b\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") "
Jul 27 17:59:21.533289 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.533122    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-token\") pod \"cd8b62de-bfac-472a-bda0-6979e4d6383b\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") "
Jul 27 17:59:21.533289 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.533156    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8zq6\" (UniqueName: \"kubernetes.io/projected/cd8b62de-bfac-472a-bda0-6979e4d6383b-kube-api-access-s8zq6\") pod \"cd8b62de-bfac-472a-bda0-6979e4d6383b\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") "
Jul 27 17:59:21.533289 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.533180    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cd8b62de-bfac-472a-bda0-6979e4d6383b" (UID: "cd8b62de-bfac-472a-bda0-6979e4d6383b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:59:21.533289 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.533188    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-credential-socket\") pod \"cd8b62de-bfac-472a-bda0-6979e4d6383b\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") "
Jul 27 17:59:21.533289 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.533232    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-envoy\") pod \"cd8b62de-bfac-472a-bda0-6979e4d6383b\" (UID: \"cd8b62de-bfac-472a-bda0-6979e4d6383b\") "
Jul 27 17:59:21.533474 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.533456    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-workload-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:21.533763 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.533740    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd8b62de-bfac-472a-bda0-6979e4d6383b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cd8b62de-bfac-472a-bda0-6979e4d6383b" (UID: "cd8b62de-bfac-472a-bda0-6979e4d6383b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:59:21.533962 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.533937    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cd8b62de-bfac-472a-bda0-6979e4d6383b" (UID: "cd8b62de-bfac-472a-bda0-6979e4d6383b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:59:21.534050 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.533964    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cd8b62de-bfac-472a-bda0-6979e4d6383b" (UID: "cd8b62de-bfac-472a-bda0-6979e4d6383b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:59:21.534246 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.534223    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-data" (OuterVolumeSpecName: "istio-data") pod "cd8b62de-bfac-472a-bda0-6979e4d6383b" (UID: "cd8b62de-bfac-472a-bda0-6979e4d6383b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:59:21.535329 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.535298    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cd8b62de-bfac-472a-bda0-6979e4d6383b" (UID: "cd8b62de-bfac-472a-bda0-6979e4d6383b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 17:59:21.535982 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.535959    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cd8b62de-bfac-472a-bda0-6979e4d6383b" (UID: "cd8b62de-bfac-472a-bda0-6979e4d6383b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:59:21.536477 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.536450    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd8b62de-bfac-472a-bda0-6979e4d6383b-kube-api-access-s8zq6" (OuterVolumeSpecName: "kube-api-access-s8zq6") pod "cd8b62de-bfac-472a-bda0-6979e4d6383b" (UID: "cd8b62de-bfac-472a-bda0-6979e4d6383b"). InnerVolumeSpecName "kube-api-access-s8zq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:59:21.536572 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.536462    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-token" (OuterVolumeSpecName: "istio-token") pod "cd8b62de-bfac-472a-bda0-6979e4d6383b" (UID: "cd8b62de-bfac-472a-bda0-6979e4d6383b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:59:21.634331 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.634296    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-token\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:21.634331 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.634330    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8zq6\" (UniqueName: \"kubernetes.io/projected/cd8b62de-bfac-472a-bda0-6979e4d6383b-kube-api-access-s8zq6\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:21.634591 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.634345    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-credential-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:21.634591 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.634356    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-envoy\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:21.634591 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.634368    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-podinfo\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:21.634591 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.634379    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-istio-data\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:21.634591 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.634390    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd8b62de-bfac-472a-bda0-6979e4d6383b-istiod-ca-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:21.634591 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.634400    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd8b62de-bfac-472a-bda0-6979e4d6383b-workload-certs\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:21.867640 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.867605    2579 generic.go:356] "Generic (PLEG): container finished" podID="cd8b62de-bfac-472a-bda0-6979e4d6383b" containerID="f1057cfc9703bea71d89f6db02ebd048d1a01c149608da9f273a80672238e674" exitCode=0
Jul 27 17:59:21.867828 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.867653    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"
Jul 27 17:59:21.867828 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.867699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls" event={"ID":"cd8b62de-bfac-472a-bda0-6979e4d6383b","Type":"ContainerDied","Data":"f1057cfc9703bea71d89f6db02ebd048d1a01c149608da9f273a80672238e674"}
Jul 27 17:59:21.867828 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.867757    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls" event={"ID":"cd8b62de-bfac-472a-bda0-6979e4d6383b","Type":"ContainerDied","Data":"c76e90e9ade32bcfaa9555eba508c2227c9355bfbdfc6adbfc34a7a15e6d47d5"}
Jul 27 17:59:21.867828 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.867783    2579 scope.go:117] "RemoveContainer" containerID="f1057cfc9703bea71d89f6db02ebd048d1a01c149608da9f273a80672238e674"
Jul 27 17:59:21.877579 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.877562    2579 scope.go:117] "RemoveContainer" containerID="ebcf467abf14e2502e96a2eb11d7ca4bd208a5755176a372c24c6259fdb82503"
Jul 27 17:59:21.885834 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.885817    2579 scope.go:117] "RemoveContainer" containerID="f1057cfc9703bea71d89f6db02ebd048d1a01c149608da9f273a80672238e674"
Jul 27 17:59:21.886104 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:59:21.886082    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1057cfc9703bea71d89f6db02ebd048d1a01c149608da9f273a80672238e674\": container with ID starting with f1057cfc9703bea71d89f6db02ebd048d1a01c149608da9f273a80672238e674 not found: ID does not exist" containerID="f1057cfc9703bea71d89f6db02ebd048d1a01c149608da9f273a80672238e674"
Jul 27 17:59:21.886206 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.886111    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1057cfc9703bea71d89f6db02ebd048d1a01c149608da9f273a80672238e674"} err="failed to get container status \"f1057cfc9703bea71d89f6db02ebd048d1a01c149608da9f273a80672238e674\": rpc error: code = NotFound desc = could not find container \"f1057cfc9703bea71d89f6db02ebd048d1a01c149608da9f273a80672238e674\": container with ID starting with f1057cfc9703bea71d89f6db02ebd048d1a01c149608da9f273a80672238e674 not found: ID does not exist"
Jul 27 17:59:21.886206 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.886129    2579 scope.go:117] "RemoveContainer" containerID="ebcf467abf14e2502e96a2eb11d7ca4bd208a5755176a372c24c6259fdb82503"
Jul 27 17:59:21.886586 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:59:21.886549    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebcf467abf14e2502e96a2eb11d7ca4bd208a5755176a372c24c6259fdb82503\": container with ID starting with ebcf467abf14e2502e96a2eb11d7ca4bd208a5755176a372c24c6259fdb82503 not found: ID does not exist" containerID="ebcf467abf14e2502e96a2eb11d7ca4bd208a5755176a372c24c6259fdb82503"
Jul 27 17:59:21.886730 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.886595    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebcf467abf14e2502e96a2eb11d7ca4bd208a5755176a372c24c6259fdb82503"} err="failed to get container status \"ebcf467abf14e2502e96a2eb11d7ca4bd208a5755176a372c24c6259fdb82503\": rpc error: code = NotFound desc = could not find container \"ebcf467abf14e2502e96a2eb11d7ca4bd208a5755176a372c24c6259fdb82503\": container with ID starting with ebcf467abf14e2502e96a2eb11d7ca4bd208a5755176a372c24c6259fdb82503 not found: ID does not exist"
Jul 27 17:59:21.888527 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.888504    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"]
Jul 27 17:59:21.891724 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:21.891701    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a155ed-openshift-default-6577567bf6-z4dls"]
Jul 27 17:59:22.992829 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:22.992798    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd8b62de-bfac-472a-bda0-6979e4d6383b" path="/var/lib/kubelet/pods/cd8b62de-bfac-472a-bda0-6979e4d6383b/volumes"
Jul 27 17:59:27.005002 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.004970    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"]
Jul 27 17:59:27.005496 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.005172    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v" podUID="54ab8281-d775-465d-938b-1c572ff1da8a" containerName="payload-processing" containerID="cri-o://6ac0e10b11b355c5b640d9c0f9c4399c53033127d3c33bddf100ecbc284d70fc" gracePeriod=30
Jul 27 17:59:27.283623 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.283598    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"
Jul 27 17:59:27.382353 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.382320    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vp9z\" (UniqueName: \"kubernetes.io/projected/54ab8281-d775-465d-938b-1c572ff1da8a-kube-api-access-7vp9z\") pod \"54ab8281-d775-465d-938b-1c572ff1da8a\" (UID: \"54ab8281-d775-465d-938b-1c572ff1da8a\") "
Jul 27 17:59:27.382577 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.382385    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54ab8281-d775-465d-938b-1c572ff1da8a-plugins-config-volume\") pod \"54ab8281-d775-465d-938b-1c572ff1da8a\" (UID: \"54ab8281-d775-465d-938b-1c572ff1da8a\") "
Jul 27 17:59:27.382792 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.382772    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54ab8281-d775-465d-938b-1c572ff1da8a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "54ab8281-d775-465d-938b-1c572ff1da8a" (UID: "54ab8281-d775-465d-938b-1c572ff1da8a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:59:27.384712 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.384690    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54ab8281-d775-465d-938b-1c572ff1da8a-kube-api-access-7vp9z" (OuterVolumeSpecName: "kube-api-access-7vp9z") pod "54ab8281-d775-465d-938b-1c572ff1da8a" (UID: "54ab8281-d775-465d-938b-1c572ff1da8a"). InnerVolumeSpecName "kube-api-access-7vp9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:59:27.483851 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.483817    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vp9z\" (UniqueName: \"kubernetes.io/projected/54ab8281-d775-465d-938b-1c572ff1da8a-kube-api-access-7vp9z\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:27.483851 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.483846    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54ab8281-d775-465d-938b-1c572ff1da8a-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:27.907729 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.907691    2579 generic.go:356] "Generic (PLEG): container finished" podID="54ab8281-d775-465d-938b-1c572ff1da8a" containerID="6ac0e10b11b355c5b640d9c0f9c4399c53033127d3c33bddf100ecbc284d70fc" exitCode=0
Jul 27 17:59:27.907930 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.907754    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"
Jul 27 17:59:27.907930 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.907757    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v" event={"ID":"54ab8281-d775-465d-938b-1c572ff1da8a","Type":"ContainerDied","Data":"6ac0e10b11b355c5b640d9c0f9c4399c53033127d3c33bddf100ecbc284d70fc"}
Jul 27 17:59:27.908049 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.907928    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v" event={"ID":"54ab8281-d775-465d-938b-1c572ff1da8a","Type":"ContainerDied","Data":"22f69b747dd59a7ec30f482b50a978cdb54badb7aec2d1c5dfbe04821696bdb4"}
Jul 27 17:59:27.908049 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.907966    2579 scope.go:117] "RemoveContainer" containerID="6ac0e10b11b355c5b640d9c0f9c4399c53033127d3c33bddf100ecbc284d70fc"
Jul 27 17:59:27.917552 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.917535    2579 scope.go:117] "RemoveContainer" containerID="6ac0e10b11b355c5b640d9c0f9c4399c53033127d3c33bddf100ecbc284d70fc"
Jul 27 17:59:27.917850 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:59:27.917795    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ac0e10b11b355c5b640d9c0f9c4399c53033127d3c33bddf100ecbc284d70fc\": container with ID starting with 6ac0e10b11b355c5b640d9c0f9c4399c53033127d3c33bddf100ecbc284d70fc not found: ID does not exist" containerID="6ac0e10b11b355c5b640d9c0f9c4399c53033127d3c33bddf100ecbc284d70fc"
Jul 27 17:59:27.917948 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.917875    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ac0e10b11b355c5b640d9c0f9c4399c53033127d3c33bddf100ecbc284d70fc"} err="failed to get container status \"6ac0e10b11b355c5b640d9c0f9c4399c53033127d3c33bddf100ecbc284d70fc\": rpc error: code = NotFound desc = could not find container \"6ac0e10b11b355c5b640d9c0f9c4399c53033127d3c33bddf100ecbc284d70fc\": container with ID starting with 6ac0e10b11b355c5b640d9c0f9c4399c53033127d3c33bddf100ecbc284d70fc not found: ID does not exist"
Jul 27 17:59:27.929962 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.929936    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"]
Jul 27 17:59:27.932650 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:27.932631    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-ab2501-55d8787998-7rj4v"]
Jul 27 17:59:28.993515 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:28.993485    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54ab8281-d775-465d-938b-1c572ff1da8a" path="/var/lib/kubelet/pods/54ab8281-d775-465d-938b-1c572ff1da8a/volumes"
Jul 27 17:59:38.096737 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:38.096704    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"]
Jul 27 17:59:38.097200 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:38.096936    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9" podUID="869a2145-4043-42b5-ab8d-6e453ab383a4" containerName="istio-proxy" containerID="cri-o://4c8a3dfd1ddc0ceb6d9b4c56370493c169c9e5db4568e8c41abafaeb1ca59b8f" gracePeriod=30
Jul 27 17:59:43.351249 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.351219    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:59:43.425784 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.425689    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-workload-socket\") pod \"869a2145-4043-42b5-ab8d-6e453ab383a4\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") "
Jul 27 17:59:43.425784 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.425734    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scckw\" (UniqueName: \"kubernetes.io/projected/869a2145-4043-42b5-ab8d-6e453ab383a4-kube-api-access-scckw\") pod \"869a2145-4043-42b5-ab8d-6e453ab383a4\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") "
Jul 27 17:59:43.425784 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.425773    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-workload-certs\") pod \"869a2145-4043-42b5-ab8d-6e453ab383a4\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") "
Jul 27 17:59:43.426071 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.425800    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-podinfo\") pod \"869a2145-4043-42b5-ab8d-6e453ab383a4\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") "
Jul 27 17:59:43.426071 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.425857    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/869a2145-4043-42b5-ab8d-6e453ab383a4-istiod-ca-cert\") pod \"869a2145-4043-42b5-ab8d-6e453ab383a4\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") "
Jul 27 17:59:43.426071 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.425898    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-token\") pod \"869a2145-4043-42b5-ab8d-6e453ab383a4\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") "
Jul 27 17:59:43.426071 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.425921    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-data\") pod \"869a2145-4043-42b5-ab8d-6e453ab383a4\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") "
Jul 27 17:59:43.426071 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.425943    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-envoy\") pod \"869a2145-4043-42b5-ab8d-6e453ab383a4\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") "
Jul 27 17:59:43.426071 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.425988    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-credential-socket\") pod \"869a2145-4043-42b5-ab8d-6e453ab383a4\" (UID: \"869a2145-4043-42b5-ab8d-6e453ab383a4\") "
Jul 27 17:59:43.426384 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.426112    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "869a2145-4043-42b5-ab8d-6e453ab383a4" (UID: "869a2145-4043-42b5-ab8d-6e453ab383a4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:59:43.426384 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.426308    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-workload-certs\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:43.426384 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.426362    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "869a2145-4043-42b5-ab8d-6e453ab383a4" (UID: "869a2145-4043-42b5-ab8d-6e453ab383a4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:59:43.426582 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.426433    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/869a2145-4043-42b5-ab8d-6e453ab383a4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "869a2145-4043-42b5-ab8d-6e453ab383a4" (UID: "869a2145-4043-42b5-ab8d-6e453ab383a4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 17:59:43.426958 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.426904    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-data" (OuterVolumeSpecName: "istio-data") pod "869a2145-4043-42b5-ab8d-6e453ab383a4" (UID: "869a2145-4043-42b5-ab8d-6e453ab383a4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:59:43.427162 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.427134    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "869a2145-4043-42b5-ab8d-6e453ab383a4" (UID: "869a2145-4043-42b5-ab8d-6e453ab383a4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:59:43.428650 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.428626    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "869a2145-4043-42b5-ab8d-6e453ab383a4" (UID: "869a2145-4043-42b5-ab8d-6e453ab383a4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 17:59:43.428754 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.428652    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-token" (OuterVolumeSpecName: "istio-token") pod "869a2145-4043-42b5-ab8d-6e453ab383a4" (UID: "869a2145-4043-42b5-ab8d-6e453ab383a4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:59:43.428824 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.428814    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "869a2145-4043-42b5-ab8d-6e453ab383a4" (UID: "869a2145-4043-42b5-ab8d-6e453ab383a4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 17:59:43.428882 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.428832    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/869a2145-4043-42b5-ab8d-6e453ab383a4-kube-api-access-scckw" (OuterVolumeSpecName: "kube-api-access-scckw") pod "869a2145-4043-42b5-ab8d-6e453ab383a4" (UID: "869a2145-4043-42b5-ab8d-6e453ab383a4"). InnerVolumeSpecName "kube-api-access-scckw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 17:59:43.527283 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.527246    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-podinfo\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:43.527283 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.527276    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/869a2145-4043-42b5-ab8d-6e453ab383a4-istiod-ca-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:43.527283 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.527285    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-token\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:43.527283 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.527293    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-data\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:43.527573 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.527301    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-istio-envoy\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:43.527573 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.527309    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-credential-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:43.527573 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.527317    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/869a2145-4043-42b5-ab8d-6e453ab383a4-workload-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:43.527573 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:43.527327    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scckw\" (UniqueName: \"kubernetes.io/projected/869a2145-4043-42b5-ab8d-6e453ab383a4-kube-api-access-scckw\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 17:59:44.001404 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:44.001370    2579 generic.go:356] "Generic (PLEG): container finished" podID="869a2145-4043-42b5-ab8d-6e453ab383a4" containerID="4c8a3dfd1ddc0ceb6d9b4c56370493c169c9e5db4568e8c41abafaeb1ca59b8f" exitCode=0
Jul 27 17:59:44.001598 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:44.001407    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9" event={"ID":"869a2145-4043-42b5-ab8d-6e453ab383a4","Type":"ContainerDied","Data":"4c8a3dfd1ddc0ceb6d9b4c56370493c169c9e5db4568e8c41abafaeb1ca59b8f"}
Jul 27 17:59:44.001598 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:44.001492    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9" event={"ID":"869a2145-4043-42b5-ab8d-6e453ab383a4","Type":"ContainerDied","Data":"88cd1a6076b6e9f7692a1262f476538f0844757a9ceaadedef3942599ed4d7a8"}
Jul 27 17:59:44.001598 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:44.001514    2579 scope.go:117] "RemoveContainer" containerID="4c8a3dfd1ddc0ceb6d9b4c56370493c169c9e5db4568e8c41abafaeb1ca59b8f"
Jul 27 17:59:44.001598 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:44.001445    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"
Jul 27 17:59:44.011468 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:44.011410    2579 scope.go:117] "RemoveContainer" containerID="6f5658d84037b09c77a16a8dbc1c088c6d80e9bde4822e390d11d952e175592e"
Jul 27 17:59:44.019979 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:44.019959    2579 scope.go:117] "RemoveContainer" containerID="4c8a3dfd1ddc0ceb6d9b4c56370493c169c9e5db4568e8c41abafaeb1ca59b8f"
Jul 27 17:59:44.020258 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:59:44.020236    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c8a3dfd1ddc0ceb6d9b4c56370493c169c9e5db4568e8c41abafaeb1ca59b8f\": container with ID starting with 4c8a3dfd1ddc0ceb6d9b4c56370493c169c9e5db4568e8c41abafaeb1ca59b8f not found: ID does not exist" containerID="4c8a3dfd1ddc0ceb6d9b4c56370493c169c9e5db4568e8c41abafaeb1ca59b8f"
Jul 27 17:59:44.020301 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:44.020268    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8a3dfd1ddc0ceb6d9b4c56370493c169c9e5db4568e8c41abafaeb1ca59b8f"} err="failed to get container status \"4c8a3dfd1ddc0ceb6d9b4c56370493c169c9e5db4568e8c41abafaeb1ca59b8f\": rpc error: code = NotFound desc = could not find container \"4c8a3dfd1ddc0ceb6d9b4c56370493c169c9e5db4568e8c41abafaeb1ca59b8f\": container with ID starting with 4c8a3dfd1ddc0ceb6d9b4c56370493c169c9e5db4568e8c41abafaeb1ca59b8f not found: ID does not exist"
Jul 27 17:59:44.020301 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:44.020284    2579 scope.go:117] "RemoveContainer" containerID="6f5658d84037b09c77a16a8dbc1c088c6d80e9bde4822e390d11d952e175592e"
Jul 27 17:59:44.020536 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:59:44.020521    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f5658d84037b09c77a16a8dbc1c088c6d80e9bde4822e390d11d952e175592e\": container with ID starting with 6f5658d84037b09c77a16a8dbc1c088c6d80e9bde4822e390d11d952e175592e not found: ID does not exist" containerID="6f5658d84037b09c77a16a8dbc1c088c6d80e9bde4822e390d11d952e175592e"
Jul 27 17:59:44.020593 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:44.020538    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f5658d84037b09c77a16a8dbc1c088c6d80e9bde4822e390d11d952e175592e"} err="failed to get container status \"6f5658d84037b09c77a16a8dbc1c088c6d80e9bde4822e390d11d952e175592e\": rpc error: code = NotFound desc = could not find container \"6f5658d84037b09c77a16a8dbc1c088c6d80e9bde4822e390d11d952e175592e\": container with ID starting with 6f5658d84037b09c77a16a8dbc1c088c6d80e9bde4822e390d11d952e175592e not found: ID does not exist"
Jul 27 17:59:44.023652 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:44.023629    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"]
Jul 27 17:59:44.027349 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:44.027328    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-ab2501-openshift-default-86985cd97d-6vzw9"]
Jul 27 17:59:44.993237 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:44.993204    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="869a2145-4043-42b5-ab8d-6e453ab383a4" path="/var/lib/kubelet/pods/869a2145-4043-42b5-ab8d-6e453ab383a4/volumes"
Jul 27 17:59:51.567503 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.567470    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"]
Jul 27 17:59:51.568014 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.567951    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ab8281-d775-465d-938b-1c572ff1da8a" containerName="payload-processing"
Jul 27 17:59:51.568014 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.567965    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ab8281-d775-465d-938b-1c572ff1da8a" containerName="payload-processing"
Jul 27 17:59:51.568014 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.567982    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd8b62de-bfac-472a-bda0-6979e4d6383b" containerName="istio-proxy"
Jul 27 17:59:51.568014 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.567991    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd8b62de-bfac-472a-bda0-6979e4d6383b" containerName="istio-proxy"
Jul 27 17:59:51.568014 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.568006    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a751ba99-2f24-45ff-91db-8ce83553e9b2" containerName="revoke-keys"
Jul 27 17:59:51.568014 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.568014    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a751ba99-2f24-45ff-91db-8ce83553e9b2" containerName="revoke-keys"
Jul 27 17:59:51.568391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.568030    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="869a2145-4043-42b5-ab8d-6e453ab383a4" containerName="istio-proxy"
Jul 27 17:59:51.568391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.568038    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="869a2145-4043-42b5-ab8d-6e453ab383a4" containerName="istio-proxy"
Jul 27 17:59:51.568391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.568048    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="869a2145-4043-42b5-ab8d-6e453ab383a4" containerName="istio-proxy"
Jul 27 17:59:51.568391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.568056    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="869a2145-4043-42b5-ab8d-6e453ab383a4" containerName="istio-proxy"
Jul 27 17:59:51.568391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.568069    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd8b62de-bfac-472a-bda0-6979e4d6383b" containerName="istio-proxy"
Jul 27 17:59:51.568391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.568077    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd8b62de-bfac-472a-bda0-6979e4d6383b" containerName="istio-proxy"
Jul 27 17:59:51.568391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.568089    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca092ad7-6609-4b83-bc2c-bb62319b8f78" containerName="payload-pre-processing"
Jul 27 17:59:51.568391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.568098    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca092ad7-6609-4b83-bc2c-bb62319b8f78" containerName="payload-pre-processing"
Jul 27 17:59:51.568391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.568168    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="869a2145-4043-42b5-ab8d-6e453ab383a4" containerName="istio-proxy"
Jul 27 17:59:51.568391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.568179    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a751ba99-2f24-45ff-91db-8ce83553e9b2" containerName="revoke-keys"
Jul 27 17:59:51.568391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.568189    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca092ad7-6609-4b83-bc2c-bb62319b8f78" containerName="payload-pre-processing"
Jul 27 17:59:51.568391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.568197    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="54ab8281-d775-465d-938b-1c572ff1da8a" containerName="payload-processing"
Jul 27 17:59:51.568391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.568207    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd8b62de-bfac-472a-bda0-6979e4d6383b" containerName="istio-proxy"
Jul 27 17:59:51.568391 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.568214    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd8b62de-bfac-472a-bda0-6979e4d6383b" containerName="istio-proxy"
Jul 27 17:59:51.572901 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.572874    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"
Jul 27 17:59:51.575048 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.575024    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-617fa4-serving-cert\""
Jul 27 17:59:51.575455 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.575411    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qxgf2\""
Jul 27 17:59:51.581359 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.581332    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"]
Jul 27 17:59:51.695629 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.695590    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/606492dd-0262-4b65-a789-81b7f6c29782-openshift-service-ca\") pod \"maas-api-e2e-api-a-617fa4-686b476684-d2p4q\" (UID: \"606492dd-0262-4b65-a789-81b7f6c29782\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"
Jul 27 17:59:51.695800 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.695655    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/606492dd-0262-4b65-a789-81b7f6c29782-maas-api-tls\") pod \"maas-api-e2e-api-a-617fa4-686b476684-d2p4q\" (UID: \"606492dd-0262-4b65-a789-81b7f6c29782\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"
Jul 27 17:59:51.695800 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.695707    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zkfk\" (UniqueName: \"kubernetes.io/projected/606492dd-0262-4b65-a789-81b7f6c29782-kube-api-access-7zkfk\") pod \"maas-api-e2e-api-a-617fa4-686b476684-d2p4q\" (UID: \"606492dd-0262-4b65-a789-81b7f6c29782\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"
Jul 27 17:59:51.797062 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.797023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/606492dd-0262-4b65-a789-81b7f6c29782-maas-api-tls\") pod \"maas-api-e2e-api-a-617fa4-686b476684-d2p4q\" (UID: \"606492dd-0262-4b65-a789-81b7f6c29782\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"
Jul 27 17:59:51.797062 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.797065    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zkfk\" (UniqueName: \"kubernetes.io/projected/606492dd-0262-4b65-a789-81b7f6c29782-kube-api-access-7zkfk\") pod \"maas-api-e2e-api-a-617fa4-686b476684-d2p4q\" (UID: \"606492dd-0262-4b65-a789-81b7f6c29782\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"
Jul 27 17:59:51.797313 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.797147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/606492dd-0262-4b65-a789-81b7f6c29782-openshift-service-ca\") pod \"maas-api-e2e-api-a-617fa4-686b476684-d2p4q\" (UID: \"606492dd-0262-4b65-a789-81b7f6c29782\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"
Jul 27 17:59:51.797313 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:59:51.797186    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-serving-cert: secret "maas-api-e2e-api-a-617fa4-serving-cert" not found
Jul 27 17:59:51.797313 ip-10-0-128-74 kubenswrapper[2579]: E0727 17:59:51.797278    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/606492dd-0262-4b65-a789-81b7f6c29782-maas-api-tls podName:606492dd-0262-4b65-a789-81b7f6c29782 nodeName:}" failed. No retries permitted until 2026-07-27 17:59:52.2972568 +0000 UTC m=+2335.829007765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/606492dd-0262-4b65-a789-81b7f6c29782-maas-api-tls") pod "maas-api-e2e-api-a-617fa4-686b476684-d2p4q" (UID: "606492dd-0262-4b65-a789-81b7f6c29782") : secret "maas-api-e2e-api-a-617fa4-serving-cert" not found
Jul 27 17:59:51.797884 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.797861    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/606492dd-0262-4b65-a789-81b7f6c29782-openshift-service-ca\") pod \"maas-api-e2e-api-a-617fa4-686b476684-d2p4q\" (UID: \"606492dd-0262-4b65-a789-81b7f6c29782\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"
Jul 27 17:59:51.805353 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:51.805329    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zkfk\" (UniqueName: \"kubernetes.io/projected/606492dd-0262-4b65-a789-81b7f6c29782-kube-api-access-7zkfk\") pod \"maas-api-e2e-api-a-617fa4-686b476684-d2p4q\" (UID: \"606492dd-0262-4b65-a789-81b7f6c29782\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"
Jul 27 17:59:52.254100 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.254068    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"]
Jul 27 17:59:52.254520 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.254506    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="869a2145-4043-42b5-ab8d-6e453ab383a4" containerName="istio-proxy"
Jul 27 17:59:52.257330 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.257310    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"
Jul 27 17:59:52.259971 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.259950    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-617fa4\""
Jul 27 17:59:52.260077 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.259952    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-617fa4-dockercfg-m65bq\""
Jul 27 17:59:52.266589 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.266569    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"]
Jul 27 17:59:52.280247 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.280222    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"]
Jul 27 17:59:52.283973 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.283953    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"
Jul 27 17:59:52.294577 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.294556    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"]
Jul 27 17:59:52.302685 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.302663    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/606492dd-0262-4b65-a789-81b7f6c29782-maas-api-tls\") pod \"maas-api-e2e-api-a-617fa4-686b476684-d2p4q\" (UID: \"606492dd-0262-4b65-a789-81b7f6c29782\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"
Jul 27 17:59:52.302781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.302716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a94a06b4-89cd-4d8d-bdf7-5a7365423727-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478\" (UID: \"a94a06b4-89cd-4d8d-bdf7-5a7365423727\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"
Jul 27 17:59:52.302781 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.302752    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gbvc\" (UniqueName: \"kubernetes.io/projected/a94a06b4-89cd-4d8d-bdf7-5a7365423727-kube-api-access-8gbvc\") pod \"payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478\" (UID: \"a94a06b4-89cd-4d8d-bdf7-5a7365423727\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"
Jul 27 17:59:52.305504 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.305477    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/606492dd-0262-4b65-a789-81b7f6c29782-maas-api-tls\") pod \"maas-api-e2e-api-a-617fa4-686b476684-d2p4q\" (UID: \"606492dd-0262-4b65-a789-81b7f6c29782\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"
Jul 27 17:59:52.404148 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.404111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a94a06b4-89cd-4d8d-bdf7-5a7365423727-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478\" (UID: \"a94a06b4-89cd-4d8d-bdf7-5a7365423727\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"
Jul 27 17:59:52.404347 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.404157    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gbvc\" (UniqueName: \"kubernetes.io/projected/a94a06b4-89cd-4d8d-bdf7-5a7365423727-kube-api-access-8gbvc\") pod \"payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478\" (UID: \"a94a06b4-89cd-4d8d-bdf7-5a7365423727\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"
Jul 27 17:59:52.404347 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.404185    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8pt5\" (UniqueName: \"kubernetes.io/projected/a1a037f6-5d47-4408-8b64-1517bc03eab8-kube-api-access-j8pt5\") pod \"payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb\" (UID: \"a1a037f6-5d47-4408-8b64-1517bc03eab8\") " pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"
Jul 27 17:59:52.404347 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.404234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1a037f6-5d47-4408-8b64-1517bc03eab8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb\" (UID: \"a1a037f6-5d47-4408-8b64-1517bc03eab8\") " pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"
Jul 27 17:59:52.404937 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.404913    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a94a06b4-89cd-4d8d-bdf7-5a7365423727-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478\" (UID: \"a94a06b4-89cd-4d8d-bdf7-5a7365423727\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"
Jul 27 17:59:52.412328 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.412298    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gbvc\" (UniqueName: \"kubernetes.io/projected/a94a06b4-89cd-4d8d-bdf7-5a7365423727-kube-api-access-8gbvc\") pod \"payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478\" (UID: \"a94a06b4-89cd-4d8d-bdf7-5a7365423727\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"
Jul 27 17:59:52.485583 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.485549    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"
Jul 27 17:59:52.505225 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.505153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8pt5\" (UniqueName: \"kubernetes.io/projected/a1a037f6-5d47-4408-8b64-1517bc03eab8-kube-api-access-j8pt5\") pod \"payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb\" (UID: \"a1a037f6-5d47-4408-8b64-1517bc03eab8\") " pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"
Jul 27 17:59:52.505341 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.505254    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1a037f6-5d47-4408-8b64-1517bc03eab8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb\" (UID: \"a1a037f6-5d47-4408-8b64-1517bc03eab8\") " pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"
Jul 27 17:59:52.506141 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.506089    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1a037f6-5d47-4408-8b64-1517bc03eab8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb\" (UID: \"a1a037f6-5d47-4408-8b64-1517bc03eab8\") " pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"
Jul 27 17:59:52.512661 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.512631    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8pt5\" (UniqueName: \"kubernetes.io/projected/a1a037f6-5d47-4408-8b64-1517bc03eab8-kube-api-access-j8pt5\") pod \"payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb\" (UID: \"a1a037f6-5d47-4408-8b64-1517bc03eab8\") " pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"
Jul 27 17:59:52.569656 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.569563    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"
Jul 27 17:59:52.593745 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.593715    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"
Jul 27 17:59:52.634816 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.634711    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"]
Jul 27 17:59:52.637109 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:59:52.637066    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod606492dd_0262_4b65_a789_81b7f6c29782.slice/crio-c100e41580c516ba407f0d1cbe6d492cf6c5f14334ce8818785a075c421dc553 WatchSource:0}: Error finding container c100e41580c516ba407f0d1cbe6d492cf6c5f14334ce8818785a075c421dc553: Status 404 returned error can't find the container with id c100e41580c516ba407f0d1cbe6d492cf6c5f14334ce8818785a075c421dc553
Jul 27 17:59:52.638455 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.638401    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 17:59:52.933550 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.933521    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"]
Jul 27 17:59:52.935169 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:59:52.935127    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda94a06b4_89cd_4d8d_bdf7_5a7365423727.slice/crio-741b90355e45099422a45be74320d3524f54af73c344b66cb61b8e9f13431282 WatchSource:0}: Error finding container 741b90355e45099422a45be74320d3524f54af73c344b66cb61b8e9f13431282: Status 404 returned error can't find the container with id 741b90355e45099422a45be74320d3524f54af73c344b66cb61b8e9f13431282
Jul 27 17:59:52.973109 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:52.973081    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"]
Jul 27 17:59:52.978621 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:59:52.978594    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a037f6_5d47_4408_8b64_1517bc03eab8.slice/crio-c83e73b39fcb2faeeeadeb1673b9a4c18d197d2c09c4efe94ddd98f091e05b29 WatchSource:0}: Error finding container c83e73b39fcb2faeeeadeb1673b9a4c18d197d2c09c4efe94ddd98f091e05b29: Status 404 returned error can't find the container with id c83e73b39fcb2faeeeadeb1673b9a4c18d197d2c09c4efe94ddd98f091e05b29
Jul 27 17:59:53.055102 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:53.055063    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb" event={"ID":"a1a037f6-5d47-4408-8b64-1517bc03eab8","Type":"ContainerStarted","Data":"c83e73b39fcb2faeeeadeb1673b9a4c18d197d2c09c4efe94ddd98f091e05b29"}
Jul 27 17:59:53.056881 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:53.056847    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478" event={"ID":"a94a06b4-89cd-4d8d-bdf7-5a7365423727","Type":"ContainerStarted","Data":"4161ad6a38976116929607ba59c40366cbed0c0cc05aac2467b0b223f1c0684f"}
Jul 27 17:59:53.056996 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:53.056901    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478" event={"ID":"a94a06b4-89cd-4d8d-bdf7-5a7365423727","Type":"ContainerStarted","Data":"741b90355e45099422a45be74320d3524f54af73c344b66cb61b8e9f13431282"}
Jul 27 17:59:53.056996 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:53.056967    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"
Jul 27 17:59:53.058062 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:53.058043    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q" event={"ID":"606492dd-0262-4b65-a789-81b7f6c29782","Type":"ContainerStarted","Data":"c100e41580c516ba407f0d1cbe6d492cf6c5f14334ce8818785a075c421dc553"}
Jul 27 17:59:53.070755 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:53.070705    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478" podStartSLOduration=1.070686452 podStartE2EDuration="1.070686452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:59:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:59:53.069897394 +0000 UTC m=+2336.601648382" watchObservedRunningTime="2026-07-27 17:59:53.070686452 +0000 UTC m=+2336.602437440"
Jul 27 17:59:54.066442 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:54.066390    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb" event={"ID":"a1a037f6-5d47-4408-8b64-1517bc03eab8","Type":"ContainerStarted","Data":"21133aae4512e123d2256f33146dc78346dbe5f5fd03f3c8f54a86a4e8008a20"}
Jul 27 17:59:54.066878 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:54.066479    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"
Jul 27 17:59:54.083834 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:54.083784    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb" podStartSLOduration=2.083766021 podStartE2EDuration="2.083766021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:59:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:59:54.081158534 +0000 UTC m=+2337.612909521" watchObservedRunningTime="2026-07-27 17:59:54.083766021 +0000 UTC m=+2337.615517009"
Jul 27 17:59:55.073493 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:55.073371    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q" event={"ID":"606492dd-0262-4b65-a789-81b7f6c29782","Type":"ContainerStarted","Data":"c9e6ed01820def7867dcb9ae3756e99578d59de71c46874e61a64038852b9197"}
Jul 27 17:59:55.073493 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:55.073484    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"
Jul 27 17:59:55.088832 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:55.088788    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q" podStartSLOduration=1.917921698 podStartE2EDuration="4.088773502s" totalImagesPullingTime="2.170851804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:59:55.088123283 +0000 UTC m=+2338.619874271" watchObservedRunningTime="2026-07-27 17:59:55.088773502 +0000 UTC m=+2338.620524487"
Jul 27 17:59:56.561709 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.561679    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"]
Jul 27 17:59:56.565945 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.565922    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.567945 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.567923    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-0dcf85-openshift-default-dockercfg-shch4\""
Jul 27 17:59:56.576877 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.576855    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"]
Jul 27 17:59:56.646894 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.646855    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-workload-certs\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.647091 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.646917    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-envoy\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.647091 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.646944    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-data\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.647091 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.646978    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istiod-ca-cert\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.647091 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.647020    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-token\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.647091 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.647085    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-credential-socket\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.647306 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.647139    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8j68\" (UniqueName: \"kubernetes.io/projected/2d68ba5b-34c4-4895-94ac-9a5b2407335c-kube-api-access-c8j68\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.647306 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.647170    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-podinfo\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.647306 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.647202    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-workload-socket\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.748145 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.748105    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-token\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.748348 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.748150    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-credential-socket\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.748348 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.748199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8j68\" (UniqueName: \"kubernetes.io/projected/2d68ba5b-34c4-4895-94ac-9a5b2407335c-kube-api-access-c8j68\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.748348 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.748222    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-podinfo\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.748348 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.748249    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-workload-socket\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.748348 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.748305    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-workload-certs\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.748348 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.748342    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-envoy\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.748698 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.748364    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-data\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.748698 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.748399    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istiod-ca-cert\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.748698 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.748653    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-credential-socket\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.748850 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.748706    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-workload-socket\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.748850 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.748790    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-workload-certs\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.748968 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.748856    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-data\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.749184 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.749161    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istiod-ca-cert\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.750763 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.750744    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-envoy\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.750882 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.750864    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-podinfo\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.757556 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.757535    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-token\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.757689 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.757664    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8j68\" (UniqueName: \"kubernetes.io/projected/2d68ba5b-34c4-4895-94ac-9a5b2407335c-kube-api-access-c8j68\") pod \"e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") " pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:56.878118 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.878040    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-0dcf85-openshift-default-dockercfg-shch4\""
Jul 27 17:59:56.886653 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:56.886541    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:57.041499 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:57.041471    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"]
Jul 27 17:59:57.043508 ip-10-0-128-74 kubenswrapper[2579]: W0727 17:59:57.043483    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d68ba5b_34c4_4895_94ac_9a5b2407335c.slice/crio-ef7db2a8b114123c7411a9d96f6677844f383336be8b8aa54e6a360a58b0042c WatchSource:0}: Error finding container ef7db2a8b114123c7411a9d96f6677844f383336be8b8aa54e6a360a58b0042c: Status 404 returned error can't find the container with id ef7db2a8b114123c7411a9d96f6677844f383336be8b8aa54e6a360a58b0042c
Jul 27 17:59:57.045892 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:57.045864    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:59:57.045968 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:57.045929    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:59:57.045968 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:57.045956    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 17:59:57.086688 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:57.086661    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7" event={"ID":"2d68ba5b-34c4-4895-94ac-9a5b2407335c","Type":"ContainerStarted","Data":"ef7db2a8b114123c7411a9d96f6677844f383336be8b8aa54e6a360a58b0042c"}
Jul 27 17:59:58.093288 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:58.093253    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7" event={"ID":"2d68ba5b-34c4-4895-94ac-9a5b2407335c","Type":"ContainerStarted","Data":"8641c2083e04ad7430811f2c7a367f980eba9a2856710179175ef6f7e04a07e9"}
Jul 27 17:59:58.112945 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:58.112895    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7" podStartSLOduration=2.112878795 podStartE2EDuration="2.112878795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:59:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:59:58.110998884 +0000 UTC m=+2341.642749870" watchObservedRunningTime="2026-07-27 17:59:58.112878795 +0000 UTC m=+2341.644629780"
Jul 27 17:59:58.887169 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:58.887131    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:58.892553 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:58.892527    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:59.098667 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:59.098628    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 17:59:59.099517 ip-10-0-128-74 kubenswrapper[2579]: I0727 17:59:59.099497    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 18:00:01.086074 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.086047    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"
Jul 27 18:00:01.168626 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.168589    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"]
Jul 27 18:00:01.171976 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.171960    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"
Jul 27 18:00:01.173893 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.173875    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-0dcf85\""
Jul 27 18:00:01.173972 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.173937    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-0dcf85-dockercfg-jqxn4\""
Jul 27 18:00:01.185024 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.184989    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"]
Jul 27 18:00:01.249394 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.249351    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"]
Jul 27 18:00:01.253688 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.253647    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"
Jul 27 18:00:01.258691 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.258662    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"]
Jul 27 18:00:01.290729 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.290695    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fa63661-7bab-41e2-9621-e0d944a9050f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw\" (UID: \"0fa63661-7bab-41e2-9621-e0d944a9050f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"
Jul 27 18:00:01.290906 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.290756    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx5wq\" (UniqueName: \"kubernetes.io/projected/0fa63661-7bab-41e2-9621-e0d944a9050f-kube-api-access-xx5wq\") pod \"payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw\" (UID: \"0fa63661-7bab-41e2-9621-e0d944a9050f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"
Jul 27 18:00:01.392176 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.392100    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9wzj\" (UniqueName: \"kubernetes.io/projected/ca3084b1-8950-4833-b24f-d93f4845fa71-kube-api-access-d9wzj\") pod \"payload-processing-e2e-api-b-0dcf85-68444db678-92rh8\" (UID: \"ca3084b1-8950-4833-b24f-d93f4845fa71\") " pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"
Jul 27 18:00:01.392176 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.392149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx5wq\" (UniqueName: \"kubernetes.io/projected/0fa63661-7bab-41e2-9621-e0d944a9050f-kube-api-access-xx5wq\") pod \"payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw\" (UID: \"0fa63661-7bab-41e2-9621-e0d944a9050f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"
Jul 27 18:00:01.392356 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.392246    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca3084b1-8950-4833-b24f-d93f4845fa71-plugins-config-volume\") pod \"payload-processing-e2e-api-b-0dcf85-68444db678-92rh8\" (UID: \"ca3084b1-8950-4833-b24f-d93f4845fa71\") " pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"
Jul 27 18:00:01.392356 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.392305    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fa63661-7bab-41e2-9621-e0d944a9050f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw\" (UID: \"0fa63661-7bab-41e2-9621-e0d944a9050f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"
Jul 27 18:00:01.393046 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.393021    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fa63661-7bab-41e2-9621-e0d944a9050f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw\" (UID: \"0fa63661-7bab-41e2-9621-e0d944a9050f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"
Jul 27 18:00:01.402044 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.402020    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx5wq\" (UniqueName: \"kubernetes.io/projected/0fa63661-7bab-41e2-9621-e0d944a9050f-kube-api-access-xx5wq\") pod \"payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw\" (UID: \"0fa63661-7bab-41e2-9621-e0d944a9050f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"
Jul 27 18:00:01.490317 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.490278    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"
Jul 27 18:00:01.493534 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.493199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9wzj\" (UniqueName: \"kubernetes.io/projected/ca3084b1-8950-4833-b24f-d93f4845fa71-kube-api-access-d9wzj\") pod \"payload-processing-e2e-api-b-0dcf85-68444db678-92rh8\" (UID: \"ca3084b1-8950-4833-b24f-d93f4845fa71\") " pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"
Jul 27 18:00:01.493534 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.493267    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca3084b1-8950-4833-b24f-d93f4845fa71-plugins-config-volume\") pod \"payload-processing-e2e-api-b-0dcf85-68444db678-92rh8\" (UID: \"ca3084b1-8950-4833-b24f-d93f4845fa71\") " pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"
Jul 27 18:00:01.493867 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.493851    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca3084b1-8950-4833-b24f-d93f4845fa71-plugins-config-volume\") pod \"payload-processing-e2e-api-b-0dcf85-68444db678-92rh8\" (UID: \"ca3084b1-8950-4833-b24f-d93f4845fa71\") " pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"
Jul 27 18:00:01.500791 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.500768    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9wzj\" (UniqueName: \"kubernetes.io/projected/ca3084b1-8950-4833-b24f-d93f4845fa71-kube-api-access-d9wzj\") pod \"payload-processing-e2e-api-b-0dcf85-68444db678-92rh8\" (UID: \"ca3084b1-8950-4833-b24f-d93f4845fa71\") " pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"
Jul 27 18:00:01.566223 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.566150    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"
Jul 27 18:00:01.643233 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.642840    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"]
Jul 27 18:00:01.647989 ip-10-0-128-74 kubenswrapper[2579]: W0727 18:00:01.647949    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa63661_7bab_41e2_9621_e0d944a9050f.slice/crio-963b6bcfee44b8269b59e84346356c598862770791de10580ec9fe4b39573e70 WatchSource:0}: Error finding container 963b6bcfee44b8269b59e84346356c598862770791de10580ec9fe4b39573e70: Status 404 returned error can't find the container with id 963b6bcfee44b8269b59e84346356c598862770791de10580ec9fe4b39573e70
Jul 27 18:00:01.721671 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:01.721640    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"]
Jul 27 18:00:01.723943 ip-10-0-128-74 kubenswrapper[2579]: W0727 18:00:01.723919    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3084b1_8950_4833_b24f_d93f4845fa71.slice/crio-1011d092243ccb20076d2f6d0bb54588e391f8246aa57eeb98e7282c77f41142 WatchSource:0}: Error finding container 1011d092243ccb20076d2f6d0bb54588e391f8246aa57eeb98e7282c77f41142: Status 404 returned error can't find the container with id 1011d092243ccb20076d2f6d0bb54588e391f8246aa57eeb98e7282c77f41142
Jul 27 18:00:02.119820 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:02.119787    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8" event={"ID":"ca3084b1-8950-4833-b24f-d93f4845fa71","Type":"ContainerStarted","Data":"438f27083e8f46e3160f80586272fcd27392b1fb0db26e7e521d2a765b835b08"}
Jul 27 18:00:02.120260 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:02.119840    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8" event={"ID":"ca3084b1-8950-4833-b24f-d93f4845fa71","Type":"ContainerStarted","Data":"1011d092243ccb20076d2f6d0bb54588e391f8246aa57eeb98e7282c77f41142"}
Jul 27 18:00:02.120260 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:02.119903    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"
Jul 27 18:00:02.121538 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:02.121511    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw" event={"ID":"0fa63661-7bab-41e2-9621-e0d944a9050f","Type":"ContainerStarted","Data":"083552a4addf03761a4b5450c37a0a1aa53b328bfed3e15090f76ed13e5a197d"}
Jul 27 18:00:02.121680 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:02.121555    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw" event={"ID":"0fa63661-7bab-41e2-9621-e0d944a9050f","Type":"ContainerStarted","Data":"963b6bcfee44b8269b59e84346356c598862770791de10580ec9fe4b39573e70"}
Jul 27 18:00:02.121680 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:02.121638    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"
Jul 27 18:00:02.136023 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:02.135975    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8" podStartSLOduration=1.135959874 podStartE2EDuration="1.135959874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:00:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:00:02.133698441 +0000 UTC m=+2345.665449417" watchObservedRunningTime="2026-07-27 18:00:02.135959874 +0000 UTC m=+2345.667710859"
Jul 27 18:00:02.148515 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:02.148467    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw" podStartSLOduration=1.148450285 podStartE2EDuration="1.148450285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:00:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:00:02.146784685 +0000 UTC m=+2345.678535670" watchObservedRunningTime="2026-07-27 18:00:02.148450285 +0000 UTC m=+2345.680201275"
Jul 27 18:00:04.069111 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:04.069076    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"
Jul 27 18:00:05.076204 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:05.076176    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"
Jul 27 18:00:13.129314 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:13.129260    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"
Jul 27 18:00:13.129860 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:13.129365    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"
Jul 27 18:00:18.212966 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:18.212929    2579 generic.go:356] "Generic (PLEG): container finished" podID="2d68ba5b-34c4-4895-94ac-9a5b2407335c" containerID="8641c2083e04ad7430811f2c7a367f980eba9a2856710179175ef6f7e04a07e9" exitCode=0
Jul 27 18:00:18.213380 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:18.213002    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7" event={"ID":"2d68ba5b-34c4-4895-94ac-9a5b2407335c","Type":"ContainerDied","Data":"8641c2083e04ad7430811f2c7a367f980eba9a2856710179175ef6f7e04a07e9"}
Jul 27 18:00:18.213455 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:18.213409    2579 scope.go:117] "RemoveContainer" containerID="8641c2083e04ad7430811f2c7a367f980eba9a2856710179175ef6f7e04a07e9"
Jul 27 18:00:18.214513 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:18.214480    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:00:18.214582 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:18.214566    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:00:18.214625 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:18.214615    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:00:19.226280 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:19.225314    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7" event={"ID":"2d68ba5b-34c4-4895-94ac-9a5b2407335c","Type":"ContainerStarted","Data":"a77cadcdc4a630b58b56a9de7f8f9c9eb58b11897bb6aa6c5f091bed1222dcf7"}
Jul 27 18:00:19.887762 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:19.887720    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 18:00:19.887999 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:19.887975    2579 patch_prober.go:28] interesting pod/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Jul 27 18:00:19.888048 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:19.888031    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7" podUID="2d68ba5b-34c4-4895-94ac-9a5b2407335c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Jul 27 18:00:20.887138 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:20.887105    2579 patch_prober.go:28] interesting pod/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Jul 27 18:00:20.887544 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:20.887177    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7" podUID="2d68ba5b-34c4-4895-94ac-9a5b2407335c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Jul 27 18:00:21.887817 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:21.887781    2579 patch_prober.go:28] interesting pod/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Jul 27 18:00:21.888212 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:21.887834    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7" podUID="2d68ba5b-34c4-4895-94ac-9a5b2407335c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Jul 27 18:00:22.919595 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:22.919564    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 18:00:22.920107 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:22.919838    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 18:00:22.920683 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:22.920664    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 18:00:29.002649 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.002617    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"]
Jul 27 18:00:29.003100 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.002882    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q" podUID="606492dd-0262-4b65-a789-81b7f6c29782" containerName="maas-api" containerID="cri-o://c9e6ed01820def7867dcb9ae3756e99578d59de71c46874e61a64038852b9197" gracePeriod=30
Jul 27 18:00:29.068296 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.068245    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"]
Jul 27 18:00:29.068627 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.068577    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb" podUID="a1a037f6-5d47-4408-8b64-1517bc03eab8" containerName="payload-processing" containerID="cri-o://21133aae4512e123d2256f33146dc78346dbe5f5fd03f3c8f54a86a4e8008a20" gracePeriod=30
Jul 27 18:00:29.071850 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.071819    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"]
Jul 27 18:00:29.072097 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.072054    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478" podUID="a94a06b4-89cd-4d8d-bdf7-5a7365423727" containerName="payload-pre-processing" containerID="cri-o://4161ad6a38976116929607ba59c40366cbed0c0cc05aac2467b0b223f1c0684f" gracePeriod=30
Jul 27 18:00:29.289966 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.289919    2579 generic.go:356] "Generic (PLEG): container finished" podID="a1a037f6-5d47-4408-8b64-1517bc03eab8" containerID="21133aae4512e123d2256f33146dc78346dbe5f5fd03f3c8f54a86a4e8008a20" exitCode=0
Jul 27 18:00:29.290141 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.289992    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb" event={"ID":"a1a037f6-5d47-4408-8b64-1517bc03eab8","Type":"ContainerDied","Data":"21133aae4512e123d2256f33146dc78346dbe5f5fd03f3c8f54a86a4e8008a20"}
Jul 27 18:00:29.291786 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.291763    2579 generic.go:356] "Generic (PLEG): container finished" podID="a94a06b4-89cd-4d8d-bdf7-5a7365423727" containerID="4161ad6a38976116929607ba59c40366cbed0c0cc05aac2467b0b223f1c0684f" exitCode=0
Jul 27 18:00:29.291920 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.291846    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478" event={"ID":"a94a06b4-89cd-4d8d-bdf7-5a7365423727","Type":"ContainerDied","Data":"4161ad6a38976116929607ba59c40366cbed0c0cc05aac2467b0b223f1c0684f"}
Jul 27 18:00:29.293467 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.293445    2579 generic.go:356] "Generic (PLEG): container finished" podID="606492dd-0262-4b65-a789-81b7f6c29782" containerID="c9e6ed01820def7867dcb9ae3756e99578d59de71c46874e61a64038852b9197" exitCode=0
Jul 27 18:00:29.293573 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.293503    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q" event={"ID":"606492dd-0262-4b65-a789-81b7f6c29782","Type":"ContainerDied","Data":"c9e6ed01820def7867dcb9ae3756e99578d59de71c46874e61a64038852b9197"}
Jul 27 18:00:29.376921 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.376894    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"
Jul 27 18:00:29.385236 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.385211    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"
Jul 27 18:00:29.397149 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.397127    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"
Jul 27 18:00:29.438516 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.438487    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/606492dd-0262-4b65-a789-81b7f6c29782-maas-api-tls\") pod \"606492dd-0262-4b65-a789-81b7f6c29782\" (UID: \"606492dd-0262-4b65-a789-81b7f6c29782\") "
Jul 27 18:00:29.438516 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.438521    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gbvc\" (UniqueName: \"kubernetes.io/projected/a94a06b4-89cd-4d8d-bdf7-5a7365423727-kube-api-access-8gbvc\") pod \"a94a06b4-89cd-4d8d-bdf7-5a7365423727\" (UID: \"a94a06b4-89cd-4d8d-bdf7-5a7365423727\") "
Jul 27 18:00:29.438769 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.438545    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1a037f6-5d47-4408-8b64-1517bc03eab8-plugins-config-volume\") pod \"a1a037f6-5d47-4408-8b64-1517bc03eab8\" (UID: \"a1a037f6-5d47-4408-8b64-1517bc03eab8\") "
Jul 27 18:00:29.438769 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.438561    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8pt5\" (UniqueName: \"kubernetes.io/projected/a1a037f6-5d47-4408-8b64-1517bc03eab8-kube-api-access-j8pt5\") pod \"a1a037f6-5d47-4408-8b64-1517bc03eab8\" (UID: \"a1a037f6-5d47-4408-8b64-1517bc03eab8\") "
Jul 27 18:00:29.438769 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.438596    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/606492dd-0262-4b65-a789-81b7f6c29782-openshift-service-ca\") pod \"606492dd-0262-4b65-a789-81b7f6c29782\" (UID: \"606492dd-0262-4b65-a789-81b7f6c29782\") "
Jul 27 18:00:29.438769 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.438636    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zkfk\" (UniqueName: \"kubernetes.io/projected/606492dd-0262-4b65-a789-81b7f6c29782-kube-api-access-7zkfk\") pod \"606492dd-0262-4b65-a789-81b7f6c29782\" (UID: \"606492dd-0262-4b65-a789-81b7f6c29782\") "
Jul 27 18:00:29.438769 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.438677    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a94a06b4-89cd-4d8d-bdf7-5a7365423727-plugins-config-volume\") pod \"a94a06b4-89cd-4d8d-bdf7-5a7365423727\" (UID: \"a94a06b4-89cd-4d8d-bdf7-5a7365423727\") "
Jul 27 18:00:29.439040 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.438915    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1a037f6-5d47-4408-8b64-1517bc03eab8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a1a037f6-5d47-4408-8b64-1517bc03eab8" (UID: "a1a037f6-5d47-4408-8b64-1517bc03eab8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:00:29.439100 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.439038    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/606492dd-0262-4b65-a789-81b7f6c29782-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "606492dd-0262-4b65-a789-81b7f6c29782" (UID: "606492dd-0262-4b65-a789-81b7f6c29782"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:00:29.439247 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.439223    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a94a06b4-89cd-4d8d-bdf7-5a7365423727-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a94a06b4-89cd-4d8d-bdf7-5a7365423727" (UID: "a94a06b4-89cd-4d8d-bdf7-5a7365423727"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:00:29.440859 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.440839    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1a037f6-5d47-4408-8b64-1517bc03eab8-kube-api-access-j8pt5" (OuterVolumeSpecName: "kube-api-access-j8pt5") pod "a1a037f6-5d47-4408-8b64-1517bc03eab8" (UID: "a1a037f6-5d47-4408-8b64-1517bc03eab8"). InnerVolumeSpecName "kube-api-access-j8pt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:00:29.441229 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.441213    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a94a06b4-89cd-4d8d-bdf7-5a7365423727-kube-api-access-8gbvc" (OuterVolumeSpecName: "kube-api-access-8gbvc") pod "a94a06b4-89cd-4d8d-bdf7-5a7365423727" (UID: "a94a06b4-89cd-4d8d-bdf7-5a7365423727"). InnerVolumeSpecName "kube-api-access-8gbvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:00:29.441622 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.441593    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/606492dd-0262-4b65-a789-81b7f6c29782-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "606492dd-0262-4b65-a789-81b7f6c29782" (UID: "606492dd-0262-4b65-a789-81b7f6c29782"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:00:29.441622 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.441604    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/606492dd-0262-4b65-a789-81b7f6c29782-kube-api-access-7zkfk" (OuterVolumeSpecName: "kube-api-access-7zkfk") pod "606492dd-0262-4b65-a789-81b7f6c29782" (UID: "606492dd-0262-4b65-a789-81b7f6c29782"). InnerVolumeSpecName "kube-api-access-7zkfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:00:29.539320 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.539288    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/606492dd-0262-4b65-a789-81b7f6c29782-maas-api-tls\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:00:29.539320 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.539315    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gbvc\" (UniqueName: \"kubernetes.io/projected/a94a06b4-89cd-4d8d-bdf7-5a7365423727-kube-api-access-8gbvc\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:00:29.539320 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.539326    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1a037f6-5d47-4408-8b64-1517bc03eab8-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:00:29.539580 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.539336    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8pt5\" (UniqueName: \"kubernetes.io/projected/a1a037f6-5d47-4408-8b64-1517bc03eab8-kube-api-access-j8pt5\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:00:29.539580 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.539345    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/606492dd-0262-4b65-a789-81b7f6c29782-openshift-service-ca\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:00:29.539580 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.539353    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zkfk\" (UniqueName: \"kubernetes.io/projected/606492dd-0262-4b65-a789-81b7f6c29782-kube-api-access-7zkfk\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:00:29.539580 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:29.539361    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a94a06b4-89cd-4d8d-bdf7-5a7365423727-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:00:30.301171 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.301145    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"
Jul 27 18:00:30.301171 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.301153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478" event={"ID":"a94a06b4-89cd-4d8d-bdf7-5a7365423727","Type":"ContainerDied","Data":"741b90355e45099422a45be74320d3524f54af73c344b66cb61b8e9f13431282"}
Jul 27 18:00:30.301720 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.301218    2579 scope.go:117] "RemoveContainer" containerID="4161ad6a38976116929607ba59c40366cbed0c0cc05aac2467b0b223f1c0684f"
Jul 27 18:00:30.302545 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.302528    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"
Jul 27 18:00:30.302630 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.302561    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q" event={"ID":"606492dd-0262-4b65-a789-81b7f6c29782","Type":"ContainerDied","Data":"c100e41580c516ba407f0d1cbe6d492cf6c5f14334ce8818785a075c421dc553"}
Jul 27 18:00:30.304289 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.304270    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"
Jul 27 18:00:30.304451 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.304265    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb" event={"ID":"a1a037f6-5d47-4408-8b64-1517bc03eab8","Type":"ContainerDied","Data":"c83e73b39fcb2faeeeadeb1673b9a4c18d197d2c09c4efe94ddd98f091e05b29"}
Jul 27 18:00:30.313710 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.313630    2579 scope.go:117] "RemoveContainer" containerID="c9e6ed01820def7867dcb9ae3756e99578d59de71c46874e61a64038852b9197"
Jul 27 18:00:30.322641 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.322625    2579 scope.go:117] "RemoveContainer" containerID="21133aae4512e123d2256f33146dc78346dbe5f5fd03f3c8f54a86a4e8008a20"
Jul 27 18:00:30.328947 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.328924    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"]
Jul 27 18:00:30.333409 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.333389    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-617fa4-5f6449b94d-86478"]
Jul 27 18:00:30.341774 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.341752    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"]
Jul 27 18:00:30.343910 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.343884    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-617fa4-686b476684-d2p4q"]
Jul 27 18:00:30.355205 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.355170    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"]
Jul 27 18:00:30.359022 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.359001    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-617fa4-86cbc59b6b-gjhlb"]
Jul 27 18:00:30.992925 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.992891    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="606492dd-0262-4b65-a789-81b7f6c29782" path="/var/lib/kubelet/pods/606492dd-0262-4b65-a789-81b7f6c29782/volumes"
Jul 27 18:00:30.993250 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.993238    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1a037f6-5d47-4408-8b64-1517bc03eab8" path="/var/lib/kubelet/pods/a1a037f6-5d47-4408-8b64-1517bc03eab8/volumes"
Jul 27 18:00:30.993556 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:30.993545    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a94a06b4-89cd-4d8d-bdf7-5a7365423727" path="/var/lib/kubelet/pods/a94a06b4-89cd-4d8d-bdf7-5a7365423727/volumes"
Jul 27 18:00:54.946061 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:54.946027    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"]
Jul 27 18:00:54.946636 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:54.946287    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8" podUID="ca3084b1-8950-4833-b24f-d93f4845fa71" containerName="payload-processing" containerID="cri-o://438f27083e8f46e3160f80586272fcd27392b1fb0db26e7e521d2a765b835b08" gracePeriod=30
Jul 27 18:00:54.954298 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:54.954267    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"]
Jul 27 18:00:54.955670 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:54.954549    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw" podUID="0fa63661-7bab-41e2-9621-e0d944a9050f" containerName="payload-pre-processing" containerID="cri-o://083552a4addf03761a4b5450c37a0a1aa53b328bfed3e15090f76ed13e5a197d" gracePeriod=30
Jul 27 18:00:55.212186 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.212115    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"
Jul 27 18:00:55.240071 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.240048    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"
Jul 27 18:00:55.275727 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.275701    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca3084b1-8950-4833-b24f-d93f4845fa71-plugins-config-volume\") pod \"ca3084b1-8950-4833-b24f-d93f4845fa71\" (UID: \"ca3084b1-8950-4833-b24f-d93f4845fa71\") "
Jul 27 18:00:55.275870 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.275758    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9wzj\" (UniqueName: \"kubernetes.io/projected/ca3084b1-8950-4833-b24f-d93f4845fa71-kube-api-access-d9wzj\") pod \"ca3084b1-8950-4833-b24f-d93f4845fa71\" (UID: \"ca3084b1-8950-4833-b24f-d93f4845fa71\") "
Jul 27 18:00:55.276144 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.276118    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3084b1-8950-4833-b24f-d93f4845fa71-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ca3084b1-8950-4833-b24f-d93f4845fa71" (UID: "ca3084b1-8950-4833-b24f-d93f4845fa71"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:00:55.278013 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.277992    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca3084b1-8950-4833-b24f-d93f4845fa71-kube-api-access-d9wzj" (OuterVolumeSpecName: "kube-api-access-d9wzj") pod "ca3084b1-8950-4833-b24f-d93f4845fa71" (UID: "ca3084b1-8950-4833-b24f-d93f4845fa71"). InnerVolumeSpecName "kube-api-access-d9wzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:00:55.376846 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.376812    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fa63661-7bab-41e2-9621-e0d944a9050f-plugins-config-volume\") pod \"0fa63661-7bab-41e2-9621-e0d944a9050f\" (UID: \"0fa63661-7bab-41e2-9621-e0d944a9050f\") "
Jul 27 18:00:55.377001 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.376853    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx5wq\" (UniqueName: \"kubernetes.io/projected/0fa63661-7bab-41e2-9621-e0d944a9050f-kube-api-access-xx5wq\") pod \"0fa63661-7bab-41e2-9621-e0d944a9050f\" (UID: \"0fa63661-7bab-41e2-9621-e0d944a9050f\") "
Jul 27 18:00:55.377043 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.377031    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9wzj\" (UniqueName: \"kubernetes.io/projected/ca3084b1-8950-4833-b24f-d93f4845fa71-kube-api-access-d9wzj\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:00:55.377084 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.377041    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca3084b1-8950-4833-b24f-d93f4845fa71-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:00:55.377230 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.377204    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fa63661-7bab-41e2-9621-e0d944a9050f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0fa63661-7bab-41e2-9621-e0d944a9050f" (UID: "0fa63661-7bab-41e2-9621-e0d944a9050f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:00:55.379004 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.378985    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fa63661-7bab-41e2-9621-e0d944a9050f-kube-api-access-xx5wq" (OuterVolumeSpecName: "kube-api-access-xx5wq") pod "0fa63661-7bab-41e2-9621-e0d944a9050f" (UID: "0fa63661-7bab-41e2-9621-e0d944a9050f"). InnerVolumeSpecName "kube-api-access-xx5wq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:00:55.446216 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.446177    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca3084b1-8950-4833-b24f-d93f4845fa71" containerID="438f27083e8f46e3160f80586272fcd27392b1fb0db26e7e521d2a765b835b08" exitCode=0
Jul 27 18:00:55.446382 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.446223    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"
Jul 27 18:00:55.446382 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.446268    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8" event={"ID":"ca3084b1-8950-4833-b24f-d93f4845fa71","Type":"ContainerDied","Data":"438f27083e8f46e3160f80586272fcd27392b1fb0db26e7e521d2a765b835b08"}
Jul 27 18:00:55.446382 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.446316    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8" event={"ID":"ca3084b1-8950-4833-b24f-d93f4845fa71","Type":"ContainerDied","Data":"1011d092243ccb20076d2f6d0bb54588e391f8246aa57eeb98e7282c77f41142"}
Jul 27 18:00:55.446382 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.446338    2579 scope.go:117] "RemoveContainer" containerID="438f27083e8f46e3160f80586272fcd27392b1fb0db26e7e521d2a765b835b08"
Jul 27 18:00:55.447726 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.447671    2579 generic.go:356] "Generic (PLEG): container finished" podID="0fa63661-7bab-41e2-9621-e0d944a9050f" containerID="083552a4addf03761a4b5450c37a0a1aa53b328bfed3e15090f76ed13e5a197d" exitCode=0
Jul 27 18:00:55.447726 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.447699    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"
Jul 27 18:00:55.447852 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.447758    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw" event={"ID":"0fa63661-7bab-41e2-9621-e0d944a9050f","Type":"ContainerDied","Data":"083552a4addf03761a4b5450c37a0a1aa53b328bfed3e15090f76ed13e5a197d"}
Jul 27 18:00:55.447852 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.447805    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw" event={"ID":"0fa63661-7bab-41e2-9621-e0d944a9050f","Type":"ContainerDied","Data":"963b6bcfee44b8269b59e84346356c598862770791de10580ec9fe4b39573e70"}
Jul 27 18:00:55.456763 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.456744    2579 scope.go:117] "RemoveContainer" containerID="438f27083e8f46e3160f80586272fcd27392b1fb0db26e7e521d2a765b835b08"
Jul 27 18:00:55.457039 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:00:55.457018    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"438f27083e8f46e3160f80586272fcd27392b1fb0db26e7e521d2a765b835b08\": container with ID starting with 438f27083e8f46e3160f80586272fcd27392b1fb0db26e7e521d2a765b835b08 not found: ID does not exist" containerID="438f27083e8f46e3160f80586272fcd27392b1fb0db26e7e521d2a765b835b08"
Jul 27 18:00:55.457134 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.457046    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"438f27083e8f46e3160f80586272fcd27392b1fb0db26e7e521d2a765b835b08"} err="failed to get container status \"438f27083e8f46e3160f80586272fcd27392b1fb0db26e7e521d2a765b835b08\": rpc error: code = NotFound desc = could not find container \"438f27083e8f46e3160f80586272fcd27392b1fb0db26e7e521d2a765b835b08\": container with ID starting with 438f27083e8f46e3160f80586272fcd27392b1fb0db26e7e521d2a765b835b08 not found: ID does not exist"
Jul 27 18:00:55.457134 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.457065    2579 scope.go:117] "RemoveContainer" containerID="083552a4addf03761a4b5450c37a0a1aa53b328bfed3e15090f76ed13e5a197d"
Jul 27 18:00:55.465164 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.465131    2579 scope.go:117] "RemoveContainer" containerID="083552a4addf03761a4b5450c37a0a1aa53b328bfed3e15090f76ed13e5a197d"
Jul 27 18:00:55.465491 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:00:55.465465    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"083552a4addf03761a4b5450c37a0a1aa53b328bfed3e15090f76ed13e5a197d\": container with ID starting with 083552a4addf03761a4b5450c37a0a1aa53b328bfed3e15090f76ed13e5a197d not found: ID does not exist" containerID="083552a4addf03761a4b5450c37a0a1aa53b328bfed3e15090f76ed13e5a197d"
Jul 27 18:00:55.465600 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.465499    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"083552a4addf03761a4b5450c37a0a1aa53b328bfed3e15090f76ed13e5a197d"} err="failed to get container status \"083552a4addf03761a4b5450c37a0a1aa53b328bfed3e15090f76ed13e5a197d\": rpc error: code = NotFound desc = could not find container \"083552a4addf03761a4b5450c37a0a1aa53b328bfed3e15090f76ed13e5a197d\": container with ID starting with 083552a4addf03761a4b5450c37a0a1aa53b328bfed3e15090f76ed13e5a197d not found: ID does not exist"
Jul 27 18:00:55.468049 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.468028    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"]
Jul 27 18:00:55.471861 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.471837    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-0dcf85-68444db678-92rh8"]
Jul 27 18:00:55.478243 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.478226    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fa63661-7bab-41e2-9621-e0d944a9050f-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:00:55.478301 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.478246    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx5wq\" (UniqueName: \"kubernetes.io/projected/0fa63661-7bab-41e2-9621-e0d944a9050f-kube-api-access-xx5wq\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:00:55.481411 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.481391    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"]
Jul 27 18:00:55.484599 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:55.484577    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0dcf85-75dc7dc67b-ktzpw"]
Jul 27 18:00:56.993553 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:56.993520    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fa63661-7bab-41e2-9621-e0d944a9050f" path="/var/lib/kubelet/pods/0fa63661-7bab-41e2-9621-e0d944a9050f/volumes"
Jul 27 18:00:56.993912 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:00:56.993874    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca3084b1-8950-4833-b24f-d93f4845fa71" path="/var/lib/kubelet/pods/ca3084b1-8950-4833-b24f-d93f4845fa71/volumes"
Jul 27 18:01:06.004385 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:06.004351    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"]
Jul 27 18:01:06.004772 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:06.004625    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7" podUID="2d68ba5b-34c4-4895-94ac-9a5b2407335c" containerName="istio-proxy" containerID="cri-o://a77cadcdc4a630b58b56a9de7f8f9c9eb58b11897bb6aa6c5f091bed1222dcf7" gracePeriod=30
Jul 27 18:01:07.922376 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:07.922335    2579 patch_prober.go:28] interesting pod/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 18:01:07.922794 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:07.922436    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7" podUID="2d68ba5b-34c4-4895-94ac-9a5b2407335c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 18:01:10.095642 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.095608    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"]
Jul 27 18:01:10.096135 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.096116    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fa63661-7bab-41e2-9621-e0d944a9050f" containerName="payload-pre-processing"
Jul 27 18:01:10.096212 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.096138    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fa63661-7bab-41e2-9621-e0d944a9050f" containerName="payload-pre-processing"
Jul 27 18:01:10.096212 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.096164    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1a037f6-5d47-4408-8b64-1517bc03eab8" containerName="payload-processing"
Jul 27 18:01:10.096212 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.096173    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1a037f6-5d47-4408-8b64-1517bc03eab8" containerName="payload-processing"
Jul 27 18:01:10.096212 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.096187    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="606492dd-0262-4b65-a789-81b7f6c29782" containerName="maas-api"
Jul 27 18:01:10.096212 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.096196    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="606492dd-0262-4b65-a789-81b7f6c29782" containerName="maas-api"
Jul 27 18:01:10.096491 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.096216    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3084b1-8950-4833-b24f-d93f4845fa71" containerName="payload-processing"
Jul 27 18:01:10.096491 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.096224    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3084b1-8950-4833-b24f-d93f4845fa71" containerName="payload-processing"
Jul 27 18:01:10.096491 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.096238    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a94a06b4-89cd-4d8d-bdf7-5a7365423727" containerName="payload-pre-processing"
Jul 27 18:01:10.096491 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.096247    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a94a06b4-89cd-4d8d-bdf7-5a7365423727" containerName="payload-pre-processing"
Jul 27 18:01:10.096491 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.096329    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3084b1-8950-4833-b24f-d93f4845fa71" containerName="payload-processing"
Jul 27 18:01:10.096491 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.096342    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1a037f6-5d47-4408-8b64-1517bc03eab8" containerName="payload-processing"
Jul 27 18:01:10.096491 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.096353    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="606492dd-0262-4b65-a789-81b7f6c29782" containerName="maas-api"
Jul 27 18:01:10.096491 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.096363    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a94a06b4-89cd-4d8d-bdf7-5a7365423727" containerName="payload-pre-processing"
Jul 27 18:01:10.096491 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.096373    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fa63661-7bab-41e2-9621-e0d944a9050f" containerName="payload-pre-processing"
Jul 27 18:01:10.098530 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.098503    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"
Jul 27 18:01:10.100654 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.100631    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-1aa3ff-serving-cert\""
Jul 27 18:01:10.100777 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.100697    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qxgf2\""
Jul 27 18:01:10.110720 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.110698    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"]
Jul 27 18:01:10.206295 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.206253    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-maas-api-tls\") pod \"maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx\" (UID: \"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"
Jul 27 18:01:10.206532 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.206319    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx\" (UID: \"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"
Jul 27 18:01:10.206532 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.206354    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46gzj\" (UniqueName: \"kubernetes.io/projected/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-kube-api-access-46gzj\") pod \"maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx\" (UID: \"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"
Jul 27 18:01:10.307670 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.307630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46gzj\" (UniqueName: \"kubernetes.io/projected/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-kube-api-access-46gzj\") pod \"maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx\" (UID: \"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"
Jul 27 18:01:10.307851 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.307764    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-maas-api-tls\") pod \"maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx\" (UID: \"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"
Jul 27 18:01:10.307851 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.307803    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx\" (UID: \"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"
Jul 27 18:01:10.307941 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:01:10.307902    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-serving-cert: secret "maas-api-e2e-shared-a-1aa3ff-serving-cert" not found
Jul 27 18:01:10.307983 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:01:10.307976    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-maas-api-tls podName:f2b8a5b7-a11d-4a71-a5cb-2ffa08644085 nodeName:}" failed. No retries permitted until 2026-07-27 18:01:10.807954734 +0000 UTC m=+2414.339705698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-maas-api-tls") pod "maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx" (UID: "f2b8a5b7-a11d-4a71-a5cb-2ffa08644085") : secret "maas-api-e2e-shared-a-1aa3ff-serving-cert" not found
Jul 27 18:01:10.308537 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.308519    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx\" (UID: \"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"
Jul 27 18:01:10.322830 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.322803    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46gzj\" (UniqueName: \"kubernetes.io/projected/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-kube-api-access-46gzj\") pod \"maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx\" (UID: \"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"
Jul 27 18:01:10.781491 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.781457    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"]
Jul 27 18:01:10.784004 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.783982    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"
Jul 27 18:01:10.786073 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.786050    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-1aa3ff\""
Jul 27 18:01:10.786196 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.786114    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-1aa3ff-dockercfg-6sn4g\""
Jul 27 18:01:10.795844 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.795809    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"]
Jul 27 18:01:10.813828 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.813799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-maas-api-tls\") pod \"maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx\" (UID: \"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"
Jul 27 18:01:10.813998 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.813834    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxgvz\" (UniqueName: \"kubernetes.io/projected/e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d-kube-api-access-wxgvz\") pod \"payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv\" (UID: \"e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"
Jul 27 18:01:10.813998 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.813869    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv\" (UID: \"e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"
Jul 27 18:01:10.816370 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.816348    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-maas-api-tls\") pod \"maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx\" (UID: \"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"
Jul 27 18:01:10.914754 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.914717    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxgvz\" (UniqueName: \"kubernetes.io/projected/e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d-kube-api-access-wxgvz\") pod \"payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv\" (UID: \"e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"
Jul 27 18:01:10.914920 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.914775    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv\" (UID: \"e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"
Jul 27 18:01:10.915449 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.915411    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv\" (UID: \"e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"
Jul 27 18:01:10.923624 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:10.923600    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxgvz\" (UniqueName: \"kubernetes.io/projected/e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d-kube-api-access-wxgvz\") pod \"payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv\" (UID: \"e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"
Jul 27 18:01:11.014985 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.014929    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"
Jul 27 18:01:11.095779 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.095743    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"
Jul 27 18:01:11.167228 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.166918    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"]
Jul 27 18:01:11.271369 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.271346    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"]
Jul 27 18:01:11.273432 ip-10-0-128-74 kubenswrapper[2579]: W0727 18:01:11.273379    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30ae0ab_4bfe_4763_9f93_30f6a4bbed6d.slice/crio-43b122e9e6236cf6d9ac274126a31272fd998ff733f87af0e3aacb666b10279a WatchSource:0}: Error finding container 43b122e9e6236cf6d9ac274126a31272fd998ff733f87af0e3aacb666b10279a: Status 404 returned error can't find the container with id 43b122e9e6236cf6d9ac274126a31272fd998ff733f87af0e3aacb666b10279a
Jul 27 18:01:11.280765 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.280746    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 18:01:11.319375 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.319342    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-data\") pod \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") "
Jul 27 18:01:11.319569 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.319384    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-podinfo\") pod \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") "
Jul 27 18:01:11.319569 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.319481    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-envoy\") pod \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") "
Jul 27 18:01:11.319569 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.319500    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8j68\" (UniqueName: \"kubernetes.io/projected/2d68ba5b-34c4-4895-94ac-9a5b2407335c-kube-api-access-c8j68\") pod \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") "
Jul 27 18:01:11.319569 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.319528    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-credential-socket\") pod \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") "
Jul 27 18:01:11.319569 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.319550    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-workload-socket\") pod \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") "
Jul 27 18:01:11.319841 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.319582    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istiod-ca-cert\") pod \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") "
Jul 27 18:01:11.319841 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.319609    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-token\") pod \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") "
Jul 27 18:01:11.319841 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.319637    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-workload-certs\") pod \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\" (UID: \"2d68ba5b-34c4-4895-94ac-9a5b2407335c\") "
Jul 27 18:01:11.320179 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.320090    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d68ba5b-34c4-4895-94ac-9a5b2407335c" (UID: "2d68ba5b-34c4-4895-94ac-9a5b2407335c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:01:11.320179 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.320112    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d68ba5b-34c4-4895-94ac-9a5b2407335c" (UID: "2d68ba5b-34c4-4895-94ac-9a5b2407335c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:01:11.320179 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.320098    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d68ba5b-34c4-4895-94ac-9a5b2407335c" (UID: "2d68ba5b-34c4-4895-94ac-9a5b2407335c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:01:11.320384 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.320219    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d68ba5b-34c4-4895-94ac-9a5b2407335c" (UID: "2d68ba5b-34c4-4895-94ac-9a5b2407335c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:01:11.320384 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.320308    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d68ba5b-34c4-4895-94ac-9a5b2407335c" (UID: "2d68ba5b-34c4-4895-94ac-9a5b2407335c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:01:11.322285 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.322253    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d68ba5b-34c4-4895-94ac-9a5b2407335c" (UID: "2d68ba5b-34c4-4895-94ac-9a5b2407335c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 18:01:11.322285 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.322271    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d68ba5b-34c4-4895-94ac-9a5b2407335c" (UID: "2d68ba5b-34c4-4895-94ac-9a5b2407335c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:01:11.322488 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.322365    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d68ba5b-34c4-4895-94ac-9a5b2407335c-kube-api-access-c8j68" (OuterVolumeSpecName: "kube-api-access-c8j68") pod "2d68ba5b-34c4-4895-94ac-9a5b2407335c" (UID: "2d68ba5b-34c4-4895-94ac-9a5b2407335c"). InnerVolumeSpecName "kube-api-access-c8j68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:01:11.322618 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.322602    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d68ba5b-34c4-4895-94ac-9a5b2407335c" (UID: "2d68ba5b-34c4-4895-94ac-9a5b2407335c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:01:11.420498 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.420462    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-data\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:01:11.420498 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.420487    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-podinfo\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:01:11.420498 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.420496    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-envoy\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:01:11.420802 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.420508    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8j68\" (UniqueName: \"kubernetes.io/projected/2d68ba5b-34c4-4895-94ac-9a5b2407335c-kube-api-access-c8j68\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:01:11.420802 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.420521    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-credential-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:01:11.420802 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.420531    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-workload-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:01:11.420802 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.420538    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istiod-ca-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:01:11.420802 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.420546    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d68ba5b-34c4-4895-94ac-9a5b2407335c-istio-token\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:01:11.420802 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.420553    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d68ba5b-34c4-4895-94ac-9a5b2407335c-workload-certs\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:01:11.538287 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.538181    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv" event={"ID":"e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d","Type":"ContainerStarted","Data":"e0afe8c3e3a536ae8f2728c20aae5996e09964ed3ad7d1b63ea58e73285af760"}
Jul 27 18:01:11.538287 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.538259    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"
Jul 27 18:01:11.538287 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.538282    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv" event={"ID":"e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d","Type":"ContainerStarted","Data":"43b122e9e6236cf6d9ac274126a31272fd998ff733f87af0e3aacb666b10279a"}
Jul 27 18:01:11.539865 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.539843    2579 generic.go:356] "Generic (PLEG): container finished" podID="2d68ba5b-34c4-4895-94ac-9a5b2407335c" containerID="a77cadcdc4a630b58b56a9de7f8f9c9eb58b11897bb6aa6c5f091bed1222dcf7" exitCode=0
Jul 27 18:01:11.539953 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.539891    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"
Jul 27 18:01:11.539953 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.539895    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7" event={"ID":"2d68ba5b-34c4-4895-94ac-9a5b2407335c","Type":"ContainerDied","Data":"a77cadcdc4a630b58b56a9de7f8f9c9eb58b11897bb6aa6c5f091bed1222dcf7"}
Jul 27 18:01:11.539953 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.539943    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7" event={"ID":"2d68ba5b-34c4-4895-94ac-9a5b2407335c","Type":"ContainerDied","Data":"ef7db2a8b114123c7411a9d96f6677844f383336be8b8aa54e6a360a58b0042c"}
Jul 27 18:01:11.540099 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.539975    2579 scope.go:117] "RemoveContainer" containerID="a77cadcdc4a630b58b56a9de7f8f9c9eb58b11897bb6aa6c5f091bed1222dcf7"
Jul 27 18:01:11.541401 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.541370    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx" event={"ID":"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085","Type":"ContainerStarted","Data":"15c7b11fe4ae2a5f0298f6c97a59878525970e655138b7763c5948b6b4fed1c4"}
Jul 27 18:01:11.549365 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.549348    2579 scope.go:117] "RemoveContainer" containerID="8641c2083e04ad7430811f2c7a367f980eba9a2856710179175ef6f7e04a07e9"
Jul 27 18:01:11.554313 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.554273    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv" podStartSLOduration=1.554260414 podStartE2EDuration="1.554260414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:01:11.551665867 +0000 UTC m=+2415.083416854" watchObservedRunningTime="2026-07-27 18:01:11.554260414 +0000 UTC m=+2415.086011400"
Jul 27 18:01:11.558818 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.558795    2579 scope.go:117] "RemoveContainer" containerID="a77cadcdc4a630b58b56a9de7f8f9c9eb58b11897bb6aa6c5f091bed1222dcf7"
Jul 27 18:01:11.559195 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:01:11.559175    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a77cadcdc4a630b58b56a9de7f8f9c9eb58b11897bb6aa6c5f091bed1222dcf7\": container with ID starting with a77cadcdc4a630b58b56a9de7f8f9c9eb58b11897bb6aa6c5f091bed1222dcf7 not found: ID does not exist" containerID="a77cadcdc4a630b58b56a9de7f8f9c9eb58b11897bb6aa6c5f091bed1222dcf7"
Jul 27 18:01:11.559299 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.559205    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a77cadcdc4a630b58b56a9de7f8f9c9eb58b11897bb6aa6c5f091bed1222dcf7"} err="failed to get container status \"a77cadcdc4a630b58b56a9de7f8f9c9eb58b11897bb6aa6c5f091bed1222dcf7\": rpc error: code = NotFound desc = could not find container \"a77cadcdc4a630b58b56a9de7f8f9c9eb58b11897bb6aa6c5f091bed1222dcf7\": container with ID starting with a77cadcdc4a630b58b56a9de7f8f9c9eb58b11897bb6aa6c5f091bed1222dcf7 not found: ID does not exist"
Jul 27 18:01:11.559299 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.559227    2579 scope.go:117] "RemoveContainer" containerID="8641c2083e04ad7430811f2c7a367f980eba9a2856710179175ef6f7e04a07e9"
Jul 27 18:01:11.559498 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:01:11.559481    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8641c2083e04ad7430811f2c7a367f980eba9a2856710179175ef6f7e04a07e9\": container with ID starting with 8641c2083e04ad7430811f2c7a367f980eba9a2856710179175ef6f7e04a07e9 not found: ID does not exist" containerID="8641c2083e04ad7430811f2c7a367f980eba9a2856710179175ef6f7e04a07e9"
Jul 27 18:01:11.559561 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.559506    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8641c2083e04ad7430811f2c7a367f980eba9a2856710179175ef6f7e04a07e9"} err="failed to get container status \"8641c2083e04ad7430811f2c7a367f980eba9a2856710179175ef6f7e04a07e9\": rpc error: code = NotFound desc = could not find container \"8641c2083e04ad7430811f2c7a367f980eba9a2856710179175ef6f7e04a07e9\": container with ID starting with 8641c2083e04ad7430811f2c7a367f980eba9a2856710179175ef6f7e04a07e9 not found: ID does not exist"
Jul 27 18:01:11.567255 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.567234    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"]
Jul 27 18:01:11.572414 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:11.572392    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-0dcf85-openshift-default-8bfd8b974-l9fk7"]
Jul 27 18:01:11.651080 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:01:11.651019    2579 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/opendatahub/maas-api@sha256:b1e0c5d3d22f1ad2d7b9c4e8596fd00110f61ffaef69983f9c871252f8009be6: reading manifest sha256:06d9058dcf2053d0d5e20708cc974610fa3402a3577fc715c04c3eb3ef4c3f01 in quay.io/opendatahub/maas-api: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" image="quay.io/opendatahub/maas-api@sha256:b1e0c5d3d22f1ad2d7b9c4e8596fd00110f61ffaef69983f9c871252f8009be6"
Jul 27 18:01:11.651382 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:01:11.651171    2579 kuberuntime_manager.go:1459] "Unhandled Error" err="container maas-api start failed in pod maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx_odh-ai-gateway-infra(f2b8a5b7-a11d-4a71-a5cb-2ffa08644085): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/opendatahub/maas-api@sha256:b1e0c5d3d22f1ad2d7b9c4e8596fd00110f61ffaef69983f9c871252f8009be6: reading manifest sha256:06d9058dcf2053d0d5e20708cc974610fa3402a3577fc715c04c3eb3ef4c3f01 in quay.io/opendatahub/maas-api: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 27 18:01:11.651382 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:01:11.651218    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/opendatahub/maas-api@sha256:b1e0c5d3d22f1ad2d7b9c4e8596fd00110f61ffaef69983f9c871252f8009be6: reading manifest sha256:06d9058dcf2053d0d5e20708cc974610fa3402a3577fc715c04c3eb3ef4c3f01 in quay.io/opendatahub/maas-api: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx" podUID="f2b8a5b7-a11d-4a71-a5cb-2ffa08644085"
Jul 27 18:01:12.548955 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:01:12.548912    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/maas-api@sha256:b1e0c5d3d22f1ad2d7b9c4e8596fd00110f61ffaef69983f9c871252f8009be6\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: determining manifest MIME type for docker://quay.io/opendatahub/maas-api@sha256:b1e0c5d3d22f1ad2d7b9c4e8596fd00110f61ffaef69983f9c871252f8009be6: reading manifest sha256:06d9058dcf2053d0d5e20708cc974610fa3402a3577fc715c04c3eb3ef4c3f01 in quay.io/opendatahub/maas-api: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx" podUID="f2b8a5b7-a11d-4a71-a5cb-2ffa08644085"
Jul 27 18:01:12.993131 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:12.993051    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d68ba5b-34c4-4895-94ac-9a5b2407335c" path="/var/lib/kubelet/pods/2d68ba5b-34c4-4895-94ac-9a5b2407335c/volumes"
Jul 27 18:01:15.083575 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.083546    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"]
Jul 27 18:01:15.083948 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.083929    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d68ba5b-34c4-4895-94ac-9a5b2407335c" containerName="istio-proxy"
Jul 27 18:01:15.083948 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.083942    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d68ba5b-34c4-4895-94ac-9a5b2407335c" containerName="istio-proxy"
Jul 27 18:01:15.084028 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.083951    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d68ba5b-34c4-4895-94ac-9a5b2407335c" containerName="istio-proxy"
Jul 27 18:01:15.084028 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.083957    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d68ba5b-34c4-4895-94ac-9a5b2407335c" containerName="istio-proxy"
Jul 27 18:01:15.084028 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.084015    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d68ba5b-34c4-4895-94ac-9a5b2407335c" containerName="istio-proxy"
Jul 27 18:01:15.084028 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.084025    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d68ba5b-34c4-4895-94ac-9a5b2407335c" containerName="istio-proxy"
Jul 27 18:01:15.086512 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.086493    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.089745 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.089725    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-ed5396-openshift-default-dockercfg-8q7x7\""
Jul 27 18:01:15.116528 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.116494    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"]
Jul 27 18:01:15.150170 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.150127    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62285ca6-2701-4321-a768-1b3c502628f9-istio-podinfo\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.150326 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.150208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62285ca6-2701-4321-a768-1b3c502628f9-istiod-ca-cert\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.150326 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.150229    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-workload-certs\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.150326 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.150248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-credential-socket\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.150326 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.150277    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-istio-envoy\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.150594 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.150332    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-istio-data\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.150594 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.150399    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-workload-socket\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.150594 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.150457    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62285ca6-2701-4321-a768-1b3c502628f9-istio-token\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.150594 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.150482    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl5mj\" (UniqueName: \"kubernetes.io/projected/62285ca6-2701-4321-a768-1b3c502628f9-kube-api-access-pl5mj\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.251707 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.251672    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-workload-socket\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.251707 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.251712    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62285ca6-2701-4321-a768-1b3c502628f9-istio-token\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.251973 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.251734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl5mj\" (UniqueName: \"kubernetes.io/projected/62285ca6-2701-4321-a768-1b3c502628f9-kube-api-access-pl5mj\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.251973 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.251763    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62285ca6-2701-4321-a768-1b3c502628f9-istio-podinfo\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.251973 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.251814    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62285ca6-2701-4321-a768-1b3c502628f9-istiod-ca-cert\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.251973 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.251847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-workload-certs\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.251973 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.251872    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-credential-socket\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.251973 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.251911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-istio-envoy\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.251973 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.251942    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-istio-data\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.252361 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.252195    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-workload-socket\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.252361 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.252269    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-credential-socket\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.252361 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.252314    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-istio-data\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.252672 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.252645    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-workload-certs\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.252672 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.252654    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62285ca6-2701-4321-a768-1b3c502628f9-istiod-ca-cert\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.254301 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.254285    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-istio-envoy\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.254577 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.254556    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62285ca6-2701-4321-a768-1b3c502628f9-istio-podinfo\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.260042 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.260023    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62285ca6-2701-4321-a768-1b3c502628f9-istio-token\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.260208 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.260188    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl5mj\" (UniqueName: \"kubernetes.io/projected/62285ca6-2701-4321-a768-1b3c502628f9-kube-api-access-pl5mj\") pod \"e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") " pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.396991 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.396907    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:15.545497 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.545471    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"]
Jul 27 18:01:15.547045 ip-10-0-128-74 kubenswrapper[2579]: W0727 18:01:15.547017    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62285ca6_2701_4321_a768_1b3c502628f9.slice/crio-dc91396975587cb6d31d6514d27e6d7921e8f8351d9c9c515a24163cba47e8b1 WatchSource:0}: Error finding container dc91396975587cb6d31d6514d27e6d7921e8f8351d9c9c515a24163cba47e8b1: Status 404 returned error can't find the container with id dc91396975587cb6d31d6514d27e6d7921e8f8351d9c9c515a24163cba47e8b1
Jul 27 18:01:15.549361 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.549334    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:01:15.549443 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.549398    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:01:15.549487 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.549445    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:01:15.565478 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:15.565451    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv" event={"ID":"62285ca6-2701-4321-a768-1b3c502628f9","Type":"ContainerStarted","Data":"dc91396975587cb6d31d6514d27e6d7921e8f8351d9c9c515a24163cba47e8b1"}
Jul 27 18:01:16.572555 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:16.572512    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv" event={"ID":"62285ca6-2701-4321-a768-1b3c502628f9","Type":"ContainerStarted","Data":"8f1cfb3f877cae63294fb808f7a980c04d34c245cefacb21615751bca512d431"}
Jul 27 18:01:16.593618 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:16.593561    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv" podStartSLOduration=1.5935399540000001 podStartE2EDuration="1.593539954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:01:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:01:16.592732378 +0000 UTC m=+2420.124483363" watchObservedRunningTime="2026-07-27 18:01:16.593539954 +0000 UTC m=+2420.125290941"
Jul 27 18:01:17.397890 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:17.397860    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:17.402961 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:17.402936    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:17.578360 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:17.578328    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:17.579404 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:17.579381    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:19.546456 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.546401    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"]
Jul 27 18:01:19.548859 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.548842    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"
Jul 27 18:01:19.552088 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.552069    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-ed5396\""
Jul 27 18:01:19.564043 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.564021    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"]
Jul 27 18:01:19.590004 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.589968    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/959f995a-b202-43c3-a1c6-e878004984f2-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7\" (UID: \"959f995a-b202-43c3-a1c6-e878004984f2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"
Jul 27 18:01:19.590147 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.590015    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2b27\" (UniqueName: \"kubernetes.io/projected/959f995a-b202-43c3-a1c6-e878004984f2-kube-api-access-b2b27\") pod \"payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7\" (UID: \"959f995a-b202-43c3-a1c6-e878004984f2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"
Jul 27 18:01:19.596518 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.596494    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"]
Jul 27 18:01:19.598730 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.598714    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"
Jul 27 18:01:19.601061 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.601042    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-ed5396-dockercfg-dcvcq\""
Jul 27 18:01:19.611649 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.611621    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"]
Jul 27 18:01:19.690741 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.690703    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/959f995a-b202-43c3-a1c6-e878004984f2-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7\" (UID: \"959f995a-b202-43c3-a1c6-e878004984f2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"
Jul 27 18:01:19.690942 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.690780    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsx8c\" (UniqueName: \"kubernetes.io/projected/9659f9ca-f3ec-44ed-9cd4-844dfabd341e-kube-api-access-lsx8c\") pod \"payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr\" (UID: \"9659f9ca-f3ec-44ed-9cd4-844dfabd341e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"
Jul 27 18:01:19.690942 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.690872    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2b27\" (UniqueName: \"kubernetes.io/projected/959f995a-b202-43c3-a1c6-e878004984f2-kube-api-access-b2b27\") pod \"payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7\" (UID: \"959f995a-b202-43c3-a1c6-e878004984f2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"
Jul 27 18:01:19.690942 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.690916    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9659f9ca-f3ec-44ed-9cd4-844dfabd341e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr\" (UID: \"9659f9ca-f3ec-44ed-9cd4-844dfabd341e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"
Jul 27 18:01:19.692085 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.692055    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/959f995a-b202-43c3-a1c6-e878004984f2-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7\" (UID: \"959f995a-b202-43c3-a1c6-e878004984f2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"
Jul 27 18:01:19.701351 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.701318    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2b27\" (UniqueName: \"kubernetes.io/projected/959f995a-b202-43c3-a1c6-e878004984f2-kube-api-access-b2b27\") pod \"payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7\" (UID: \"959f995a-b202-43c3-a1c6-e878004984f2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"
Jul 27 18:01:19.791625 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.791591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsx8c\" (UniqueName: \"kubernetes.io/projected/9659f9ca-f3ec-44ed-9cd4-844dfabd341e-kube-api-access-lsx8c\") pod \"payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr\" (UID: \"9659f9ca-f3ec-44ed-9cd4-844dfabd341e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"
Jul 27 18:01:19.791821 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.791651    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9659f9ca-f3ec-44ed-9cd4-844dfabd341e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr\" (UID: \"9659f9ca-f3ec-44ed-9cd4-844dfabd341e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"
Jul 27 18:01:19.792261 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.792242    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9659f9ca-f3ec-44ed-9cd4-844dfabd341e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr\" (UID: \"9659f9ca-f3ec-44ed-9cd4-844dfabd341e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"
Jul 27 18:01:19.801699 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.801634    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsx8c\" (UniqueName: \"kubernetes.io/projected/9659f9ca-f3ec-44ed-9cd4-844dfabd341e-kube-api-access-lsx8c\") pod \"payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr\" (UID: \"9659f9ca-f3ec-44ed-9cd4-844dfabd341e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"
Jul 27 18:01:19.859864 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.859837    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"
Jul 27 18:01:19.909976 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:19.909737    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"
Jul 27 18:01:20.013766 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:20.013070    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"]
Jul 27 18:01:20.016259 ip-10-0-128-74 kubenswrapper[2579]: W0727 18:01:20.016226    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959f995a_b202_43c3_a1c6_e878004984f2.slice/crio-8ea14bae258708ec4eb3accee137798c29df7d1dd43f5479c2b382872c99bb82 WatchSource:0}: Error finding container 8ea14bae258708ec4eb3accee137798c29df7d1dd43f5479c2b382872c99bb82: Status 404 returned error can't find the container with id 8ea14bae258708ec4eb3accee137798c29df7d1dd43f5479c2b382872c99bb82
Jul 27 18:01:20.066863 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:20.066835    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"]
Jul 27 18:01:20.069174 ip-10-0-128-74 kubenswrapper[2579]: W0727 18:01:20.069145    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9659f9ca_f3ec_44ed_9cd4_844dfabd341e.slice/crio-fa2591495b45fcf6490c21f3d3d736c155384714dd7d1a3d1dd9053bf3a05134 WatchSource:0}: Error finding container fa2591495b45fcf6490c21f3d3d736c155384714dd7d1a3d1dd9053bf3a05134: Status 404 returned error can't find the container with id fa2591495b45fcf6490c21f3d3d736c155384714dd7d1a3d1dd9053bf3a05134
Jul 27 18:01:20.597696 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:20.597662    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7" event={"ID":"959f995a-b202-43c3-a1c6-e878004984f2","Type":"ContainerStarted","Data":"b8833c0af8948f04c9898c22d51a55ba9f6bd25ec3fb8f21c1782e8560c4f107"}
Jul 27 18:01:20.598110 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:20.597725    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7" event={"ID":"959f995a-b202-43c3-a1c6-e878004984f2","Type":"ContainerStarted","Data":"8ea14bae258708ec4eb3accee137798c29df7d1dd43f5479c2b382872c99bb82"}
Jul 27 18:01:20.598110 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:20.597753    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"
Jul 27 18:01:20.599332 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:20.599304    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr" event={"ID":"9659f9ca-f3ec-44ed-9cd4-844dfabd341e","Type":"ContainerStarted","Data":"1ec0bd0f6e1f769eac7dc94349de1e7c2c00291ed93d66896e9f2ab96b36a903"}
Jul 27 18:01:20.599451 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:20.599358    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"
Jul 27 18:01:20.599451 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:20.599376    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr" event={"ID":"9659f9ca-f3ec-44ed-9cd4-844dfabd341e","Type":"ContainerStarted","Data":"fa2591495b45fcf6490c21f3d3d736c155384714dd7d1a3d1dd9053bf3a05134"}
Jul 27 18:01:20.615348 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:20.615296    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7" podStartSLOduration=1.615278703 podStartE2EDuration="1.615278703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:01:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:01:20.613021553 +0000 UTC m=+2424.144772539" watchObservedRunningTime="2026-07-27 18:01:20.615278703 +0000 UTC m=+2424.147029691"
Jul 27 18:01:20.629041 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:20.629000    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr" podStartSLOduration=1.628988763 podStartE2EDuration="1.628988763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:01:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:01:20.627552369 +0000 UTC m=+2424.159303356" watchObservedRunningTime="2026-07-27 18:01:20.628988763 +0000 UTC m=+2424.160739753"
Jul 27 18:01:22.550071 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:22.550037    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"
Jul 27 18:01:24.622090 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:24.622050    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx" event={"ID":"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085","Type":"ContainerStarted","Data":"107a2104be0e2bb688e3f474cb30998e20d99aa3a44c65604b42a9225fbcfeb4"}
Jul 27 18:01:24.622553 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:24.622277    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"
Jul 27 18:01:24.641491 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:24.641441    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx" podStartSLOduration=2.209147723 podStartE2EDuration="14.641410867s" totalImagesPullingTime="12.432263144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:01:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-27 18:01:24.638654633 +0000 UTC m=+2428.170405619" watchObservedRunningTime="2026-07-27 18:01:24.641410867 +0000 UTC m=+2428.173161853"
Jul 27 18:01:30.639320 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:30.639289    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"
Jul 27 18:01:31.606870 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:31.606827    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"
Jul 27 18:01:31.607096 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:31.607050    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"
Jul 27 18:01:32.579794 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:32.579758    2579 patch_prober.go:28] interesting pod/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Jul 27 18:01:32.580298 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:32.579817    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv" podUID="62285ca6-2701-4321-a768-1b3c502628f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Jul 27 18:01:32.676161 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:32.676129    2579 generic.go:356] "Generic (PLEG): container finished" podID="62285ca6-2701-4321-a768-1b3c502628f9" containerID="8f1cfb3f877cae63294fb808f7a980c04d34c245cefacb21615751bca512d431" exitCode=0
Jul 27 18:01:32.676161 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:32.676170    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv" event={"ID":"62285ca6-2701-4321-a768-1b3c502628f9","Type":"ContainerDied","Data":"8f1cfb3f877cae63294fb808f7a980c04d34c245cefacb21615751bca512d431"}
Jul 27 18:01:32.676650 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:32.676635    2579 scope.go:117] "RemoveContainer" containerID="8f1cfb3f877cae63294fb808f7a980c04d34c245cefacb21615751bca512d431"
Jul 27 18:01:32.677742 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:32.677715    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:01:32.677851 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:32.677782    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:01:32.677851 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:32.677817    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:01:33.684268 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:33.684229    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv" event={"ID":"62285ca6-2701-4321-a768-1b3c502628f9","Type":"ContainerStarted","Data":"5670f75170071fa26e91e372851bace071fe216fd918d6f67796068f21f9b1fb"}
Jul 27 18:01:34.397559 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:34.397522    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:34.397819 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:34.397798    2579 patch_prober.go:28] interesting pod/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Jul 27 18:01:34.397871 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:34.397845    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv" podUID="62285ca6-2701-4321-a768-1b3c502628f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Jul 27 18:01:35.397816 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:35.397779    2579 patch_prober.go:28] interesting pod/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Jul 27 18:01:35.398208 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:35.397853    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv" podUID="62285ca6-2701-4321-a768-1b3c502628f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Jul 27 18:01:36.397922 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:36.397884    2579 patch_prober.go:28] interesting pod/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Jul 27 18:01:36.398325 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:36.397954    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv" podUID="62285ca6-2701-4321-a768-1b3c502628f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Jul 27 18:01:37.398181 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:37.398141    2579 patch_prober.go:28] interesting pod/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Jul 27 18:01:37.398590 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:37.398204    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv" podUID="62285ca6-2701-4321-a768-1b3c502628f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Jul 27 18:01:38.402093 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:38.402065    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:38.402506 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:38.402387    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:01:38.403076 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:01:38.403061    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:04:57.333161 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:04:57.333085    2579 scope.go:117] "RemoveContainer" containerID="25ab5a3761f5e40f3a11eae2dd9ed21f6ebbed19a026d8df59262a76ea08be33"
Jul 27 18:11:09.919292 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:09.919257    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"]
Jul 27 18:11:09.922572 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:09.922552    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:09.924887 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:09.924863    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-7985e5-openshift-default-dockercfg-dm8xx\""
Jul 27 18:11:09.936988 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:09.936966    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"]
Jul 27 18:11:10.057664 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.057627    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-workload-certs\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.057841 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.057669    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-workload-socket\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.057841 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.057735    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-envoy\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.057841 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.057750    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-data\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.057841 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.057769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-token\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.057841 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.057793    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t5ms\" (UniqueName: \"kubernetes.io/projected/f914f563-df5b-47de-86ca-5d186a5da3bc-kube-api-access-4t5ms\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.058049 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.057841    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-podinfo\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.058049 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.057895    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-credential-socket\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.058049 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.057911    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f914f563-df5b-47de-86ca-5d186a5da3bc-istiod-ca-cert\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.158342 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.158300    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-workload-certs\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.158342 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.158341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-workload-socket\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.158621 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.158373    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-envoy\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.158621 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.158395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-data\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.158621 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.158448    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-token\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.158621 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.158472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t5ms\" (UniqueName: \"kubernetes.io/projected/f914f563-df5b-47de-86ca-5d186a5da3bc-kube-api-access-4t5ms\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.158621 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.158529    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-podinfo\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.158621 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.158578    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-credential-socket\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.158621 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.158598    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f914f563-df5b-47de-86ca-5d186a5da3bc-istiod-ca-cert\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.159030 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.158809    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-workload-certs\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.159087 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.159066    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-credential-socket\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.159245 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.159199    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-data\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.159452 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.159341    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f914f563-df5b-47de-86ca-5d186a5da3bc-istiod-ca-cert\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.159692 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.159644    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-workload-socket\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.161223 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.161195    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-envoy\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.161943 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.161918    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-podinfo\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.166752 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.166734    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-token\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.166973 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.166953    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t5ms\" (UniqueName: \"kubernetes.io/projected/f914f563-df5b-47de-86ca-5d186a5da3bc-kube-api-access-4t5ms\") pod \"e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") " pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.233103 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.233007    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:10.388930 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.388906    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"]
Jul 27 18:11:10.391487 ip-10-0-128-74 kubenswrapper[2579]: W0727 18:11:10.391462    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf914f563_df5b_47de_86ca_5d186a5da3bc.slice/crio-4ffb97db1b00a33679a3f785685a109bd4c682e7654720a54da3eb9814f11cef WatchSource:0}: Error finding container 4ffb97db1b00a33679a3f785685a109bd4c682e7654720a54da3eb9814f11cef: Status 404 returned error can't find the container with id 4ffb97db1b00a33679a3f785685a109bd4c682e7654720a54da3eb9814f11cef
Jul 27 18:11:10.394224 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.394181    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:11:10.394306 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.394270    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:11:10.394346 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.394307    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:11:10.824902 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.824864    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz" event={"ID":"f914f563-df5b-47de-86ca-5d186a5da3bc","Type":"ContainerStarted","Data":"c967c606995af46abfb710ab7a22cdebf5ef1b6f51be186c6d0bff2a574482a0"}
Jul 27 18:11:10.825077 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.824924    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz" event={"ID":"f914f563-df5b-47de-86ca-5d186a5da3bc","Type":"ContainerStarted","Data":"4ffb97db1b00a33679a3f785685a109bd4c682e7654720a54da3eb9814f11cef"}
Jul 27 18:11:10.850430 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:10.850362    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz" podStartSLOduration=1.850340506 podStartE2EDuration="1.850340506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:11:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:11:10.846063649 +0000 UTC m=+3014.377814634" watchObservedRunningTime="2026-07-27 18:11:10.850340506 +0000 UTC m=+3014.382091508"
Jul 27 18:11:11.233801 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:11.233724    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:11.238879 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:11.238857    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:11.830311 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:11.830282    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:11.831240 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:11.831216    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:12.890028 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:12.889989    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"]
Jul 27 18:11:12.893813 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:12.893792    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"
Jul 27 18:11:12.896577 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:12.896551    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-7985e5-serving-cert\""
Jul 27 18:11:12.929676 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:12.929648    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"]
Jul 27 18:11:12.986980 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:12.986925    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmrcj\" (UniqueName: \"kubernetes.io/projected/784e785b-0a77-4522-a96e-01cc560cb8a2-kube-api-access-mmrcj\") pod \"maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw\" (UID: \"784e785b-0a77-4522-a96e-01cc560cb8a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"
Jul 27 18:11:12.987183 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:12.987039    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/784e785b-0a77-4522-a96e-01cc560cb8a2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw\" (UID: \"784e785b-0a77-4522-a96e-01cc560cb8a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"
Jul 27 18:11:12.987183 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:12.987104    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/784e785b-0a77-4522-a96e-01cc560cb8a2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw\" (UID: \"784e785b-0a77-4522-a96e-01cc560cb8a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"
Jul 27 18:11:13.088726 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:13.088688    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmrcj\" (UniqueName: \"kubernetes.io/projected/784e785b-0a77-4522-a96e-01cc560cb8a2-kube-api-access-mmrcj\") pod \"maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw\" (UID: \"784e785b-0a77-4522-a96e-01cc560cb8a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"
Jul 27 18:11:13.088936 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:13.088782    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/784e785b-0a77-4522-a96e-01cc560cb8a2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw\" (UID: \"784e785b-0a77-4522-a96e-01cc560cb8a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"
Jul 27 18:11:13.088936 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:13.088816    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/784e785b-0a77-4522-a96e-01cc560cb8a2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw\" (UID: \"784e785b-0a77-4522-a96e-01cc560cb8a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"
Jul 27 18:11:13.089049 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:11:13.088966    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-serving-cert: secret "maas-api-e2e-ipp-a-7985e5-serving-cert" not found
Jul 27 18:11:13.089049 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:11:13.089031    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/784e785b-0a77-4522-a96e-01cc560cb8a2-maas-api-tls podName:784e785b-0a77-4522-a96e-01cc560cb8a2 nodeName:}" failed. No retries permitted until 2026-07-27 18:11:13.589011585 +0000 UTC m=+3017.120762550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/784e785b-0a77-4522-a96e-01cc560cb8a2-maas-api-tls") pod "maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw" (UID: "784e785b-0a77-4522-a96e-01cc560cb8a2") : secret "maas-api-e2e-ipp-a-7985e5-serving-cert" not found
Jul 27 18:11:13.089550 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:13.089517    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/784e785b-0a77-4522-a96e-01cc560cb8a2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw\" (UID: \"784e785b-0a77-4522-a96e-01cc560cb8a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"
Jul 27 18:11:13.098761 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:13.098736    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmrcj\" (UniqueName: \"kubernetes.io/projected/784e785b-0a77-4522-a96e-01cc560cb8a2-kube-api-access-mmrcj\") pod \"maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw\" (UID: \"784e785b-0a77-4522-a96e-01cc560cb8a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"
Jul 27 18:11:13.594680 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:13.594628    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/784e785b-0a77-4522-a96e-01cc560cb8a2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw\" (UID: \"784e785b-0a77-4522-a96e-01cc560cb8a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"
Jul 27 18:11:13.597339 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:13.597312    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/784e785b-0a77-4522-a96e-01cc560cb8a2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw\" (UID: \"784e785b-0a77-4522-a96e-01cc560cb8a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"
Jul 27 18:11:13.805594 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:13.805553    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"
Jul 27 18:11:13.977189 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:13.977158    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"]
Jul 27 18:11:13.977881 ip-10-0-128-74 kubenswrapper[2579]: W0727 18:11:13.977858    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod784e785b_0a77_4522_a96e_01cc560cb8a2.slice/crio-c82dcbc9874f18e0d289dd86cfdaf01a3640a772805bc6dea092c4f820ca02ec WatchSource:0}: Error finding container c82dcbc9874f18e0d289dd86cfdaf01a3640a772805bc6dea092c4f820ca02ec: Status 404 returned error can't find the container with id c82dcbc9874f18e0d289dd86cfdaf01a3640a772805bc6dea092c4f820ca02ec
Jul 27 18:11:13.979336 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:13.979319    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:11:14.850439 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:14.850386    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw" event={"ID":"784e785b-0a77-4522-a96e-01cc560cb8a2","Type":"ContainerStarted","Data":"5f10dbbc2923ee983e89aa41838fcf6a6fd6bbe4695954c78b452b26037f7f1b"}
Jul 27 18:11:14.850643 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:14.850459    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw" event={"ID":"784e785b-0a77-4522-a96e-01cc560cb8a2","Type":"ContainerStarted","Data":"c82dcbc9874f18e0d289dd86cfdaf01a3640a772805bc6dea092c4f820ca02ec"}
Jul 27 18:11:14.850643 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:14.850535    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"
Jul 27 18:11:14.870903 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:14.870855    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw" podStartSLOduration=2.173754078 podStartE2EDuration="2.8708411s" totalImagesPullingTime="697.087022ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:11:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:11:14.86859127 +0000 UTC m=+3018.400342255" watchObservedRunningTime="2026-07-27 18:11:14.8708411 +0000 UTC m=+3018.402592091"
Jul 27 18:11:20.862223 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:20.862182    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"
Jul 27 18:11:27.273327 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:27.272208    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": read tcp 10.133.0.2:50994->10.133.0.83:15021: read: connection reset by peer" start-of-body=
Jul 27 18:11:27.273327 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:27.272290    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz" podUID="f914f563-df5b-47de-86ca-5d186a5da3bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": read tcp 10.133.0.2:50994->10.133.0.83:15021: read: connection reset by peer"
Jul 27 18:11:27.925581 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:27.925545    2579 generic.go:356] "Generic (PLEG): container finished" podID="f914f563-df5b-47de-86ca-5d186a5da3bc" containerID="c967c606995af46abfb710ab7a22cdebf5ef1b6f51be186c6d0bff2a574482a0" exitCode=0
Jul 27 18:11:27.925756 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:27.925620    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz" event={"ID":"f914f563-df5b-47de-86ca-5d186a5da3bc","Type":"ContainerDied","Data":"c967c606995af46abfb710ab7a22cdebf5ef1b6f51be186c6d0bff2a574482a0"}
Jul 27 18:11:27.926056 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:27.926038    2579 scope.go:117] "RemoveContainer" containerID="c967c606995af46abfb710ab7a22cdebf5ef1b6f51be186c6d0bff2a574482a0"
Jul 27 18:11:27.927211 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:27.927181    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:11:27.927291 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:27.927253    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:11:27.927331 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:27.927302    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:11:28.557846 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.557811    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"]
Jul 27 18:11:28.561529 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.561509    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.563608 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.563588    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-fbef1a-openshift-default-dockercfg-drmmf\""
Jul 27 18:11:28.573248 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.573221    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"]
Jul 27 18:11:28.738479 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.738447    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-podinfo\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.738655 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.738497    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-workload-certs\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.738655 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.738531    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-workload-socket\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.738655 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.738559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-credential-socket\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.738655 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.738576    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-envoy\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.738655 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.738628    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istiod-ca-cert\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.738845 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.738707    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-token\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.738845 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.738737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-data\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.738845 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.738795    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm94p\" (UniqueName: \"kubernetes.io/projected/fd2ad129-a309-4731-baf1-8f9caa24cd5e-kube-api-access-nm94p\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.839700 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.839605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm94p\" (UniqueName: \"kubernetes.io/projected/fd2ad129-a309-4731-baf1-8f9caa24cd5e-kube-api-access-nm94p\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.839700 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.839669    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-podinfo\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.839938 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.839720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-workload-certs\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.839938 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.839750    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-workload-socket\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.839938 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.839791    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-credential-socket\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.839938 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.839814    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-envoy\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.839938 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.839839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istiod-ca-cert\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.839938 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.839870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-token\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.839938 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.839904    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-data\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.840319 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.840175    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-workload-socket\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.840319 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.840243    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-workload-certs\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.840642 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.840620    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istiod-ca-cert\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.840710 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.840681    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-credential-socket\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.840752 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.840667    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-data\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.842300 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.842274    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-envoy\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.842557 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.842540    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-podinfo\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.847710 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.847689    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-token\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.847936 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.847919    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm94p\" (UniqueName: \"kubernetes.io/projected/fd2ad129-a309-4731-baf1-8f9caa24cd5e-kube-api-access-nm94p\") pod \"e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") " pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.873949 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.873910    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:28.937717 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:28.937685    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz" event={"ID":"f914f563-df5b-47de-86ca-5d186a5da3bc","Type":"ContainerStarted","Data":"cc46161ac5dfe7cdf8f9c2b8040c3984e3a0c93a5922db580d93cf1f8c6f703f"}
Jul 27 18:11:29.038438 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:29.034773    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"]
Jul 27 18:11:29.041479 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:29.040875    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:11:29.041479 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:29.040963    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:11:29.041479 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:29.041002    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:11:29.233659 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:29.233623    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:29.234292 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:29.233831    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Jul 27 18:11:29.234292 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:29.234003    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz" podUID="f914f563-df5b-47de-86ca-5d186a5da3bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Jul 27 18:11:29.944678 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:29.944634    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct" event={"ID":"fd2ad129-a309-4731-baf1-8f9caa24cd5e","Type":"ContainerStarted","Data":"1548636644e3928565035d4ac8704d8d8b6ed096a3ddd8934c17433e14a709b7"}
Jul 27 18:11:29.945096 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:29.944695    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct" event={"ID":"fd2ad129-a309-4731-baf1-8f9caa24cd5e","Type":"ContainerStarted","Data":"763682ff5f95bb04878fec1d8716adbf76ccb2247a62bedad87aa2a5d709cde7"}
Jul 27 18:11:29.966684 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:29.966637    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct" podStartSLOduration=1.966620584 podStartE2EDuration="1.966620584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:11:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:11:29.963785145 +0000 UTC m=+3033.495536131" watchObservedRunningTime="2026-07-27 18:11:29.966620584 +0000 UTC m=+3033.498371569"
Jul 27 18:11:30.234463 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:30.234348    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Jul 27 18:11:30.234646 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:30.234455    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz" podUID="f914f563-df5b-47de-86ca-5d186a5da3bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Jul 27 18:11:30.874256 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:30.874215    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:30.878833 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:30.878811    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:30.950636 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:30.950606    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:30.951538 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:30.951515    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:31.234001 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:31.233899    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Jul 27 18:11:31.234001 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:31.233982    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz" podUID="f914f563-df5b-47de-86ca-5d186a5da3bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Jul 27 18:11:32.234444 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:32.234313    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Jul 27 18:11:32.234444 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:32.234376    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz" podUID="f914f563-df5b-47de-86ca-5d186a5da3bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Jul 27 18:11:33.082894 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.082857    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"]
Jul 27 18:11:33.086354 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.086338    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"
Jul 27 18:11:33.089740 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.089722    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-fbef1a\""
Jul 27 18:11:33.091102 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.091085    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-fbef1a-dockercfg-994hj\""
Jul 27 18:11:33.113382 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.111941    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"]
Jul 27 18:11:33.179131 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.179092    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29dc3b6c-a730-4a25-a836-f0004cfb2b44-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg\" (UID: \"29dc3b6c-a730-4a25-a836-f0004cfb2b44\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"
Jul 27 18:11:33.179301 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.179244    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdltp\" (UniqueName: \"kubernetes.io/projected/29dc3b6c-a730-4a25-a836-f0004cfb2b44-kube-api-access-rdltp\") pod \"payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg\" (UID: \"29dc3b6c-a730-4a25-a836-f0004cfb2b44\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"
Jul 27 18:11:33.234410 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.234365    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Jul 27 18:11:33.234640 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.234463    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz" podUID="f914f563-df5b-47de-86ca-5d186a5da3bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Jul 27 18:11:33.279978 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.279937    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdltp\" (UniqueName: \"kubernetes.io/projected/29dc3b6c-a730-4a25-a836-f0004cfb2b44-kube-api-access-rdltp\") pod \"payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg\" (UID: \"29dc3b6c-a730-4a25-a836-f0004cfb2b44\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"
Jul 27 18:11:33.280153 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.280033    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29dc3b6c-a730-4a25-a836-f0004cfb2b44-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg\" (UID: \"29dc3b6c-a730-4a25-a836-f0004cfb2b44\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"
Jul 27 18:11:33.280742 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.280724    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29dc3b6c-a730-4a25-a836-f0004cfb2b44-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg\" (UID: \"29dc3b6c-a730-4a25-a836-f0004cfb2b44\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"
Jul 27 18:11:33.288187 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.288161    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdltp\" (UniqueName: \"kubernetes.io/projected/29dc3b6c-a730-4a25-a836-f0004cfb2b44-kube-api-access-rdltp\") pod \"payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg\" (UID: \"29dc3b6c-a730-4a25-a836-f0004cfb2b44\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"
Jul 27 18:11:33.397464 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.397367    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"
Jul 27 18:11:33.542242 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.542214    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"]
Jul 27 18:11:33.544330 ip-10-0-128-74 kubenswrapper[2579]: W0727 18:11:33.544294    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29dc3b6c_a730_4a25_a836_f0004cfb2b44.slice/crio-65cd60ad5bdfc33abad4641bf4b62169b31836169036c0eb4d6cb81b290e8ee1 WatchSource:0}: Error finding container 65cd60ad5bdfc33abad4641bf4b62169b31836169036c0eb4d6cb81b290e8ee1: Status 404 returned error can't find the container with id 65cd60ad5bdfc33abad4641bf4b62169b31836169036c0eb4d6cb81b290e8ee1
Jul 27 18:11:33.968921 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.968880    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg" event={"ID":"29dc3b6c-a730-4a25-a836-f0004cfb2b44","Type":"ContainerStarted","Data":"73d4a5c725f89e2d925a141d91cc92caf85c1e680310c3c7c2d7d3a959471a08"}
Jul 27 18:11:33.969096 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.968990    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"
Jul 27 18:11:33.969096 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.969018    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg" event={"ID":"29dc3b6c-a730-4a25-a836-f0004cfb2b44","Type":"ContainerStarted","Data":"65cd60ad5bdfc33abad4641bf4b62169b31836169036c0eb4d6cb81b290e8ee1"}
Jul 27 18:11:33.986094 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:33.986045    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg" podStartSLOduration=0.986029605 podStartE2EDuration="986.029605ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:11:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:11:33.984537882 +0000 UTC m=+3037.516288868" watchObservedRunningTime="2026-07-27 18:11:33.986029605 +0000 UTC m=+3037.517780624"
Jul 27 18:11:34.237879 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:34.237796    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:34.238248 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:34.238087    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:34.238775 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:34.238756    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:11:44.977411 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:44.977381    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"
Jul 27 18:11:50.078062 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:50.078029    2579 generic.go:356] "Generic (PLEG): container finished" podID="fd2ad129-a309-4731-baf1-8f9caa24cd5e" containerID="1548636644e3928565035d4ac8704d8d8b6ed096a3ddd8934c17433e14a709b7" exitCode=0
Jul 27 18:11:50.078530 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:50.078105    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct" event={"ID":"fd2ad129-a309-4731-baf1-8f9caa24cd5e","Type":"ContainerDied","Data":"1548636644e3928565035d4ac8704d8d8b6ed096a3ddd8934c17433e14a709b7"}
Jul 27 18:11:50.078530 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:50.078517    2579 scope.go:117] "RemoveContainer" containerID="1548636644e3928565035d4ac8704d8d8b6ed096a3ddd8934c17433e14a709b7"
Jul 27 18:11:50.079593 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:50.079568    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:11:50.079653 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:50.079640    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:11:50.079691 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:50.079675    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 27 18:11:51.085609 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:51.085571    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct" event={"ID":"fd2ad129-a309-4731-baf1-8f9caa24cd5e","Type":"ContainerStarted","Data":"d65bf744bb7d5523da056b8d708ecdc025ef7177e87a44aeb89ab4568c4e474a"}
Jul 27 18:11:51.874615 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:51.874577    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:51.874801 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:51.874781    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Jul 27 18:11:51.874847 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:51.874827    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct" podUID="fd2ad129-a309-4731-baf1-8f9caa24cd5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Jul 27 18:11:52.874788 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:52.874746    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Jul 27 18:11:52.875267 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:52.874809    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct" podUID="fd2ad129-a309-4731-baf1-8f9caa24cd5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Jul 27 18:11:53.874970 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:53.874934    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Jul 27 18:11:53.875378 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:53.874995    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct" podUID="fd2ad129-a309-4731-baf1-8f9caa24cd5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Jul 27 18:11:54.007502 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:54.007471    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-l4dk8_eb94c657-b0a1-426d-8414-89545237e621/payload-processing/0.log"
Jul 27 18:11:54.874495 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:54.874458    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused" start-of-body=
Jul 27 18:11:54.874676 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:54.874533    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct" podUID="fd2ad129-a309-4731-baf1-8f9caa24cd5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": dial tcp 10.133.0.85:15021: connect: connection refused"
Jul 27 18:11:55.878575 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:55.878545    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:55.879044 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:55.878938    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:11:55.879721 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:11:55.879701    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:13:29.155257 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:29.155146    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-l4dk8_eb94c657-b0a1-426d-8414-89545237e621/payload-processing/0.log"
Jul 27 18:13:35.711107 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:35.711064    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"]
Jul 27 18:13:35.715080 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:35.715062    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"
Jul 27 18:13:35.719107 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:35.719075    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-e962ab\""
Jul 27 18:13:35.721782 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:35.721760    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"]
Jul 27 18:13:35.765460 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:35.765402    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7cnf\" (UniqueName: \"kubernetes.io/projected/fa7ff22e-0a44-4544-936c-a37d5eb649f7-kube-api-access-x7cnf\") pod \"payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm\" (UID: \"fa7ff22e-0a44-4544-936c-a37d5eb649f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"
Jul 27 18:13:35.765642 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:35.765588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa7ff22e-0a44-4544-936c-a37d5eb649f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm\" (UID: \"fa7ff22e-0a44-4544-936c-a37d5eb649f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"
Jul 27 18:13:35.866285 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:35.866254    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7cnf\" (UniqueName: \"kubernetes.io/projected/fa7ff22e-0a44-4544-936c-a37d5eb649f7-kube-api-access-x7cnf\") pod \"payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm\" (UID: \"fa7ff22e-0a44-4544-936c-a37d5eb649f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"
Jul 27 18:13:35.866532 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:35.866351    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa7ff22e-0a44-4544-936c-a37d5eb649f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm\" (UID: \"fa7ff22e-0a44-4544-936c-a37d5eb649f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"
Jul 27 18:13:35.867063 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:35.867042    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa7ff22e-0a44-4544-936c-a37d5eb649f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm\" (UID: \"fa7ff22e-0a44-4544-936c-a37d5eb649f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"
Jul 27 18:13:35.875899 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:35.875874    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7cnf\" (UniqueName: \"kubernetes.io/projected/fa7ff22e-0a44-4544-936c-a37d5eb649f7-kube-api-access-x7cnf\") pod \"payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm\" (UID: \"fa7ff22e-0a44-4544-936c-a37d5eb649f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"
Jul 27 18:13:36.028473 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:36.028403    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"
Jul 27 18:13:36.176218 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:36.176191    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"]
Jul 27 18:13:36.177899 ip-10-0-128-74 kubenswrapper[2579]: W0727 18:13:36.177871    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa7ff22e_0a44_4544_936c_a37d5eb649f7.slice/crio-cb391fab03e8bd56b4644da9a0436757c6f9d4dbf3fa50846d31bec613645a22 WatchSource:0}: Error finding container cb391fab03e8bd56b4644da9a0436757c6f9d4dbf3fa50846d31bec613645a22: Status 404 returned error can't find the container with id cb391fab03e8bd56b4644da9a0436757c6f9d4dbf3fa50846d31bec613645a22
Jul 27 18:13:36.709272 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:36.709229    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm" event={"ID":"fa7ff22e-0a44-4544-936c-a37d5eb649f7","Type":"ContainerStarted","Data":"13940d66d108ac9a59fdf22cbe485833ba25d7f80ac47a46b244f4989c49b2aa"}
Jul 27 18:13:36.709477 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:36.709330    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm" event={"ID":"fa7ff22e-0a44-4544-936c-a37d5eb649f7","Type":"ContainerStarted","Data":"cb391fab03e8bd56b4644da9a0436757c6f9d4dbf3fa50846d31bec613645a22"}
Jul 27 18:13:36.709477 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:36.709448    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"
Jul 27 18:13:36.725849 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:36.725789    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm" podStartSLOduration=1.725771769 podStartE2EDuration="1.725771769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:13:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:13:36.725147154 +0000 UTC m=+3160.256898140" watchObservedRunningTime="2026-07-27 18:13:36.725771769 +0000 UTC m=+3160.257522757"
Jul 27 18:13:47.718406 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:13:47.718374    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"
Jul 27 18:14:06.238479 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.238437    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"]
Jul 27 18:14:06.238989 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.238708    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm" podUID="fa7ff22e-0a44-4544-936c-a37d5eb649f7" containerName="payload-pre-processing" containerID="cri-o://13940d66d108ac9a59fdf22cbe485833ba25d7f80ac47a46b244f4989c49b2aa" gracePeriod=30
Jul 27 18:14:06.498511 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.498442    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"
Jul 27 18:14:06.666326 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.666295    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa7ff22e-0a44-4544-936c-a37d5eb649f7-plugins-config-volume\") pod \"fa7ff22e-0a44-4544-936c-a37d5eb649f7\" (UID: \"fa7ff22e-0a44-4544-936c-a37d5eb649f7\") "
Jul 27 18:14:06.666528 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.666344    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7cnf\" (UniqueName: \"kubernetes.io/projected/fa7ff22e-0a44-4544-936c-a37d5eb649f7-kube-api-access-x7cnf\") pod \"fa7ff22e-0a44-4544-936c-a37d5eb649f7\" (UID: \"fa7ff22e-0a44-4544-936c-a37d5eb649f7\") "
Jul 27 18:14:06.666677 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.666656    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa7ff22e-0a44-4544-936c-a37d5eb649f7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fa7ff22e-0a44-4544-936c-a37d5eb649f7" (UID: "fa7ff22e-0a44-4544-936c-a37d5eb649f7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:14:06.668515 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.668488    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa7ff22e-0a44-4544-936c-a37d5eb649f7-kube-api-access-x7cnf" (OuterVolumeSpecName: "kube-api-access-x7cnf") pod "fa7ff22e-0a44-4544-936c-a37d5eb649f7" (UID: "fa7ff22e-0a44-4544-936c-a37d5eb649f7"). InnerVolumeSpecName "kube-api-access-x7cnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:14:06.768057 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.767976    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa7ff22e-0a44-4544-936c-a37d5eb649f7-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:14:06.768057 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.768003    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7cnf\" (UniqueName: \"kubernetes.io/projected/fa7ff22e-0a44-4544-936c-a37d5eb649f7-kube-api-access-x7cnf\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:14:06.903146 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.903103    2579 generic.go:356] "Generic (PLEG): container finished" podID="fa7ff22e-0a44-4544-936c-a37d5eb649f7" containerID="13940d66d108ac9a59fdf22cbe485833ba25d7f80ac47a46b244f4989c49b2aa" exitCode=0
Jul 27 18:14:06.903146 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.903148    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"
Jul 27 18:14:06.903360 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.903181    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm" event={"ID":"fa7ff22e-0a44-4544-936c-a37d5eb649f7","Type":"ContainerDied","Data":"13940d66d108ac9a59fdf22cbe485833ba25d7f80ac47a46b244f4989c49b2aa"}
Jul 27 18:14:06.903360 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.903239    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm" event={"ID":"fa7ff22e-0a44-4544-936c-a37d5eb649f7","Type":"ContainerDied","Data":"cb391fab03e8bd56b4644da9a0436757c6f9d4dbf3fa50846d31bec613645a22"}
Jul 27 18:14:06.903360 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.903268    2579 scope.go:117] "RemoveContainer" containerID="13940d66d108ac9a59fdf22cbe485833ba25d7f80ac47a46b244f4989c49b2aa"
Jul 27 18:14:06.922146 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.922125    2579 scope.go:117] "RemoveContainer" containerID="13940d66d108ac9a59fdf22cbe485833ba25d7f80ac47a46b244f4989c49b2aa"
Jul 27 18:14:06.922450 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:14:06.922405    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13940d66d108ac9a59fdf22cbe485833ba25d7f80ac47a46b244f4989c49b2aa\": container with ID starting with 13940d66d108ac9a59fdf22cbe485833ba25d7f80ac47a46b244f4989c49b2aa not found: ID does not exist" containerID="13940d66d108ac9a59fdf22cbe485833ba25d7f80ac47a46b244f4989c49b2aa"
Jul 27 18:14:06.922537 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.922459    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13940d66d108ac9a59fdf22cbe485833ba25d7f80ac47a46b244f4989c49b2aa"} err="failed to get container status \"13940d66d108ac9a59fdf22cbe485833ba25d7f80ac47a46b244f4989c49b2aa\": rpc error: code = NotFound desc = could not find container \"13940d66d108ac9a59fdf22cbe485833ba25d7f80ac47a46b244f4989c49b2aa\": container with ID starting with 13940d66d108ac9a59fdf22cbe485833ba25d7f80ac47a46b244f4989c49b2aa not found: ID does not exist"
Jul 27 18:14:06.931115 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.931092    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"]
Jul 27 18:14:06.933552 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.933534    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e962ab-75c8d744d8-tnqbm"]
Jul 27 18:14:06.993471 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:06.993443    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa7ff22e-0a44-4544-936c-a37d5eb649f7" path="/var/lib/kubelet/pods/fa7ff22e-0a44-4544-936c-a37d5eb649f7/volumes"
Jul 27 18:14:36.244957 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:36.244917    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"]
Jul 27 18:14:36.245584 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:36.245206    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw" podUID="784e785b-0a77-4522-a96e-01cc560cb8a2" containerName="maas-api" containerID="cri-o://5f10dbbc2923ee983e89aa41838fcf6a6fd6bbe4695954c78b452b26037f7f1b" gracePeriod=30
Jul 27 18:14:36.529474 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:36.529447    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"
Jul 27 18:14:36.660786 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:36.660753    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/784e785b-0a77-4522-a96e-01cc560cb8a2-openshift-service-ca\") pod \"784e785b-0a77-4522-a96e-01cc560cb8a2\" (UID: \"784e785b-0a77-4522-a96e-01cc560cb8a2\") "
Jul 27 18:14:36.660965 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:36.660825    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmrcj\" (UniqueName: \"kubernetes.io/projected/784e785b-0a77-4522-a96e-01cc560cb8a2-kube-api-access-mmrcj\") pod \"784e785b-0a77-4522-a96e-01cc560cb8a2\" (UID: \"784e785b-0a77-4522-a96e-01cc560cb8a2\") "
Jul 27 18:14:36.660965 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:36.660854    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/784e785b-0a77-4522-a96e-01cc560cb8a2-maas-api-tls\") pod \"784e785b-0a77-4522-a96e-01cc560cb8a2\" (UID: \"784e785b-0a77-4522-a96e-01cc560cb8a2\") "
Jul 27 18:14:36.661101 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:36.661078    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/784e785b-0a77-4522-a96e-01cc560cb8a2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "784e785b-0a77-4522-a96e-01cc560cb8a2" (UID: "784e785b-0a77-4522-a96e-01cc560cb8a2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:14:36.661252 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:36.661233    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/784e785b-0a77-4522-a96e-01cc560cb8a2-openshift-service-ca\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:14:36.663234 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:36.663199    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/784e785b-0a77-4522-a96e-01cc560cb8a2-kube-api-access-mmrcj" (OuterVolumeSpecName: "kube-api-access-mmrcj") pod "784e785b-0a77-4522-a96e-01cc560cb8a2" (UID: "784e785b-0a77-4522-a96e-01cc560cb8a2"). InnerVolumeSpecName "kube-api-access-mmrcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:14:36.663346 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:36.663273    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/784e785b-0a77-4522-a96e-01cc560cb8a2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "784e785b-0a77-4522-a96e-01cc560cb8a2" (UID: "784e785b-0a77-4522-a96e-01cc560cb8a2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:14:36.762302 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:36.762209    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmrcj\" (UniqueName: \"kubernetes.io/projected/784e785b-0a77-4522-a96e-01cc560cb8a2-kube-api-access-mmrcj\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:14:36.762302 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:36.762243    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/784e785b-0a77-4522-a96e-01cc560cb8a2-maas-api-tls\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:14:37.082494 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:37.082459    2579 generic.go:356] "Generic (PLEG): container finished" podID="784e785b-0a77-4522-a96e-01cc560cb8a2" containerID="5f10dbbc2923ee983e89aa41838fcf6a6fd6bbe4695954c78b452b26037f7f1b" exitCode=0
Jul 27 18:14:37.082674 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:37.082504    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"
Jul 27 18:14:37.082674 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:37.082549    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw" event={"ID":"784e785b-0a77-4522-a96e-01cc560cb8a2","Type":"ContainerDied","Data":"5f10dbbc2923ee983e89aa41838fcf6a6fd6bbe4695954c78b452b26037f7f1b"}
Jul 27 18:14:37.082674 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:37.082602    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw" event={"ID":"784e785b-0a77-4522-a96e-01cc560cb8a2","Type":"ContainerDied","Data":"c82dcbc9874f18e0d289dd86cfdaf01a3640a772805bc6dea092c4f820ca02ec"}
Jul 27 18:14:37.082674 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:37.082625    2579 scope.go:117] "RemoveContainer" containerID="5f10dbbc2923ee983e89aa41838fcf6a6fd6bbe4695954c78b452b26037f7f1b"
Jul 27 18:14:37.092302 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:37.092284    2579 scope.go:117] "RemoveContainer" containerID="5f10dbbc2923ee983e89aa41838fcf6a6fd6bbe4695954c78b452b26037f7f1b"
Jul 27 18:14:37.092575 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:14:37.092552    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f10dbbc2923ee983e89aa41838fcf6a6fd6bbe4695954c78b452b26037f7f1b\": container with ID starting with 5f10dbbc2923ee983e89aa41838fcf6a6fd6bbe4695954c78b452b26037f7f1b not found: ID does not exist" containerID="5f10dbbc2923ee983e89aa41838fcf6a6fd6bbe4695954c78b452b26037f7f1b"
Jul 27 18:14:37.092655 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:37.092582    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f10dbbc2923ee983e89aa41838fcf6a6fd6bbe4695954c78b452b26037f7f1b"} err="failed to get container status \"5f10dbbc2923ee983e89aa41838fcf6a6fd6bbe4695954c78b452b26037f7f1b\": rpc error: code = NotFound desc = could not find container \"5f10dbbc2923ee983e89aa41838fcf6a6fd6bbe4695954c78b452b26037f7f1b\": container with ID starting with 5f10dbbc2923ee983e89aa41838fcf6a6fd6bbe4695954c78b452b26037f7f1b not found: ID does not exist"
Jul 27 18:14:37.101117 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:37.101095    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"]
Jul 27 18:14:37.104447 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:37.104428    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7985e5-5fd95d8c49-qnwkw"]
Jul 27 18:14:38.993788 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:14:38.993752    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="784e785b-0a77-4522-a96e-01cc560cb8a2" path="/var/lib/kubelet/pods/784e785b-0a77-4522-a96e-01cc560cb8a2/volumes"
Jul 27 18:15:28.193503 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:28.193466    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"]
Jul 27 18:15:28.378686 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:28.378618    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz" podUID="f914f563-df5b-47de-86ca-5d186a5da3bc" containerName="istio-proxy" containerID="cri-o://cc46161ac5dfe7cdf8f9c2b8040c3984e3a0c93a5922db580d93cf1f8c6f703f" gracePeriod=30
Jul 27 18:15:33.643103 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.643041    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:15:33.690167 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.690138    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-token\") pod \"f914f563-df5b-47de-86ca-5d186a5da3bc\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") "
Jul 27 18:15:33.690167 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.690184    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-credential-socket\") pod \"f914f563-df5b-47de-86ca-5d186a5da3bc\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") "
Jul 27 18:15:33.690397 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.690210    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-podinfo\") pod \"f914f563-df5b-47de-86ca-5d186a5da3bc\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") "
Jul 27 18:15:33.690397 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.690328    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-workload-socket\") pod \"f914f563-df5b-47de-86ca-5d186a5da3bc\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") "
Jul 27 18:15:33.690397 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.690360    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-workload-certs\") pod \"f914f563-df5b-47de-86ca-5d186a5da3bc\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") "
Jul 27 18:15:33.690397 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.690386    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-envoy\") pod \"f914f563-df5b-47de-86ca-5d186a5da3bc\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") "
Jul 27 18:15:33.690639 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.690436    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f914f563-df5b-47de-86ca-5d186a5da3bc-istiod-ca-cert\") pod \"f914f563-df5b-47de-86ca-5d186a5da3bc\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") "
Jul 27 18:15:33.690639 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.690466    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4t5ms\" (UniqueName: \"kubernetes.io/projected/f914f563-df5b-47de-86ca-5d186a5da3bc-kube-api-access-4t5ms\") pod \"f914f563-df5b-47de-86ca-5d186a5da3bc\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") "
Jul 27 18:15:33.690639 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.690511    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-data\") pod \"f914f563-df5b-47de-86ca-5d186a5da3bc\" (UID: \"f914f563-df5b-47de-86ca-5d186a5da3bc\") "
Jul 27 18:15:33.690639 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.690535    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f914f563-df5b-47de-86ca-5d186a5da3bc" (UID: "f914f563-df5b-47de-86ca-5d186a5da3bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:33.690868 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.690640    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f914f563-df5b-47de-86ca-5d186a5da3bc" (UID: "f914f563-df5b-47de-86ca-5d186a5da3bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:33.690928 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.690870    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f914f563-df5b-47de-86ca-5d186a5da3bc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f914f563-df5b-47de-86ca-5d186a5da3bc" (UID: "f914f563-df5b-47de-86ca-5d186a5da3bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:15:33.690928 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.690889    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-credential-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:33.690928 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.690909    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-workload-certs\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:33.691099 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.690922    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f914f563-df5b-47de-86ca-5d186a5da3bc" (UID: "f914f563-df5b-47de-86ca-5d186a5da3bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:33.691946 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.691916    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-data" (OuterVolumeSpecName: "istio-data") pod "f914f563-df5b-47de-86ca-5d186a5da3bc" (UID: "f914f563-df5b-47de-86ca-5d186a5da3bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:33.692720 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.692694    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f914f563-df5b-47de-86ca-5d186a5da3bc" (UID: "f914f563-df5b-47de-86ca-5d186a5da3bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 18:15:33.692913 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.692876    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f914f563-df5b-47de-86ca-5d186a5da3bc" (UID: "f914f563-df5b-47de-86ca-5d186a5da3bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:33.693122 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.693103    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-token" (OuterVolumeSpecName: "istio-token") pod "f914f563-df5b-47de-86ca-5d186a5da3bc" (UID: "f914f563-df5b-47de-86ca-5d186a5da3bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:15:33.693209 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.693187    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f914f563-df5b-47de-86ca-5d186a5da3bc-kube-api-access-4t5ms" (OuterVolumeSpecName: "kube-api-access-4t5ms") pod "f914f563-df5b-47de-86ca-5d186a5da3bc" (UID: "f914f563-df5b-47de-86ca-5d186a5da3bc"). InnerVolumeSpecName "kube-api-access-4t5ms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:15:33.791969 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.791936    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-token\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:33.791969 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.791965    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-podinfo\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:33.791969 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.791974    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-workload-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:33.792205 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.791981    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-envoy\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:33.792205 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.791993    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f914f563-df5b-47de-86ca-5d186a5da3bc-istiod-ca-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:33.792205 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.792005    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t5ms\" (UniqueName: \"kubernetes.io/projected/f914f563-df5b-47de-86ca-5d186a5da3bc-kube-api-access-4t5ms\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:33.792205 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:33.792018    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f914f563-df5b-47de-86ca-5d186a5da3bc-istio-data\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:34.418711 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:34.418676    2579 generic.go:356] "Generic (PLEG): container finished" podID="f914f563-df5b-47de-86ca-5d186a5da3bc" containerID="cc46161ac5dfe7cdf8f9c2b8040c3984e3a0c93a5922db580d93cf1f8c6f703f" exitCode=0
Jul 27 18:15:34.418888 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:34.418736    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"
Jul 27 18:15:34.418888 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:34.418757    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz" event={"ID":"f914f563-df5b-47de-86ca-5d186a5da3bc","Type":"ContainerDied","Data":"cc46161ac5dfe7cdf8f9c2b8040c3984e3a0c93a5922db580d93cf1f8c6f703f"}
Jul 27 18:15:34.418888 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:34.418841    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz" event={"ID":"f914f563-df5b-47de-86ca-5d186a5da3bc","Type":"ContainerDied","Data":"4ffb97db1b00a33679a3f785685a109bd4c682e7654720a54da3eb9814f11cef"}
Jul 27 18:15:34.418888 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:34.418868    2579 scope.go:117] "RemoveContainer" containerID="cc46161ac5dfe7cdf8f9c2b8040c3984e3a0c93a5922db580d93cf1f8c6f703f"
Jul 27 18:15:34.429137 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:34.429121    2579 scope.go:117] "RemoveContainer" containerID="c967c606995af46abfb710ab7a22cdebf5ef1b6f51be186c6d0bff2a574482a0"
Jul 27 18:15:34.437255 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:34.437237    2579 scope.go:117] "RemoveContainer" containerID="cc46161ac5dfe7cdf8f9c2b8040c3984e3a0c93a5922db580d93cf1f8c6f703f"
Jul 27 18:15:34.437589 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:15:34.437551    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc46161ac5dfe7cdf8f9c2b8040c3984e3a0c93a5922db580d93cf1f8c6f703f\": container with ID starting with cc46161ac5dfe7cdf8f9c2b8040c3984e3a0c93a5922db580d93cf1f8c6f703f not found: ID does not exist" containerID="cc46161ac5dfe7cdf8f9c2b8040c3984e3a0c93a5922db580d93cf1f8c6f703f"
Jul 27 18:15:34.437691 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:34.437588    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc46161ac5dfe7cdf8f9c2b8040c3984e3a0c93a5922db580d93cf1f8c6f703f"} err="failed to get container status \"cc46161ac5dfe7cdf8f9c2b8040c3984e3a0c93a5922db580d93cf1f8c6f703f\": rpc error: code = NotFound desc = could not find container \"cc46161ac5dfe7cdf8f9c2b8040c3984e3a0c93a5922db580d93cf1f8c6f703f\": container with ID starting with cc46161ac5dfe7cdf8f9c2b8040c3984e3a0c93a5922db580d93cf1f8c6f703f not found: ID does not exist"
Jul 27 18:15:34.437691 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:34.437634    2579 scope.go:117] "RemoveContainer" containerID="c967c606995af46abfb710ab7a22cdebf5ef1b6f51be186c6d0bff2a574482a0"
Jul 27 18:15:34.438078 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:15:34.438057    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c967c606995af46abfb710ab7a22cdebf5ef1b6f51be186c6d0bff2a574482a0\": container with ID starting with c967c606995af46abfb710ab7a22cdebf5ef1b6f51be186c6d0bff2a574482a0 not found: ID does not exist" containerID="c967c606995af46abfb710ab7a22cdebf5ef1b6f51be186c6d0bff2a574482a0"
Jul 27 18:15:34.438193 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:34.438084    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c967c606995af46abfb710ab7a22cdebf5ef1b6f51be186c6d0bff2a574482a0"} err="failed to get container status \"c967c606995af46abfb710ab7a22cdebf5ef1b6f51be186c6d0bff2a574482a0\": rpc error: code = NotFound desc = could not find container \"c967c606995af46abfb710ab7a22cdebf5ef1b6f51be186c6d0bff2a574482a0\": container with ID starting with c967c606995af46abfb710ab7a22cdebf5ef1b6f51be186c6d0bff2a574482a0 not found: ID does not exist"
Jul 27 18:15:34.440850 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:34.440829    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"]
Jul 27 18:15:34.444188 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:34.444168    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-7985e5-openshift-default-59bb89577b-xrhsz"]
Jul 27 18:15:34.993093 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:34.993057    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f914f563-df5b-47de-86ca-5d186a5da3bc" path="/var/lib/kubelet/pods/f914f563-df5b-47de-86ca-5d186a5da3bc/volumes"
Jul 27 18:15:39.077805 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.077768    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"]
Jul 27 18:15:39.078401 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.078016    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg" podUID="29dc3b6c-a730-4a25-a836-f0004cfb2b44" containerName="payload-pre-processing" containerID="cri-o://73d4a5c725f89e2d925a141d91cc92caf85c1e680310c3c7c2d7d3a959471a08" gracePeriod=30
Jul 27 18:15:39.346319 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.346295    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"
Jul 27 18:15:39.439102 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.439061    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdltp\" (UniqueName: \"kubernetes.io/projected/29dc3b6c-a730-4a25-a836-f0004cfb2b44-kube-api-access-rdltp\") pod \"29dc3b6c-a730-4a25-a836-f0004cfb2b44\" (UID: \"29dc3b6c-a730-4a25-a836-f0004cfb2b44\") "
Jul 27 18:15:39.439301 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.439168    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29dc3b6c-a730-4a25-a836-f0004cfb2b44-plugins-config-volume\") pod \"29dc3b6c-a730-4a25-a836-f0004cfb2b44\" (UID: \"29dc3b6c-a730-4a25-a836-f0004cfb2b44\") "
Jul 27 18:15:39.439604 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.439571    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29dc3b6c-a730-4a25-a836-f0004cfb2b44-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "29dc3b6c-a730-4a25-a836-f0004cfb2b44" (UID: "29dc3b6c-a730-4a25-a836-f0004cfb2b44"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:15:39.441337 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.441312    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29dc3b6c-a730-4a25-a836-f0004cfb2b44-kube-api-access-rdltp" (OuterVolumeSpecName: "kube-api-access-rdltp") pod "29dc3b6c-a730-4a25-a836-f0004cfb2b44" (UID: "29dc3b6c-a730-4a25-a836-f0004cfb2b44"). InnerVolumeSpecName "kube-api-access-rdltp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:15:39.449763 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.449737    2579 generic.go:356] "Generic (PLEG): container finished" podID="29dc3b6c-a730-4a25-a836-f0004cfb2b44" containerID="73d4a5c725f89e2d925a141d91cc92caf85c1e680310c3c7c2d7d3a959471a08" exitCode=0
Jul 27 18:15:39.449864 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.449775    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg" event={"ID":"29dc3b6c-a730-4a25-a836-f0004cfb2b44","Type":"ContainerDied","Data":"73d4a5c725f89e2d925a141d91cc92caf85c1e680310c3c7c2d7d3a959471a08"}
Jul 27 18:15:39.449864 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.449791    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"
Jul 27 18:15:39.449864 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.449842    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg" event={"ID":"29dc3b6c-a730-4a25-a836-f0004cfb2b44","Type":"ContainerDied","Data":"65cd60ad5bdfc33abad4641bf4b62169b31836169036c0eb4d6cb81b290e8ee1"}
Jul 27 18:15:39.449864 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.449863    2579 scope.go:117] "RemoveContainer" containerID="73d4a5c725f89e2d925a141d91cc92caf85c1e680310c3c7c2d7d3a959471a08"
Jul 27 18:15:39.459351 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.459334    2579 scope.go:117] "RemoveContainer" containerID="73d4a5c725f89e2d925a141d91cc92caf85c1e680310c3c7c2d7d3a959471a08"
Jul 27 18:15:39.459616 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:15:39.459597    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73d4a5c725f89e2d925a141d91cc92caf85c1e680310c3c7c2d7d3a959471a08\": container with ID starting with 73d4a5c725f89e2d925a141d91cc92caf85c1e680310c3c7c2d7d3a959471a08 not found: ID does not exist" containerID="73d4a5c725f89e2d925a141d91cc92caf85c1e680310c3c7c2d7d3a959471a08"
Jul 27 18:15:39.459683 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.459629    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73d4a5c725f89e2d925a141d91cc92caf85c1e680310c3c7c2d7d3a959471a08"} err="failed to get container status \"73d4a5c725f89e2d925a141d91cc92caf85c1e680310c3c7c2d7d3a959471a08\": rpc error: code = NotFound desc = could not find container \"73d4a5c725f89e2d925a141d91cc92caf85c1e680310c3c7c2d7d3a959471a08\": container with ID starting with 73d4a5c725f89e2d925a141d91cc92caf85c1e680310c3c7c2d7d3a959471a08 not found: ID does not exist"
Jul 27 18:15:39.470127 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.470108    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"]
Jul 27 18:15:39.474014 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.473985    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-fbef1a-85f9787b4-t9sdg"]
Jul 27 18:15:39.540068 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.540038    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29dc3b6c-a730-4a25-a836-f0004cfb2b44-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:39.540068 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:39.540064    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdltp\" (UniqueName: \"kubernetes.io/projected/29dc3b6c-a730-4a25-a836-f0004cfb2b44-kube-api-access-rdltp\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:40.993822 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:40.993789    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29dc3b6c-a730-4a25-a836-f0004cfb2b44" path="/var/lib/kubelet/pods/29dc3b6c-a730-4a25-a836-f0004cfb2b44/volumes"
Jul 27 18:15:50.666690 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:50.666655    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"]
Jul 27 18:15:50.667167 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:50.666911    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct" podUID="fd2ad129-a309-4731-baf1-8f9caa24cd5e" containerName="istio-proxy" containerID="cri-o://d65bf744bb7d5523da056b8d708ecdc025ef7177e87a44aeb89ab4568c4e474a" gracePeriod=30
Jul 27 18:15:55.926775 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.926750    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:15:55.997095 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.996988    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-podinfo\") pod \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") "
Jul 27 18:15:55.997095 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.997021    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-workload-certs\") pod \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") "
Jul 27 18:15:55.997095 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.997044    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istiod-ca-cert\") pod \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") "
Jul 27 18:15:55.997095 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.997066    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-envoy\") pod \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") "
Jul 27 18:15:55.997632 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.997113    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-token\") pod \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") "
Jul 27 18:15:55.997632 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.997167    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-workload-socket\") pod \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") "
Jul 27 18:15:55.997632 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.997210    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm94p\" (UniqueName: \"kubernetes.io/projected/fd2ad129-a309-4731-baf1-8f9caa24cd5e-kube-api-access-nm94p\") pod \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") "
Jul 27 18:15:55.997632 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.997274    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-credential-socket\") pod \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") "
Jul 27 18:15:55.997632 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.997297    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-data\") pod \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\" (UID: \"fd2ad129-a309-4731-baf1-8f9caa24cd5e\") "
Jul 27 18:15:55.997632 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.997490    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fd2ad129-a309-4731-baf1-8f9caa24cd5e" (UID: "fd2ad129-a309-4731-baf1-8f9caa24cd5e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:15:55.997950 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.997654    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fd2ad129-a309-4731-baf1-8f9caa24cd5e" (UID: "fd2ad129-a309-4731-baf1-8f9caa24cd5e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:55.997950 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.997680    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fd2ad129-a309-4731-baf1-8f9caa24cd5e" (UID: "fd2ad129-a309-4731-baf1-8f9caa24cd5e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:55.997950 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.997722    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istiod-ca-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:55.997950 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.997803    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fd2ad129-a309-4731-baf1-8f9caa24cd5e" (UID: "fd2ad129-a309-4731-baf1-8f9caa24cd5e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:55.998659 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.998621    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-data" (OuterVolumeSpecName: "istio-data") pod "fd2ad129-a309-4731-baf1-8f9caa24cd5e" (UID: "fd2ad129-a309-4731-baf1-8f9caa24cd5e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:55.999583 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.999558    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fd2ad129-a309-4731-baf1-8f9caa24cd5e" (UID: "fd2ad129-a309-4731-baf1-8f9caa24cd5e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 18:15:55.999700 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.999645    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fd2ad129-a309-4731-baf1-8f9caa24cd5e" (UID: "fd2ad129-a309-4731-baf1-8f9caa24cd5e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:15:55.999700 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.999676    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-token" (OuterVolumeSpecName: "istio-token") pod "fd2ad129-a309-4731-baf1-8f9caa24cd5e" (UID: "fd2ad129-a309-4731-baf1-8f9caa24cd5e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:15:55.999881 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:55.999860    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd2ad129-a309-4731-baf1-8f9caa24cd5e-kube-api-access-nm94p" (OuterVolumeSpecName: "kube-api-access-nm94p") pod "fd2ad129-a309-4731-baf1-8f9caa24cd5e" (UID: "fd2ad129-a309-4731-baf1-8f9caa24cd5e"). InnerVolumeSpecName "kube-api-access-nm94p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:15:56.098252 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.098218    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-envoy\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:56.098252 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.098245    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-token\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:56.098252 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.098254    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-workload-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:56.098530 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.098263    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm94p\" (UniqueName: \"kubernetes.io/projected/fd2ad129-a309-4731-baf1-8f9caa24cd5e-kube-api-access-nm94p\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:56.098530 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.098272    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-credential-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:56.098530 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.098281    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-data\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:56.098530 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.098288    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd2ad129-a309-4731-baf1-8f9caa24cd5e-istio-podinfo\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:56.098530 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.098296    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd2ad129-a309-4731-baf1-8f9caa24cd5e-workload-certs\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:15:56.552092 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.552060    2579 generic.go:356] "Generic (PLEG): container finished" podID="fd2ad129-a309-4731-baf1-8f9caa24cd5e" containerID="d65bf744bb7d5523da056b8d708ecdc025ef7177e87a44aeb89ab4568c4e474a" exitCode=0
Jul 27 18:15:56.552259 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.552107    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"
Jul 27 18:15:56.552259 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.552138    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct" event={"ID":"fd2ad129-a309-4731-baf1-8f9caa24cd5e","Type":"ContainerDied","Data":"d65bf744bb7d5523da056b8d708ecdc025ef7177e87a44aeb89ab4568c4e474a"}
Jul 27 18:15:56.552259 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.552195    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct" event={"ID":"fd2ad129-a309-4731-baf1-8f9caa24cd5e","Type":"ContainerDied","Data":"763682ff5f95bb04878fec1d8716adbf76ccb2247a62bedad87aa2a5d709cde7"}
Jul 27 18:15:56.552259 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.552219    2579 scope.go:117] "RemoveContainer" containerID="d65bf744bb7d5523da056b8d708ecdc025ef7177e87a44aeb89ab4568c4e474a"
Jul 27 18:15:56.562018 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.562001    2579 scope.go:117] "RemoveContainer" containerID="1548636644e3928565035d4ac8704d8d8b6ed096a3ddd8934c17433e14a709b7"
Jul 27 18:15:56.570016 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.570001    2579 scope.go:117] "RemoveContainer" containerID="d65bf744bb7d5523da056b8d708ecdc025ef7177e87a44aeb89ab4568c4e474a"
Jul 27 18:15:56.570257 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:15:56.570241    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d65bf744bb7d5523da056b8d708ecdc025ef7177e87a44aeb89ab4568c4e474a\": container with ID starting with d65bf744bb7d5523da056b8d708ecdc025ef7177e87a44aeb89ab4568c4e474a not found: ID does not exist" containerID="d65bf744bb7d5523da056b8d708ecdc025ef7177e87a44aeb89ab4568c4e474a"
Jul 27 18:15:56.570297 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.570265    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65bf744bb7d5523da056b8d708ecdc025ef7177e87a44aeb89ab4568c4e474a"} err="failed to get container status \"d65bf744bb7d5523da056b8d708ecdc025ef7177e87a44aeb89ab4568c4e474a\": rpc error: code = NotFound desc = could not find container \"d65bf744bb7d5523da056b8d708ecdc025ef7177e87a44aeb89ab4568c4e474a\": container with ID starting with d65bf744bb7d5523da056b8d708ecdc025ef7177e87a44aeb89ab4568c4e474a not found: ID does not exist"
Jul 27 18:15:56.570297 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.570280    2579 scope.go:117] "RemoveContainer" containerID="1548636644e3928565035d4ac8704d8d8b6ed096a3ddd8934c17433e14a709b7"
Jul 27 18:15:56.570510 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:15:56.570493    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1548636644e3928565035d4ac8704d8d8b6ed096a3ddd8934c17433e14a709b7\": container with ID starting with 1548636644e3928565035d4ac8704d8d8b6ed096a3ddd8934c17433e14a709b7 not found: ID does not exist" containerID="1548636644e3928565035d4ac8704d8d8b6ed096a3ddd8934c17433e14a709b7"
Jul 27 18:15:56.570552 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.570515    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1548636644e3928565035d4ac8704d8d8b6ed096a3ddd8934c17433e14a709b7"} err="failed to get container status \"1548636644e3928565035d4ac8704d8d8b6ed096a3ddd8934c17433e14a709b7\": rpc error: code = NotFound desc = could not find container \"1548636644e3928565035d4ac8704d8d8b6ed096a3ddd8934c17433e14a709b7\": container with ID starting with 1548636644e3928565035d4ac8704d8d8b6ed096a3ddd8934c17433e14a709b7 not found: ID does not exist"
Jul 27 18:15:56.574025 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.574004    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"]
Jul 27 18:15:56.577756 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.577736    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct"]
Jul 27 18:15:56.879621 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.879539    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 18:15:56.879774 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.879619    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-fbef1a-openshift-default-5c955bcd5d-6qrct" podUID="fd2ad129-a309-4731-baf1-8f9caa24cd5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 18:15:56.997290 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:15:56.997257    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd2ad129-a309-4731-baf1-8f9caa24cd5e" path="/var/lib/kubelet/pods/fd2ad129-a309-4731-baf1-8f9caa24cd5e/volumes"
Jul 27 18:16:03.256166 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.255548    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"]
Jul 27 18:16:03.256166 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.255859    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx" podUID="f2b8a5b7-a11d-4a71-a5cb-2ffa08644085" containerName="maas-api" containerID="cri-o://107a2104be0e2bb688e3f474cb30998e20d99aa3a44c65604b42a9225fbcfeb4" gracePeriod=30
Jul 27 18:16:03.370776 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.370727    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"]
Jul 27 18:16:03.371904 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.371625    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv" podUID="e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d" containerName="payload-pre-processing" containerID="cri-o://e0afe8c3e3a536ae8f2728c20aae5996e09964ed3ad7d1b63ea58e73285af760" gracePeriod=30
Jul 27 18:16:03.543093 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.543064    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"
Jul 27 18:16:03.592839 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.592761    2579 generic.go:356] "Generic (PLEG): container finished" podID="e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d" containerID="e0afe8c3e3a536ae8f2728c20aae5996e09964ed3ad7d1b63ea58e73285af760" exitCode=0
Jul 27 18:16:03.592839 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.592806    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv" event={"ID":"e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d","Type":"ContainerDied","Data":"e0afe8c3e3a536ae8f2728c20aae5996e09964ed3ad7d1b63ea58e73285af760"}
Jul 27 18:16:03.594515 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.594486    2579 generic.go:356] "Generic (PLEG): container finished" podID="f2b8a5b7-a11d-4a71-a5cb-2ffa08644085" containerID="107a2104be0e2bb688e3f474cb30998e20d99aa3a44c65604b42a9225fbcfeb4" exitCode=0
Jul 27 18:16:03.594703 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.594543    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"
Jul 27 18:16:03.594819 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.594579    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx" event={"ID":"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085","Type":"ContainerDied","Data":"107a2104be0e2bb688e3f474cb30998e20d99aa3a44c65604b42a9225fbcfeb4"}
Jul 27 18:16:03.594886 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.594868    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx" event={"ID":"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085","Type":"ContainerDied","Data":"15c7b11fe4ae2a5f0298f6c97a59878525970e655138b7763c5948b6b4fed1c4"}
Jul 27 18:16:03.594933 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.594910    2579 scope.go:117] "RemoveContainer" containerID="107a2104be0e2bb688e3f474cb30998e20d99aa3a44c65604b42a9225fbcfeb4"
Jul 27 18:16:03.604493 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.604469    2579 scope.go:117] "RemoveContainer" containerID="107a2104be0e2bb688e3f474cb30998e20d99aa3a44c65604b42a9225fbcfeb4"
Jul 27 18:16:03.604791 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:16:03.604770    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"107a2104be0e2bb688e3f474cb30998e20d99aa3a44c65604b42a9225fbcfeb4\": container with ID starting with 107a2104be0e2bb688e3f474cb30998e20d99aa3a44c65604b42a9225fbcfeb4 not found: ID does not exist" containerID="107a2104be0e2bb688e3f474cb30998e20d99aa3a44c65604b42a9225fbcfeb4"
Jul 27 18:16:03.604884 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.604798    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"107a2104be0e2bb688e3f474cb30998e20d99aa3a44c65604b42a9225fbcfeb4"} err="failed to get container status \"107a2104be0e2bb688e3f474cb30998e20d99aa3a44c65604b42a9225fbcfeb4\": rpc error: code = NotFound desc = could not find container \"107a2104be0e2bb688e3f474cb30998e20d99aa3a44c65604b42a9225fbcfeb4\": container with ID starting with 107a2104be0e2bb688e3f474cb30998e20d99aa3a44c65604b42a9225fbcfeb4 not found: ID does not exist"
Jul 27 18:16:03.657362 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.657340    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"
Jul 27 18:16:03.666430 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.666392    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-openshift-service-ca\") pod \"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085\" (UID: \"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085\") "
Jul 27 18:16:03.666555 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.666487    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-maas-api-tls\") pod \"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085\" (UID: \"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085\") "
Jul 27 18:16:03.666555 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.666519    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46gzj\" (UniqueName: \"kubernetes.io/projected/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-kube-api-access-46gzj\") pod \"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085\" (UID: \"f2b8a5b7-a11d-4a71-a5cb-2ffa08644085\") "
Jul 27 18:16:03.666770 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.666747    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f2b8a5b7-a11d-4a71-a5cb-2ffa08644085" (UID: "f2b8a5b7-a11d-4a71-a5cb-2ffa08644085"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:16:03.668566 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.668544    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f2b8a5b7-a11d-4a71-a5cb-2ffa08644085" (UID: "f2b8a5b7-a11d-4a71-a5cb-2ffa08644085"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:16:03.668712 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.668695    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-kube-api-access-46gzj" (OuterVolumeSpecName: "kube-api-access-46gzj") pod "f2b8a5b7-a11d-4a71-a5cb-2ffa08644085" (UID: "f2b8a5b7-a11d-4a71-a5cb-2ffa08644085"). InnerVolumeSpecName "kube-api-access-46gzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:16:03.767353 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.767323    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxgvz\" (UniqueName: \"kubernetes.io/projected/e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d-kube-api-access-wxgvz\") pod \"e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d\" (UID: \"e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d\") "
Jul 27 18:16:03.767544 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.767370    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d-plugins-config-volume\") pod \"e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d\" (UID: \"e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d\") "
Jul 27 18:16:03.767654 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.767640    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-openshift-service-ca\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:03.767695 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.767658    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-maas-api-tls\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:03.767695 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.767668    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46gzj\" (UniqueName: \"kubernetes.io/projected/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085-kube-api-access-46gzj\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:03.767761 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.767713    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d" (UID: "e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:16:03.769583 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.769558    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d-kube-api-access-wxgvz" (OuterVolumeSpecName: "kube-api-access-wxgvz") pod "e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d" (UID: "e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d"). InnerVolumeSpecName "kube-api-access-wxgvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:16:03.868438 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.868391    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxgvz\" (UniqueName: \"kubernetes.io/projected/e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d-kube-api-access-wxgvz\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:03.868438 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.868434    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:03.917247 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.917215    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"]
Jul 27 18:16:03.922412 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:03.922385    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1aa3ff-649cbcb86d-xfpdx"]
Jul 27 18:16:04.602221 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:04.602127    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv" event={"ID":"e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d","Type":"ContainerDied","Data":"43b122e9e6236cf6d9ac274126a31272fd998ff733f87af0e3aacb666b10279a"}
Jul 27 18:16:04.602221 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:04.602160    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"
Jul 27 18:16:04.602221 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:04.602212    2579 scope.go:117] "RemoveContainer" containerID="e0afe8c3e3a536ae8f2728c20aae5996e09964ed3ad7d1b63ea58e73285af760"
Jul 27 18:16:04.623811 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:04.623784    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"]
Jul 27 18:16:04.629023 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:04.628994    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-1aa3ff-85dcd4fffb-kmbvv"]
Jul 27 18:16:04.994458 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:04.994357    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d" path="/var/lib/kubelet/pods/e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d/volumes"
Jul 27 18:16:04.994760 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:04.994747    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2b8a5b7-a11d-4a71-a5cb-2ffa08644085" path="/var/lib/kubelet/pods/f2b8a5b7-a11d-4a71-a5cb-2ffa08644085/volumes"
Jul 27 18:16:23.946799 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:23.946710    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"]
Jul 27 18:16:23.947305 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:23.946984    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7" podUID="959f995a-b202-43c3-a1c6-e878004984f2" containerName="payload-processing" containerID="cri-o://b8833c0af8948f04c9898c22d51a55ba9f6bd25ec3fb8f21c1782e8560c4f107" gracePeriod=30
Jul 27 18:16:23.954331 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:23.954299    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"]
Jul 27 18:16:23.954752 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:23.954714    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr" podUID="9659f9ca-f3ec-44ed-9cd4-844dfabd341e" containerName="payload-pre-processing" containerID="cri-o://1ec0bd0f6e1f769eac7dc94349de1e7c2c00291ed93d66896e9f2ab96b36a903" gracePeriod=30
Jul 27 18:16:24.221382 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.221356    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"
Jul 27 18:16:24.254442 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.254394    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"
Jul 27 18:16:24.257395 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.257369    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2b27\" (UniqueName: \"kubernetes.io/projected/959f995a-b202-43c3-a1c6-e878004984f2-kube-api-access-b2b27\") pod \"959f995a-b202-43c3-a1c6-e878004984f2\" (UID: \"959f995a-b202-43c3-a1c6-e878004984f2\") "
Jul 27 18:16:24.257604 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.257568    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/959f995a-b202-43c3-a1c6-e878004984f2-plugins-config-volume\") pod \"959f995a-b202-43c3-a1c6-e878004984f2\" (UID: \"959f995a-b202-43c3-a1c6-e878004984f2\") "
Jul 27 18:16:24.257953 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.257919    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/959f995a-b202-43c3-a1c6-e878004984f2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "959f995a-b202-43c3-a1c6-e878004984f2" (UID: "959f995a-b202-43c3-a1c6-e878004984f2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:16:24.259613 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.259571    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/959f995a-b202-43c3-a1c6-e878004984f2-kube-api-access-b2b27" (OuterVolumeSpecName: "kube-api-access-b2b27") pod "959f995a-b202-43c3-a1c6-e878004984f2" (UID: "959f995a-b202-43c3-a1c6-e878004984f2"). InnerVolumeSpecName "kube-api-access-b2b27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:16:24.358832 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.358801    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9659f9ca-f3ec-44ed-9cd4-844dfabd341e-plugins-config-volume\") pod \"9659f9ca-f3ec-44ed-9cd4-844dfabd341e\" (UID: \"9659f9ca-f3ec-44ed-9cd4-844dfabd341e\") "
Jul 27 18:16:24.358995 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.358846    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsx8c\" (UniqueName: \"kubernetes.io/projected/9659f9ca-f3ec-44ed-9cd4-844dfabd341e-kube-api-access-lsx8c\") pod \"9659f9ca-f3ec-44ed-9cd4-844dfabd341e\" (UID: \"9659f9ca-f3ec-44ed-9cd4-844dfabd341e\") "
Jul 27 18:16:24.358995 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.358984    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/959f995a-b202-43c3-a1c6-e878004984f2-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:24.359071 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.358996    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2b27\" (UniqueName: \"kubernetes.io/projected/959f995a-b202-43c3-a1c6-e878004984f2-kube-api-access-b2b27\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:24.359182 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.359160    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9659f9ca-f3ec-44ed-9cd4-844dfabd341e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9659f9ca-f3ec-44ed-9cd4-844dfabd341e" (UID: "9659f9ca-f3ec-44ed-9cd4-844dfabd341e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:16:24.361087 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.361067    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9659f9ca-f3ec-44ed-9cd4-844dfabd341e-kube-api-access-lsx8c" (OuterVolumeSpecName: "kube-api-access-lsx8c") pod "9659f9ca-f3ec-44ed-9cd4-844dfabd341e" (UID: "9659f9ca-f3ec-44ed-9cd4-844dfabd341e"). InnerVolumeSpecName "kube-api-access-lsx8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:16:24.459717 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.459635    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9659f9ca-f3ec-44ed-9cd4-844dfabd341e-plugins-config-volume\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:24.459717 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.459667    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsx8c\" (UniqueName: \"kubernetes.io/projected/9659f9ca-f3ec-44ed-9cd4-844dfabd341e-kube-api-access-lsx8c\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:24.723868 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.723782    2579 generic.go:356] "Generic (PLEG): container finished" podID="9659f9ca-f3ec-44ed-9cd4-844dfabd341e" containerID="1ec0bd0f6e1f769eac7dc94349de1e7c2c00291ed93d66896e9f2ab96b36a903" exitCode=0
Jul 27 18:16:24.723868 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.723836    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"
Jul 27 18:16:24.724109 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.723887    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr" event={"ID":"9659f9ca-f3ec-44ed-9cd4-844dfabd341e","Type":"ContainerDied","Data":"1ec0bd0f6e1f769eac7dc94349de1e7c2c00291ed93d66896e9f2ab96b36a903"}
Jul 27 18:16:24.724109 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.723959    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr" event={"ID":"9659f9ca-f3ec-44ed-9cd4-844dfabd341e","Type":"ContainerDied","Data":"fa2591495b45fcf6490c21f3d3d736c155384714dd7d1a3d1dd9053bf3a05134"}
Jul 27 18:16:24.724109 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.723993    2579 scope.go:117] "RemoveContainer" containerID="1ec0bd0f6e1f769eac7dc94349de1e7c2c00291ed93d66896e9f2ab96b36a903"
Jul 27 18:16:24.725501 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.725479    2579 generic.go:356] "Generic (PLEG): container finished" podID="959f995a-b202-43c3-a1c6-e878004984f2" containerID="b8833c0af8948f04c9898c22d51a55ba9f6bd25ec3fb8f21c1782e8560c4f107" exitCode=0
Jul 27 18:16:24.725653 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.725531    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"
Jul 27 18:16:24.725653 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.725544    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7" event={"ID":"959f995a-b202-43c3-a1c6-e878004984f2","Type":"ContainerDied","Data":"b8833c0af8948f04c9898c22d51a55ba9f6bd25ec3fb8f21c1782e8560c4f107"}
Jul 27 18:16:24.725653 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.725603    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7" event={"ID":"959f995a-b202-43c3-a1c6-e878004984f2","Type":"ContainerDied","Data":"8ea14bae258708ec4eb3accee137798c29df7d1dd43f5479c2b382872c99bb82"}
Jul 27 18:16:24.734577 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.734554    2579 scope.go:117] "RemoveContainer" containerID="1ec0bd0f6e1f769eac7dc94349de1e7c2c00291ed93d66896e9f2ab96b36a903"
Jul 27 18:16:24.734850 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:16:24.734831    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ec0bd0f6e1f769eac7dc94349de1e7c2c00291ed93d66896e9f2ab96b36a903\": container with ID starting with 1ec0bd0f6e1f769eac7dc94349de1e7c2c00291ed93d66896e9f2ab96b36a903 not found: ID does not exist" containerID="1ec0bd0f6e1f769eac7dc94349de1e7c2c00291ed93d66896e9f2ab96b36a903"
Jul 27 18:16:24.734928 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.734854    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ec0bd0f6e1f769eac7dc94349de1e7c2c00291ed93d66896e9f2ab96b36a903"} err="failed to get container status \"1ec0bd0f6e1f769eac7dc94349de1e7c2c00291ed93d66896e9f2ab96b36a903\": rpc error: code = NotFound desc = could not find container \"1ec0bd0f6e1f769eac7dc94349de1e7c2c00291ed93d66896e9f2ab96b36a903\": container with ID starting with 1ec0bd0f6e1f769eac7dc94349de1e7c2c00291ed93d66896e9f2ab96b36a903 not found: ID does not exist"
Jul 27 18:16:24.734928 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.734869    2579 scope.go:117] "RemoveContainer" containerID="b8833c0af8948f04c9898c22d51a55ba9f6bd25ec3fb8f21c1782e8560c4f107"
Jul 27 18:16:24.743410 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.743394    2579 scope.go:117] "RemoveContainer" containerID="b8833c0af8948f04c9898c22d51a55ba9f6bd25ec3fb8f21c1782e8560c4f107"
Jul 27 18:16:24.743767 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:16:24.743743    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8833c0af8948f04c9898c22d51a55ba9f6bd25ec3fb8f21c1782e8560c4f107\": container with ID starting with b8833c0af8948f04c9898c22d51a55ba9f6bd25ec3fb8f21c1782e8560c4f107 not found: ID does not exist" containerID="b8833c0af8948f04c9898c22d51a55ba9f6bd25ec3fb8f21c1782e8560c4f107"
Jul 27 18:16:24.743831 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.743777    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8833c0af8948f04c9898c22d51a55ba9f6bd25ec3fb8f21c1782e8560c4f107"} err="failed to get container status \"b8833c0af8948f04c9898c22d51a55ba9f6bd25ec3fb8f21c1782e8560c4f107\": rpc error: code = NotFound desc = could not find container \"b8833c0af8948f04c9898c22d51a55ba9f6bd25ec3fb8f21c1782e8560c4f107\": container with ID starting with b8833c0af8948f04c9898c22d51a55ba9f6bd25ec3fb8f21c1782e8560c4f107 not found: ID does not exist"
Jul 27 18:16:24.748010 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.747989    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"]
Jul 27 18:16:24.751550 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.751529    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-ed5396-7bccbd4d5d-xdpn7"]
Jul 27 18:16:24.760728 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.760707    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"]
Jul 27 18:16:24.766685 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.766661    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-ed5396-869fc9d6b4-wt7jr"]
Jul 27 18:16:24.993748 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.993667    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="959f995a-b202-43c3-a1c6-e878004984f2" path="/var/lib/kubelet/pods/959f995a-b202-43c3-a1c6-e878004984f2/volumes"
Jul 27 18:16:24.994081 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:24.994026    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9659f9ca-f3ec-44ed-9cd4-844dfabd341e" path="/var/lib/kubelet/pods/9659f9ca-f3ec-44ed-9cd4-844dfabd341e/volumes"
Jul 27 18:16:35.502653 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:35.502616    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"]
Jul 27 18:16:35.503217 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:35.502877    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv" podUID="62285ca6-2701-4321-a768-1b3c502628f9" containerName="istio-proxy" containerID="cri-o://5670f75170071fa26e91e372851bace071fe216fd918d6f67796068f21f9b1fb" gracePeriod=30
Jul 27 18:16:38.404398 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:38.404361    2579 patch_prober.go:28] interesting pod/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 18:16:38.404771 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:38.404461    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv" podUID="62285ca6-2701-4321-a768-1b3c502628f9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 18:16:40.755317 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.755293    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:16:40.805467 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.805411    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-workload-socket\") pod \"62285ca6-2701-4321-a768-1b3c502628f9\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") "
Jul 27 18:16:40.805628 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.805486    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62285ca6-2701-4321-a768-1b3c502628f9-istiod-ca-cert\") pod \"62285ca6-2701-4321-a768-1b3c502628f9\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") "
Jul 27 18:16:40.805628 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.805510    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-istio-envoy\") pod \"62285ca6-2701-4321-a768-1b3c502628f9\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") "
Jul 27 18:16:40.805628 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.805539    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-workload-certs\") pod \"62285ca6-2701-4321-a768-1b3c502628f9\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") "
Jul 27 18:16:40.805628 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.805564    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-istio-data\") pod \"62285ca6-2701-4321-a768-1b3c502628f9\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") "
Jul 27 18:16:40.805628 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.805611    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl5mj\" (UniqueName: \"kubernetes.io/projected/62285ca6-2701-4321-a768-1b3c502628f9-kube-api-access-pl5mj\") pod \"62285ca6-2701-4321-a768-1b3c502628f9\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") "
Jul 27 18:16:40.805894 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.805630    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "62285ca6-2701-4321-a768-1b3c502628f9" (UID: "62285ca6-2701-4321-a768-1b3c502628f9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:16:40.805894 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.805665    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62285ca6-2701-4321-a768-1b3c502628f9-istio-podinfo\") pod \"62285ca6-2701-4321-a768-1b3c502628f9\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") "
Jul 27 18:16:40.805894 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.805697    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62285ca6-2701-4321-a768-1b3c502628f9-istio-token\") pod \"62285ca6-2701-4321-a768-1b3c502628f9\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") "
Jul 27 18:16:40.805894 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.805743    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-credential-socket\") pod \"62285ca6-2701-4321-a768-1b3c502628f9\" (UID: \"62285ca6-2701-4321-a768-1b3c502628f9\") "
Jul 27 18:16:40.805894 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.805854    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "62285ca6-2701-4321-a768-1b3c502628f9" (UID: "62285ca6-2701-4321-a768-1b3c502628f9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:16:40.806152 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.805910    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62285ca6-2701-4321-a768-1b3c502628f9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "62285ca6-2701-4321-a768-1b3c502628f9" (UID: "62285ca6-2701-4321-a768-1b3c502628f9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:16:40.806152 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.806039    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "62285ca6-2701-4321-a768-1b3c502628f9" (UID: "62285ca6-2701-4321-a768-1b3c502628f9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:16:40.806152 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.806141    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-credential-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:40.806152 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.806154    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-workload-socket\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:40.806560 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.806162    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62285ca6-2701-4321-a768-1b3c502628f9-istiod-ca-cert\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:40.806560 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.806181    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-workload-certs\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:40.806671 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.806632    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-istio-data" (OuterVolumeSpecName: "istio-data") pod "62285ca6-2701-4321-a768-1b3c502628f9" (UID: "62285ca6-2701-4321-a768-1b3c502628f9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:16:40.808032 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.808000    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62285ca6-2701-4321-a768-1b3c502628f9-kube-api-access-pl5mj" (OuterVolumeSpecName: "kube-api-access-pl5mj") pod "62285ca6-2701-4321-a768-1b3c502628f9" (UID: "62285ca6-2701-4321-a768-1b3c502628f9"). InnerVolumeSpecName "kube-api-access-pl5mj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:16:40.808032 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.808012    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62285ca6-2701-4321-a768-1b3c502628f9-istio-token" (OuterVolumeSpecName: "istio-token") pod "62285ca6-2701-4321-a768-1b3c502628f9" (UID: "62285ca6-2701-4321-a768-1b3c502628f9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:16:40.808032 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.808014    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "62285ca6-2701-4321-a768-1b3c502628f9" (UID: "62285ca6-2701-4321-a768-1b3c502628f9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:16:40.808217 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.808077    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62285ca6-2701-4321-a768-1b3c502628f9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "62285ca6-2701-4321-a768-1b3c502628f9" (UID: "62285ca6-2701-4321-a768-1b3c502628f9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 18:16:40.821119 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.821094    2579 generic.go:356] "Generic (PLEG): container finished" podID="62285ca6-2701-4321-a768-1b3c502628f9" containerID="5670f75170071fa26e91e372851bace071fe216fd918d6f67796068f21f9b1fb" exitCode=0
Jul 27 18:16:40.821252 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.821157    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv" event={"ID":"62285ca6-2701-4321-a768-1b3c502628f9","Type":"ContainerDied","Data":"5670f75170071fa26e91e372851bace071fe216fd918d6f67796068f21f9b1fb"}
Jul 27 18:16:40.821252 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.821211    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"
Jul 27 18:16:40.821252 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.821240    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv" event={"ID":"62285ca6-2701-4321-a768-1b3c502628f9","Type":"ContainerDied","Data":"dc91396975587cb6d31d6514d27e6d7921e8f8351d9c9c515a24163cba47e8b1"}
Jul 27 18:16:40.821450 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.821273    2579 scope.go:117] "RemoveContainer" containerID="5670f75170071fa26e91e372851bace071fe216fd918d6f67796068f21f9b1fb"
Jul 27 18:16:40.833792 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.833410    2579 scope.go:117] "RemoveContainer" containerID="8f1cfb3f877cae63294fb808f7a980c04d34c245cefacb21615751bca512d431"
Jul 27 18:16:40.842748 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.842658    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"]
Jul 27 18:16:40.842887 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.842746    2579 scope.go:117] "RemoveContainer" containerID="5670f75170071fa26e91e372851bace071fe216fd918d6f67796068f21f9b1fb"
Jul 27 18:16:40.843056 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:16:40.843037    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5670f75170071fa26e91e372851bace071fe216fd918d6f67796068f21f9b1fb\": container with ID starting with 5670f75170071fa26e91e372851bace071fe216fd918d6f67796068f21f9b1fb not found: ID does not exist" containerID="5670f75170071fa26e91e372851bace071fe216fd918d6f67796068f21f9b1fb"
Jul 27 18:16:40.843115 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.843064    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5670f75170071fa26e91e372851bace071fe216fd918d6f67796068f21f9b1fb"} err="failed to get container status \"5670f75170071fa26e91e372851bace071fe216fd918d6f67796068f21f9b1fb\": rpc error: code = NotFound desc = could not find container \"5670f75170071fa26e91e372851bace071fe216fd918d6f67796068f21f9b1fb\": container with ID starting with 5670f75170071fa26e91e372851bace071fe216fd918d6f67796068f21f9b1fb not found: ID does not exist"
Jul 27 18:16:40.843115 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.843082    2579 scope.go:117] "RemoveContainer" containerID="8f1cfb3f877cae63294fb808f7a980c04d34c245cefacb21615751bca512d431"
Jul 27 18:16:40.843345 ip-10-0-128-74 kubenswrapper[2579]: E0727 18:16:40.843327    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f1cfb3f877cae63294fb808f7a980c04d34c245cefacb21615751bca512d431\": container with ID starting with 8f1cfb3f877cae63294fb808f7a980c04d34c245cefacb21615751bca512d431 not found: ID does not exist" containerID="8f1cfb3f877cae63294fb808f7a980c04d34c245cefacb21615751bca512d431"
Jul 27 18:16:40.843395 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.843350    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f1cfb3f877cae63294fb808f7a980c04d34c245cefacb21615751bca512d431"} err="failed to get container status \"8f1cfb3f877cae63294fb808f7a980c04d34c245cefacb21615751bca512d431\": rpc error: code = NotFound desc = could not find container \"8f1cfb3f877cae63294fb808f7a980c04d34c245cefacb21615751bca512d431\": container with ID starting with 8f1cfb3f877cae63294fb808f7a980c04d34c245cefacb21615751bca512d431 not found: ID does not exist"
Jul 27 18:16:40.846587 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.846566    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-ed5396-openshift-default-5d5c4b95b-6zpkv"]
Jul 27 18:16:40.907622 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.907595    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl5mj\" (UniqueName: \"kubernetes.io/projected/62285ca6-2701-4321-a768-1b3c502628f9-kube-api-access-pl5mj\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:40.907622 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.907619    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62285ca6-2701-4321-a768-1b3c502628f9-istio-podinfo\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:40.907791 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.907629    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62285ca6-2701-4321-a768-1b3c502628f9-istio-token\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:40.907791 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.907638    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-istio-envoy\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:40.907791 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.907645    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62285ca6-2701-4321-a768-1b3c502628f9-istio-data\") on node \"ip-10-0-128-74.ec2.internal\" DevicePath \"\""
Jul 27 18:16:40.993043 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:40.993011    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62285ca6-2701-4321-a768-1b3c502628f9" path="/var/lib/kubelet/pods/62285ca6-2701-4321-a768-1b3c502628f9/volumes"
Jul 27 18:16:41.391681 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:41.391655    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-2j29q_5abb3884-5803-4323-838e-5c2043df8a1e/manager/0.log"
Jul 27 18:16:41.511337 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:41.511304    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zvcb4_da395a06-4adf-4dd2-b530-b74993ed4dc2/manager/0.log"
Jul 27 18:16:41.627228 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:41.627198    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7975dbccc5-5q85z_f84ec536-d025-495a-b326-d5f2ea2de519/manager/0.log"
Jul 27 18:16:41.970994 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:41.970939    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-746b8d4d47-8hg7l_1bf5a911-8a7c-499a-842e-d2337f71e4db/manager/0.log"
Jul 27 18:16:41.989993 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:41.989968    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-746b8d4d47-8hg7l_1bf5a911-8a7c-499a-842e-d2337f71e4db/copy-manifests/0.log"
Jul 27 18:16:42.651915 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:42.651881    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29752905-tmvjd_6de927d0-0fe7-402e-a75b-f8c14c2a7836/cleanup/0.log"
Jul 27 18:16:42.968767 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:42.968689    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-dv8nt_27c22213-503f-40d9-9f26-861b818290d3/postgres/0.log"
Jul 27 18:16:43.692975 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:43.692949    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98_00b83755-b21c-42d0-9e6b-b8431459ce5f/util/0.log"
Jul 27 18:16:43.700074 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:43.700051    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98_00b83755-b21c-42d0-9e6b-b8431459ce5f/pull/0.log"
Jul 27 18:16:43.706212 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:43.706192    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98_00b83755-b21c-42d0-9e6b-b8431459ce5f/extract/0.log"
Jul 27 18:16:43.817891 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:43.817860    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls_ed4fd33b-7d70-466f-87d4-87c14e122527/util/0.log"
Jul 27 18:16:43.824031 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:43.824008    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls_ed4fd33b-7d70-466f-87d4-87c14e122527/pull/0.log"
Jul 27 18:16:43.829730 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:43.829709    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls_ed4fd33b-7d70-466f-87d4-87c14e122527/extract/0.log"
Jul 27 18:16:43.940905 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:43.940876    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn_5fc06110-0f2d-4c67-84a8-d76c4e56e98c/util/0.log"
Jul 27 18:16:43.947872 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:43.947804    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn_5fc06110-0f2d-4c67-84a8-d76c4e56e98c/pull/0.log"
Jul 27 18:16:43.954886 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:43.954864    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn_5fc06110-0f2d-4c67-84a8-d76c4e56e98c/extract/0.log"
Jul 27 18:16:44.056732 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:44.056706    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs_bbff31b6-96de-40f1-94b8-ca4841c3c9ba/pull/0.log"
Jul 27 18:16:44.063143 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:44.063119    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs_bbff31b6-96de-40f1-94b8-ca4841c3c9ba/extract/0.log"
Jul 27 18:16:44.069378 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:44.069357    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs_bbff31b6-96de-40f1-94b8-ca4841c3c9ba/util/0.log"
Jul 27 18:16:44.296442 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:44.296390    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2646d_5fc3b099-dfac-4d28-b9f7-a4bed919814c/manager/0.log"
Jul 27 18:16:44.401842 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:44.401813    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bpcm4_9942cad9-6c09-4014-86de-fa51de1ca664/manager/0.log"
Jul 27 18:16:44.511557 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:44.511533    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-7w8kk_9e1e21d1-53da-40c1-b930-199a22d75aad/kuadrant-console-plugin/0.log"
Jul 27 18:16:44.638137 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:44.638055    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-c82cs_8007e12e-a67a-40c3-9648-0fcc74613b3a/registry-server/0.log"
Jul 27 18:16:44.761594 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:44.761557    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-s9r5x_4b2067e3-39b9-47b1-81b1-943736e0d23c/manager/0.log"
Jul 27 18:16:44.982376 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:44.982299    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-brf46_f7f4d213-3760-43ad-9673-e19e544df507/manager/0.log"
Jul 27 18:16:45.665373 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:45.665344    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b8c977c58-tbqpt_50f93429-99c0-4a7e-8275-02fb03791380/kube-auth-proxy/0.log"
Jul 27 18:16:45.782687 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:45.782646    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-vxlln_786cec5a-444f-47f9-9363-2fda57df5799/istio-proxy/1.log"
Jul 27 18:16:46.020979 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:46.020927    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-l4dk8_eb94c657-b0a1-426d-8414-89545237e621/payload-processing/0.log"
Jul 27 18:16:46.694870 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:46.694842    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-ml6cb_2fd83369-b33c-478c-b2ee-44b741d00172/main/0.log"
Jul 27 18:16:46.807741 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:46.807715    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvbqk9_ce788dac-3a46-4777-8c1b-385172a453bb/main/0.log"
Jul 27 18:16:56.161492 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:56.161455    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lx499_60a2b76f-7c85-4e78-89f2-56d0556836d2/global-pull-secret-syncer/0.log"
Jul 27 18:16:56.257619 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:56.257581    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nl5s4_e949f3f4-9aba-4f97-93b1-911bb441f8a8/konnectivity-agent/0.log"
Jul 27 18:16:56.317327 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:56.317277    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-74.ec2.internal_0c3c3e6cc40a8e9ec18fa8af08b36f88/haproxy/0.log"
Jul 27 18:16:59.980335 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:16:59.980305    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98_00b83755-b21c-42d0-9e6b-b8431459ce5f/extract/0.log"
Jul 27 18:17:00.004545 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:00.004516    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98_00b83755-b21c-42d0-9e6b-b8431459ce5f/util/0.log"
Jul 27 18:17:00.031837 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:00.031809    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75926f98_00b83755-b21c-42d0-9e6b-b8431459ce5f/pull/0.log"
Jul 27 18:17:00.072164 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:00.072137    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls_ed4fd33b-7d70-466f-87d4-87c14e122527/extract/0.log"
Jul 27 18:17:00.095601 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:00.095573    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls_ed4fd33b-7d70-466f-87d4-87c14e122527/util/0.log"
Jul 27 18:17:00.132257 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:00.132236    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e052fls_ed4fd33b-7d70-466f-87d4-87c14e122527/pull/0.log"
Jul 27 18:17:00.167701 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:00.167680    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn_5fc06110-0f2d-4c67-84a8-d76c4e56e98c/extract/0.log"
Jul 27 18:17:00.189690 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:00.189668    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn_5fc06110-0f2d-4c67-84a8-d76c4e56e98c/util/0.log"
Jul 27 18:17:00.217274 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:00.217249    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73p2jkn_5fc06110-0f2d-4c67-84a8-d76c4e56e98c/pull/0.log"
Jul 27 18:17:00.248796 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:00.248728    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs_bbff31b6-96de-40f1-94b8-ca4841c3c9ba/extract/0.log"
Jul 27 18:17:00.273686 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:00.273665    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs_bbff31b6-96de-40f1-94b8-ca4841c3c9ba/util/0.log"
Jul 27 18:17:00.303712 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:00.303687    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1klvcs_bbff31b6-96de-40f1-94b8-ca4841c3c9ba/pull/0.log"
Jul 27 18:17:00.865528 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:00.865495    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2646d_5fc3b099-dfac-4d28-b9f7-a4bed919814c/manager/0.log"
Jul 27 18:17:00.895540 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:00.895510    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bpcm4_9942cad9-6c09-4014-86de-fa51de1ca664/manager/0.log"
Jul 27 18:17:00.935135 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:00.935112    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-7w8kk_9e1e21d1-53da-40c1-b930-199a22d75aad/kuadrant-console-plugin/0.log"
Jul 27 18:17:00.995521 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:00.995491    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-c82cs_8007e12e-a67a-40c3-9648-0fcc74613b3a/registry-server/0.log"
Jul 27 18:17:01.194458 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:01.194357    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-s9r5x_4b2067e3-39b9-47b1-81b1-943736e0d23c/manager/0.log"
Jul 27 18:17:01.342793 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:01.342768    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-brf46_f7f4d213-3760-43ad-9673-e19e544df507/manager/0.log"
Jul 27 18:17:03.316870 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:03.316838    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h88w2_b615dc3a-d8b9-449c-996a-374e6a2b90c2/node-exporter/0.log"
Jul 27 18:17:03.341890 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:03.341860    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h88w2_b615dc3a-d8b9-449c-996a-374e6a2b90c2/kube-rbac-proxy/0.log"
Jul 27 18:17:03.366836 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:03.366811    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h88w2_b615dc3a-d8b9-449c-996a-374e6a2b90c2/init-textfile/0.log"
Jul 27 18:17:06.693620 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.693593    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-xxlcr_62035540-6350-4c69-9134-c954a6de1fe7/download-server/0.log"
Jul 27 18:17:06.859679 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.859646    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"]
Jul 27 18:17:06.860031 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860018    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9659f9ca-f3ec-44ed-9cd4-844dfabd341e" containerName="payload-pre-processing"
Jul 27 18:17:06.860080 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860033    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9659f9ca-f3ec-44ed-9cd4-844dfabd341e" containerName="payload-pre-processing"
Jul 27 18:17:06.860080 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860042    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2b8a5b7-a11d-4a71-a5cb-2ffa08644085" containerName="maas-api"
Jul 27 18:17:06.860080 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860051    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2b8a5b7-a11d-4a71-a5cb-2ffa08644085" containerName="maas-api"
Jul 27 18:17:06.860080 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860064    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa7ff22e-0a44-4544-936c-a37d5eb649f7" containerName="payload-pre-processing"
Jul 27 18:17:06.860080 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860071    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa7ff22e-0a44-4544-936c-a37d5eb649f7" containerName="payload-pre-processing"
Jul 27 18:17:06.860080 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860080    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29dc3b6c-a730-4a25-a836-f0004cfb2b44" containerName="payload-pre-processing"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860085    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="29dc3b6c-a730-4a25-a836-f0004cfb2b44" containerName="payload-pre-processing"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860093    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62285ca6-2701-4321-a768-1b3c502628f9" containerName="istio-proxy"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860097    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62285ca6-2701-4321-a768-1b3c502628f9" containerName="istio-proxy"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860104    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="784e785b-0a77-4522-a96e-01cc560cb8a2" containerName="maas-api"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860109    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="784e785b-0a77-4522-a96e-01cc560cb8a2" containerName="maas-api"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860115    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f914f563-df5b-47de-86ca-5d186a5da3bc" containerName="istio-proxy"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860120    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f914f563-df5b-47de-86ca-5d186a5da3bc" containerName="istio-proxy"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860125    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd2ad129-a309-4731-baf1-8f9caa24cd5e" containerName="istio-proxy"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860133    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd2ad129-a309-4731-baf1-8f9caa24cd5e" containerName="istio-proxy"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860153    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="959f995a-b202-43c3-a1c6-e878004984f2" containerName="payload-processing"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860158    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="959f995a-b202-43c3-a1c6-e878004984f2" containerName="payload-processing"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860164    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd2ad129-a309-4731-baf1-8f9caa24cd5e" containerName="istio-proxy"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860169    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd2ad129-a309-4731-baf1-8f9caa24cd5e" containerName="istio-proxy"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860177    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d" containerName="payload-pre-processing"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860182    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d" containerName="payload-pre-processing"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860237    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e30ae0ab-4bfe-4763-9f93-30f6a4bbed6d" containerName="payload-pre-processing"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860245    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f914f563-df5b-47de-86ca-5d186a5da3bc" containerName="istio-proxy"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860250    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd2ad129-a309-4731-baf1-8f9caa24cd5e" containerName="istio-proxy"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860258    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="959f995a-b202-43c3-a1c6-e878004984f2" containerName="payload-processing"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860263    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="62285ca6-2701-4321-a768-1b3c502628f9" containerName="istio-proxy"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860269    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa7ff22e-0a44-4544-936c-a37d5eb649f7" containerName="payload-pre-processing"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860274    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2b8a5b7-a11d-4a71-a5cb-2ffa08644085" containerName="maas-api"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860280    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="784e785b-0a77-4522-a96e-01cc560cb8a2" containerName="maas-api"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860286    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9659f9ca-f3ec-44ed-9cd4-844dfabd341e" containerName="payload-pre-processing"
Jul 27 18:17:06.860281 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.860292    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="29dc3b6c-a730-4a25-a836-f0004cfb2b44" containerName="payload-pre-processing"
Jul 27 18:17:06.864945 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.864927    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:06.867379 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.867358    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dglvr\"/\"openshift-service-ca.crt\""
Jul 27 18:17:06.867521 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.867390    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dglvr\"/\"kube-root-ca.crt\""
Jul 27 18:17:06.867794 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.867775    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dglvr\"/\"default-dockercfg-s4v9h\""
Jul 27 18:17:06.876087 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.876070    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"]
Jul 27 18:17:06.935825 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.935787    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe-podres\") pod \"perf-node-gather-daemonset-hnn4k\" (UID: \"3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe\") " pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:06.935981 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.935842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe-lib-modules\") pod \"perf-node-gather-daemonset-hnn4k\" (UID: \"3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe\") " pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:06.935981 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.935942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n28zf\" (UniqueName: \"kubernetes.io/projected/3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe-kube-api-access-n28zf\") pod \"perf-node-gather-daemonset-hnn4k\" (UID: \"3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe\") " pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:06.936057 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.935982    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe-sys\") pod \"perf-node-gather-daemonset-hnn4k\" (UID: \"3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe\") " pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:06.936057 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:06.936002    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe-proc\") pod \"perf-node-gather-daemonset-hnn4k\" (UID: \"3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe\") " pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:07.036630 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:07.036602    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n28zf\" (UniqueName: \"kubernetes.io/projected/3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe-kube-api-access-n28zf\") pod \"perf-node-gather-daemonset-hnn4k\" (UID: \"3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe\") " pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:07.036804 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:07.036638    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe-sys\") pod \"perf-node-gather-daemonset-hnn4k\" (UID: \"3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe\") " pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:07.036804 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:07.036656    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe-proc\") pod \"perf-node-gather-daemonset-hnn4k\" (UID: \"3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe\") " pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:07.036804 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:07.036682    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe-podres\") pod \"perf-node-gather-daemonset-hnn4k\" (UID: \"3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe\") " pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:07.036804 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:07.036757    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe-proc\") pod \"perf-node-gather-daemonset-hnn4k\" (UID: \"3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe\") " pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:07.036976 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:07.036816    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe-lib-modules\") pod \"perf-node-gather-daemonset-hnn4k\" (UID: \"3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe\") " pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:07.036976 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:07.036823    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe-podres\") pod \"perf-node-gather-daemonset-hnn4k\" (UID: \"3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe\") " pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:07.036976 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:07.036757    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe-sys\") pod \"perf-node-gather-daemonset-hnn4k\" (UID: \"3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe\") " pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:07.036976 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:07.036919    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe-lib-modules\") pod \"perf-node-gather-daemonset-hnn4k\" (UID: \"3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe\") " pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:07.044861 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:07.044834    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n28zf\" (UniqueName: \"kubernetes.io/projected/3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe-kube-api-access-n28zf\") pod \"perf-node-gather-daemonset-hnn4k\" (UID: \"3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe\") " pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:07.174781 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:07.174746    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:07.313331 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:07.313250    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"]
Jul 27 18:17:07.317469 ip-10-0-128-74 kubenswrapper[2579]: W0727 18:17:07.317437    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3d8dd373_b0f8_4e0e_87a2_7cc6cff186fe.slice/crio-0628c354b1d76ef5abb23f22885b563a88ef0cf5cbde13eeeb59499ad264b150 WatchSource:0}: Error finding container 0628c354b1d76ef5abb23f22885b563a88ef0cf5cbde13eeeb59499ad264b150: Status 404 returned error can't find the container with id 0628c354b1d76ef5abb23f22885b563a88ef0cf5cbde13eeeb59499ad264b150
Jul 27 18:17:07.959732 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:07.959694    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k" event={"ID":"3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe","Type":"ContainerStarted","Data":"0e60602dfae3548e81aefbd1f1c42fa69dcd9ca22e9e6435a7aa5e96c5204d03"}
Jul 27 18:17:07.960123 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:07.959787    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k" event={"ID":"3d8dd373-b0f8-4e0e-87a2-7cc6cff186fe","Type":"ContainerStarted","Data":"0628c354b1d76ef5abb23f22885b563a88ef0cf5cbde13eeeb59499ad264b150"}
Jul 27 18:17:07.960123 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:07.959817    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:07.979672 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:07.979619    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k" podStartSLOduration=1.979606123 podStartE2EDuration="1.979606123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:17:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:17:07.977215297 +0000 UTC m=+3371.508966283" watchObservedRunningTime="2026-07-27 18:17:07.979606123 +0000 UTC m=+3371.511357109"
Jul 27 18:17:08.667599 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:08.667568    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4wpt9_406f1a28-2ffe-433e-ac46-6af95cbe6b15/dns/0.log"
Jul 27 18:17:08.693907 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:08.693877    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4wpt9_406f1a28-2ffe-433e-ac46-6af95cbe6b15/kube-rbac-proxy/0.log"
Jul 27 18:17:08.807527 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:08.807498    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7wtxl_93f3cc59-b8f9-413e-9c63-917f1dada6e5/dns-node-resolver/0.log"
Jul 27 18:17:09.403477 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:09.403443    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7548b5dbfb-xn8nq_4764c568-b22e-4c30-b532-7f9adef5a684/registry/0.log"
Jul 27 18:17:09.491600 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:09.491568    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vvdfm_a76aeaf9-9094-4328-b194-8c10eeb2a8c7/node-ca/0.log"
Jul 27 18:17:10.733073 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:10.733044    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b8c977c58-tbqpt_50f93429-99c0-4a7e-8275-02fb03791380/kube-auth-proxy/0.log"
Jul 27 18:17:10.768529 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:10.768491    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-vxlln_786cec5a-444f-47f9-9363-2fda57df5799/istio-proxy/0.log"
Jul 27 18:17:10.821376 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:10.821345    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-vxlln_786cec5a-444f-47f9-9363-2fda57df5799/istio-proxy/1.log"
Jul 27 18:17:10.902738 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:10.902710    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-l4dk8_eb94c657-b0a1-426d-8414-89545237e621/payload-processing/0.log"
Jul 27 18:17:11.797646 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:11.797614    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dlv8m_152482d3-38ae-4cb2-a613-629c044074dc/serve-healthcheck-canary/0.log"
Jul 27 18:17:12.444299 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:12.444272    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stqvq_aa222af2-57f7-4cf8-b773-1af5e3bde69e/kube-rbac-proxy/0.log"
Jul 27 18:17:12.470262 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:12.470239    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stqvq_aa222af2-57f7-4cf8-b773-1af5e3bde69e/exporter/0.log"
Jul 27 18:17:12.493741 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:12.493713    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-stqvq_aa222af2-57f7-4cf8-b773-1af5e3bde69e/extractor/0.log"
Jul 27 18:17:13.976099 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:13.976070    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dglvr/perf-node-gather-daemonset-hnn4k"
Jul 27 18:17:14.639493 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:14.639468    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-2j29q_5abb3884-5803-4323-838e-5c2043df8a1e/manager/0.log"
Jul 27 18:17:15.060266 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:15.060233    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zvcb4_da395a06-4adf-4dd2-b530-b74993ed4dc2/manager/0.log"
Jul 27 18:17:15.359854 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:15.359774    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7975dbccc5-5q85z_f84ec536-d025-495a-b326-d5f2ea2de519/manager/0.log"
Jul 27 18:17:15.513093 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:15.513061    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-746b8d4d47-8hg7l_1bf5a911-8a7c-499a-842e-d2337f71e4db/manager/0.log"
Jul 27 18:17:15.535681 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:15.535654    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-746b8d4d47-8hg7l_1bf5a911-8a7c-499a-842e-d2337f71e4db/copy-manifests/0.log"
Jul 27 18:17:16.721251 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:16.721169    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b8c977c58-tbqpt_50f93429-99c0-4a7e-8275-02fb03791380/kube-auth-proxy/0.log"
Jul 27 18:17:16.751165 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:16.751132    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-vxlln_786cec5a-444f-47f9-9363-2fda57df5799/istio-proxy/0.log"
Jul 27 18:17:16.804509 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:16.804481    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-vxlln_786cec5a-444f-47f9-9363-2fda57df5799/istio-proxy/1.log"
Jul 27 18:17:16.864303 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:16.864277    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-l4dk8_eb94c657-b0a1-426d-8414-89545237e621/payload-processing/0.log"
Jul 27 18:17:18.520784 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:18.520749    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b8c977c58-tbqpt_50f93429-99c0-4a7e-8275-02fb03791380/kube-auth-proxy/0.log"
Jul 27 18:17:18.549501 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:18.549399    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-vxlln_786cec5a-444f-47f9-9363-2fda57df5799/istio-proxy/0.log"
Jul 27 18:17:18.601088 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:18.601056    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-vxlln_786cec5a-444f-47f9-9363-2fda57df5799/istio-proxy/1.log"
Jul 27 18:17:18.676992 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:18.676961    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-l4dk8_eb94c657-b0a1-426d-8414-89545237e621/payload-processing/0.log"
Jul 27 18:17:23.960913 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:23.960887    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kv4hm_aefa7f7d-16e7-4697-9270-85fadc4f836e/kube-multus-additional-cni-plugins/0.log"
Jul 27 18:17:24.002815 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:24.002790    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kv4hm_aefa7f7d-16e7-4697-9270-85fadc4f836e/egress-router-binary-copy/0.log"
Jul 27 18:17:24.041772 ip-10-0-128-74 kubenswrapper[2579]: I0727 18:17:24.041745    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kv4hm_aefa7f7d-16e7-4697-9270-85fadc4f836e/cni-plugins/0.log"