Jul 31 20:28:07.803599 ip-10-0-132-89 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 31 20:28:07.803614 ip-10-0-132-89 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 31 20:28:07.803624 ip-10-0-132-89 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 31 20:28:07.803935 ip-10-0-132-89 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 31 20:28:17.877971 ip-10-0-132-89 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 31 20:28:17.877994 ip-10-0-132-89 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f71096ab04c244f7b2ce53143eb975a8 --
Jul 31 20:29:55.265473 ip-10-0-132-89 systemd[1]: Starting Kubernetes Kubelet...
Jul 31 20:29:55.717883 ip-10-0-132-89 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 20:29:55.717883 ip-10-0-132-89 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 31 20:29:55.717883 ip-10-0-132-89 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 20:29:55.717883 ip-10-0-132-89 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 31 20:29:55.717883 ip-10-0-132-89 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 31 20:29:55.719040 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.718915    2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 31 20:29:55.726659 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726635    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 20:29:55.726659 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726657    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 20:29:55.726659 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726660    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 20:29:55.726659 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726663    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726668    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726671    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726674    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726677    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726680    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726682    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726685    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726688    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726690    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726693    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726695    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726698    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726700    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726703    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726705    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726708    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726711    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726714    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726717    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 20:29:55.726822 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726719    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726722    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726724    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726727    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726729    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726732    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726734    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726737    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726740    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726742    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726745    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726747    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726750    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726752    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726755    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726758    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726761    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726764    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726766    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726769    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 20:29:55.727330 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726772    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726774    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726777    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726780    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726782    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726785    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726787    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726789    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726792    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726794    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726796    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726800    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726802    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726805    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726807    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726810    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726813    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726816    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726819    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726821    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 20:29:55.727832 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726826    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726830    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726833    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726836    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726838    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726841    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726844    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726847    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726849    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726852    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726855    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726858    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726860    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726863    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726867    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726870    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726873    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726876    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 20:29:55.728345 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726879    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726881    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726884    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726887    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726889    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726891    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726895    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726898    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726900    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726904    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726908    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726911    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726913    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726916    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726918    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726921    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726923    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.726926    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727698    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727706    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 20:29:55.728960 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727709    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727712    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727716    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727719    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727722    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727725    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727728    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727730    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727733    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727735    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727738    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727741    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727743    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727745    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727748    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727750    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727753    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727755    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727758    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727764    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 20:29:55.729692 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727767    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727769    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727772    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727774    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727778    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727780    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727783    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727785    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727788    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727791    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727793    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727795    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727799    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727802    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727804    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727807    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727809    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727812    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727814    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727817    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 20:29:55.730246 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727820    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727822    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727824    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727827    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727829    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727831    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727834    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727838    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727842    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727845    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727850    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727853    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727856    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727859    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727862    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727865    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727868    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727871    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727874    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 20:29:55.730751 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727876    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727879    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727881    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727883    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727886    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727889    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727891    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727894    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727897    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727899    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727902    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727905    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727907    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727910    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727913    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727915    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727918    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727920    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727922    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727925    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 20:29:55.731239 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727927    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727930    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727933    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727935    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727938    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727941    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727944    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727946    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727948    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727951    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727953    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727956    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727958    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727961    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727964    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727967    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727970    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.727973    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728402    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 20:29:55.731741 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728408    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728411    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728414    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728417    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728419    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728422    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728425    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728428    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728431    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728434    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728437    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728439    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728442    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728445    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728447    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728450    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728454    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728457    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728460    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 20:29:55.732240 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.728517    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729631    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729754    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729759    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729763    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729767    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729770    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729773    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729776    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729779    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729782    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729785    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729787    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729790    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729793    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729796    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729799    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729801    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729804    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729807    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 20:29:55.732796 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729810    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729812    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729817    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729821    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729824    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729827    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729830    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729832    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729835    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729838    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729844    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729848    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729852    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729855    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729858    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729860    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729863    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729866    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729869    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 20:29:55.733309 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729872    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729893    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729897    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729902    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729905    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729910    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729914    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729917    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729920    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729923    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729926    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729928    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729931    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729934    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729937    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729940    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729943    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729946    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729949    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729951    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 20:29:55.733780 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729954    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729957    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729959    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729962    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729964    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729966    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729969    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729971    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729974    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729976    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729979    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729981    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729984    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729986    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729989    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729991    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729995    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.729998    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730000    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730003    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 20:29:55.734341 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730094    2566 flags.go:64] FLAG: --address="0.0.0.0"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730102    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730109    2566 flags.go:64] FLAG: --anonymous-auth="true"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730114    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730118    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730122    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730126    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730131    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730134    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730136    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730140    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730161    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730165    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730168    2566 flags.go:64] FLAG: --cgroup-root=""
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730171    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730173    2566 flags.go:64] FLAG: --client-ca-file=""
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730176    2566 flags.go:64] FLAG: --cloud-provider="external"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730179    2566 flags.go:64] FLAG: --cluster-dns="[]"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730184    2566 flags.go:64] FLAG: --cluster-domain=""
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730187    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730190    2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730193    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730196    2566 flags.go:64] FLAG: --container-log-max-files="5"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730200    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 31 20:29:55.734836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730203    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730206    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730209    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730212    2566 flags.go:64] FLAG: --contention-profiling="false"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730216    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730219    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730222    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730225    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730229    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730232    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730235    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730237    2566 flags.go:64] FLAG: --enable-load-reader="false"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730240    2566 flags.go:64] FLAG: --enable-server="true"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730244    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730249    2566 flags.go:64] FLAG: --event-burst="100"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730252    2566 flags.go:64] FLAG: --event-qps="50"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730255    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730258    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730261    2566 flags.go:64] FLAG: --eviction-hard=""
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730265    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730268    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730270    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730274    2566 flags.go:64] FLAG: --eviction-soft=""
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730277    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730280    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 31 20:29:55.735445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730282    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730286    2566 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730289    2566 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730292    2566 flags.go:64] FLAG: --fail-swap-on="true"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730294    2566 flags.go:64] FLAG: --feature-gates=""
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730299    2566 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730302    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730305    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730308    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730311    2566 flags.go:64] FLAG: --healthz-port="10248"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730314    2566 flags.go:64] FLAG: --help="false"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730317    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-132-89.ec2.internal"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730320    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730323    2566 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730326    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730329    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730332    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730336    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730338    2566 flags.go:64] FLAG: --image-service-endpoint=""
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730341    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730344    2566 flags.go:64] FLAG: --kube-api-burst="100"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730347    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730351    2566 flags.go:64] FLAG: --kube-api-qps="50"
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730353    2566 flags.go:64] FLAG: --kube-reserved=""
Jul 31 20:29:55.736076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730356    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730359    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730362    2566 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730364    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730374    2566 flags.go:64] FLAG: --lock-file=""
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730378    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730380    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730383    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730389    2566 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730395    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730397    2566 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730401    2566 flags.go:64] FLAG: --logging-format="text"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730404    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730407    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730410    2566 flags.go:64] FLAG: --manifest-url=""
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730412    2566 flags.go:64] FLAG: --manifest-url-header=""
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730417    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730420    2566 flags.go:64] FLAG: --max-open-files="1000000"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730424    2566 flags.go:64] FLAG: --max-pods="110"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730427    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730430    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730433    2566 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730436    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730439    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730441    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 31 20:29:55.736682 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730444    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730452    2566 flags.go:64] FLAG: --node-status-max-images="50"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730455    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730458    2566 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730461    2566 flags.go:64] FLAG: --pod-cidr=""
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730464    2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730471    2566 flags.go:64] FLAG: --pod-manifest-path=""
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730473    2566 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730476    2566 flags.go:64] FLAG: --pods-per-core="0"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730479    2566 flags.go:64] FLAG: --port="10250"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730482    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730485    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06fb99832a7cb85ae"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730488    2566 flags.go:64] FLAG: --qos-reserved=""
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730491    2566 flags.go:64] FLAG: --read-only-port="10255"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730494    2566 flags.go:64] FLAG: --register-node="true"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730497    2566 flags.go:64] FLAG: --register-with-taints=""
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730505    2566 flags.go:64] FLAG: --registry-burst="10"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730509    2566 flags.go:64] FLAG: --registry-qps="5"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730512    2566 flags.go:64] FLAG: --reserved-cpus=""
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730515    2566 flags.go:64] FLAG: --reserved-memory=""
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730521    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730524    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730527    2566 flags.go:64] FLAG: --rotate-certificates="false"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730530    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730532    2566 flags.go:64] FLAG: --runonce="false"
Jul 31 20:29:55.737315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730535    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730538    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730541    2566 flags.go:64] FLAG: --seccomp-default="false"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730544    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730546    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730549    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730552    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730555    2566 flags.go:64] FLAG: --storage-driver-password="root"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730558    2566 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730561    2566 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730564    2566 flags.go:64] FLAG: --storage-driver-user="root"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730566    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730569    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730573    2566 flags.go:64] FLAG: --system-cgroups=""
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730575    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730581    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730584    2566 flags.go:64] FLAG: --tls-cert-file=""
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730586    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730590    2566 flags.go:64] FLAG: --tls-min-version=""
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730593    2566 flags.go:64] FLAG: --tls-private-key-file=""
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730595    2566 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730598    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730601    2566 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730604    2566 flags.go:64] FLAG: --v="2"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730608    2566 flags.go:64] FLAG: --version="false"
Jul 31 20:29:55.738012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730612    2566 flags.go:64] FLAG: --vmodule=""
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730616    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.730619    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730743    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730747    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730749    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730752    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730756    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730759    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730761    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730764    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730767    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730770    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730772    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730776    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730778    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730786    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730788    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730791    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730794    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 20:29:55.738646 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730797    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730800    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730802    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730805    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730808    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730810    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730813    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730815    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730818    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730820    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730822    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730825    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730828    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730830    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730833    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730835    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730838    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730840    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730843    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730846    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 20:29:55.739161 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730849    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730851    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730853    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730856    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730858    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730861    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730865    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730867    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730869    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730872    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730874    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730877    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730879    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730883    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730887    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730890    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730893    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730896    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730898    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730901    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 20:29:55.739655 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730903    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730906    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730908    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730911    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730914    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730916    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730919    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730922    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730925    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730928    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730931    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730934    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730937    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730939    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730942    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730945    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730947    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730950    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730954    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730956    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 20:29:55.740220 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730959    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730961    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730964    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730966    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730969    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730972    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730976    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730979    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730981    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730984    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730986    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730989    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730992    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730994    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730997    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.730999    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.731002    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.731004    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.731007    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 20:29:55.740713 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.731009    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 20:29:55.741196 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.731012    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 20:29:55.741196 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.731014    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 20:29:55.741196 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.731783    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 20:29:55.741196 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.739095    2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 31 20:29:55.741196 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.739111    2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 31 20:29:55.741196 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.739132    2566 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 31 20:29:55.741196 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.739138    2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 31 20:29:55.741196 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739214    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 20:29:55.741196 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739219    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 20:29:55.741196 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739223    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 20:29:55.741196 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739226    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 20:29:55.741196 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739229    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 20:29:55.741196 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739231    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 20:29:55.741196 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739234    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739237    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739239    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739242    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739244    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739247    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739249    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739252    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739255    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739257    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739260    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739262    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739265    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739267    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739270    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739273    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739275    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739278    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739280    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 20:29:55.741550 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739283    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739285    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739287    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739292    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739297    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739301    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739304    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739307    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739310    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739313    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739316    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739319    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739321    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739323    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739327    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739331    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739334    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739337    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739339    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 20:29:55.742012 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739341    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739344    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739347    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739350    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739352    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739354    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739357    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739359    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739361    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739365    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739367    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739370    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739372    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739375    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739378    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739380    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739382    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739386    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739389    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739392    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 20:29:55.742532 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739394    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739397    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739400    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739402    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739405    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739407    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739410    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739413    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739415    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739418    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739420    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739423    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739426    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739428    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739431    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739433    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739436    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739438    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739440    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739443    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 20:29:55.743021 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739445    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 20:29:55.743578 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739448    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 20:29:55.743578 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739451    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 20:29:55.743578 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739453    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 20:29:55.743578 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739456    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 20:29:55.743578 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739458    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 20:29:55.743578 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739461    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 20:29:55.743578 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739463    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 20:29:55.743578 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739466    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 20:29:55.743578 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739469    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 20:29:55.743578 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739472    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 20:29:55.743578 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739474    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 20:29:55.743578 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739477    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 20:29:55.743578 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739479    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 20:29:55.743578 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739482    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 20:29:55.743578 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.739488    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739604    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739610    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739614    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739617    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739619    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739622    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739625    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739627    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739630    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739633    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739636    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739638    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739640    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739643    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739645    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739648    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739650    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739652    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 31 20:29:55.743980 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739655    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739658    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739660    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739663    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739665    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739669    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739672    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739675    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739678    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739681    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739684    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739686    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739689    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739691    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739694    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739696    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739698    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739701    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739704    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 31 20:29:55.744462 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739706    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739708    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739711    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739713    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739716    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739718    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739720    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739723    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739725    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739728    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739730    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739732    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739735    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739737    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739740    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739742    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739745    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739747    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739750    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739753    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 31 20:29:55.744924 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739755    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739757    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739760    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739762    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739765    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739768    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739770    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739772    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739776    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739778    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739780    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739783    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739787    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739790    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739793    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739795    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739798    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739800    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739803    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 31 20:29:55.745429 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739805    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739807    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739810    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739813    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739815    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739817    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739820    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739822    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739825    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739827    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739829    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739832    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739834    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739836    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739839    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739841    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739843    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739846    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739849    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739851    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 31 20:29:55.745892 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739853    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 31 20:29:55.746424 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739856    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 31 20:29:55.746424 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:55.739858    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 31 20:29:55.746424 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.739863    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 31 20:29:55.746424 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.739991    2566 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 31 20:29:55.746424 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.742204    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 31 20:29:55.746424 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.743659    2566 server.go:1019] "Starting client certificate rotation"
Jul 31 20:29:55.746424 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.743756    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 20:29:55.746424 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.743790    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 31 20:29:55.746649 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.746475    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 20:29:55.748428 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.748414    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 31 20:29:55.759701 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.759679    2566 log.go:25] "Validated CRI v1 runtime API"
Jul 31 20:29:55.763623 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.763603    2566 log.go:25] "Validated CRI v1 image API"
Jul 31 20:29:55.764427 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.764414    2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 31 20:29:55.770725 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.770700    2566 fs.go:135] Filesystem UUIDs: map[76d5cfcd-b8bb-4ddc-8b46-8e1061d329bb:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b736ca05-b2c9-47b6-9de7-8da12d1be2e9:/dev/nvme0n1p3]
Jul 31 20:29:55.770819 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.770723    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 31 20:29:55.777341 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.777182    2566 manager.go:216] Machine: {Timestamp:2026-07-31 20:29:55.775689101 +0000 UTC m=+0.381081569 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3127852 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cf6d22e0661e1ca7ee0bd14d8d681 SystemUUID:ec2cf6d2-2e06-61e1-ca7e-e0bd14d8d681 BootID:f71096ab-04c2-44f7-b2ce-53143eb975a8 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:29:ad:f9:28:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:29:ad:f9:28:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:5f:1f:5f:4b:49 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 31 20:29:55.777341 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.777320    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 31 20:29:55.777502 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.777448    2566 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 31 20:29:55.777502 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.777465    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 20:29:55.781476 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.781449    2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 31 20:29:55.781648 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.781481    2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-89.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 31 20:29:55.782397 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.782385    2566 topology_manager.go:138] "Creating topology manager with none policy"
Jul 31 20:29:55.782430 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.782400    2566 container_manager_linux.go:309] "Creating device plugin manager"
Jul 31 20:29:55.782430 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.782407    2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 20:29:55.783172 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.783161    2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 31 20:29:55.784223 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.784213    2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 31 20:29:55.789004 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.788991    2566 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 20:29:55.789133 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.789123    2566 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 31 20:29:55.789184 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.789172    2566 kubelet.go:486] "Attempting to sync node with API server"
Jul 31 20:29:55.789184 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.789182    2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 31 20:29:55.789236 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.789198    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 31 20:29:55.789236 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.789209    2566 kubelet.go:398] "Adding apiserver pod source"
Jul 31 20:29:55.789236 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.789219    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 31 20:29:55.789569 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.789558    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 20:29:55.789632 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.789576    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 31 20:29:55.792156 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.792130    2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 31 20:29:55.793954 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.793941    2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 31 20:29:55.793993 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.793972    2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 31 20:29:55.794345 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.794328    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-48b2f"
Jul 31 20:29:55.795492 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.795479    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 31 20:29:55.795554 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.795495    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 31 20:29:55.795554 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.795502    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 31 20:29:55.795554 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.795507    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 31 20:29:55.795554 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.795516    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 31 20:29:55.795554 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.795522    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 31 20:29:55.795554 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.795530    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 31 20:29:55.795554 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.795537    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 31 20:29:55.795554 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.795543    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 31 20:29:55.795554 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.795549    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 31 20:29:55.795554 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.795557    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 31 20:29:55.795817 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.795563    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 31 20:29:55.796322 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.796312    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 31 20:29:55.796322 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.796321    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 31 20:29:55.798905 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.798882    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-48b2f"
Jul 31 20:29:55.800264 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.800250    2566 server.go:1268] "Started kubelet"
Jul 31 20:29:55.800496 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.800441    2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 31 20:29:55.800634 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.800619    2566 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 31 20:29:55.800734 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:55.800711    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-89.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 31 20:29:55.800814 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.800509    2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 31 20:29:55.800814 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.800776    2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-89.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 31 20:29:55.800814 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:55.800664    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 31 20:29:55.801806 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.801792    2566 server.go:310] "Adding debug handlers to kubelet server"
Jul 31 20:29:55.802428 ip-10-0-132-89 systemd[1]: Started Kubernetes Kubelet.
Jul 31 20:29:55.802542 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.802426    2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 31 20:29:55.805923 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:55.804703    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-89.ec2.internal.18c779e39e8c34bf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-89.ec2.internal,UID:ip-10-0-132-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-89.ec2.internal,},FirstTimestamp:2026-07-31 20:29:55.800216767 +0000 UTC m=+0.405609235,LastTimestamp:2026-07-31 20:29:55.800216767 +0000 UTC m=+0.405609235,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-89.ec2.internal,}"
Jul 31 20:29:55.807328 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:55.807298    2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 31 20:29:55.808720 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.808703    2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 31 20:29:55.808814 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.808717    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 31 20:29:55.809289 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:55.809272    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-89.ec2.internal\" not found"
Jul 31 20:29:55.809968 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.809950    2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 31 20:29:55.809968 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.809953    2566 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 31 20:29:55.810091 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.809978    2566 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 31 20:29:55.810091 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.810078    2566 reconstruct.go:97] "Volume reconstruction finished"
Jul 31 20:29:55.810091 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.810087    2566 reconciler.go:29] "Reconciler: start to sync state"
Jul 31 20:29:55.810225 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.810205    2566 factory.go:153] Registering CRI-O factory
Jul 31 20:29:55.810225 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.810217    2566 factory.go:223] Registration of the crio container factory successfully
Jul 31 20:29:55.810303 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.810270    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 31 20:29:55.810303 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.810277    2566 factory.go:55] Registering systemd factory
Jul 31 20:29:55.810303 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.810284    2566 factory.go:223] Registration of the systemd container factory successfully
Jul 31 20:29:55.810303 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.810300    2566 factory.go:103] Registering Raw factory
Jul 31 20:29:55.810461 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.810314    2566 manager.go:1196] Started watching for new ooms in manager
Jul 31 20:29:55.810962 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.810945    2566 manager.go:349] Starting recovery of all containers
Jul 31 20:29:55.818420 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.818394    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 20:29:55.821262 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:55.821237    2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-89.ec2.internal\" not found" node="ip-10-0-132-89.ec2.internal"
Jul 31 20:29:55.823657 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.823641    2566 manager.go:354] Recovery completed
Jul 31 20:29:55.828009 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.827887    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 20:29:55.831439 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.831417    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 20:29:55.831524 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.831456    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 20:29:55.831524 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.831470    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasSufficientPID"
Jul 31 20:29:55.832050 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.832033    2566 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 31 20:29:55.832118 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.832050    2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 31 20:29:55.832118 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.832065    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 20:29:55.832118 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.832072    2566 state_mem.go:36] "Initialized new in-memory state store"
Jul 31 20:29:55.832817 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.832803    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 20:29:55.832877 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.832832    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 20:29:55.832877 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.832844    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasSufficientPID"
Jul 31 20:29:55.834372 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.834355    2566 policy_none.go:49] "None policy: Start"
Jul 31 20:29:55.834410 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.834378    2566 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 31 20:29:55.834410 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.834390    2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 31 20:29:55.836349 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.836339    2566 policy_none.go:47] "Start"
Jul 31 20:29:55.896516 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.887809    2566 manager.go:337] "Starting Device Plugin manager"
Jul 31 20:29:55.896516 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:55.887843    2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 31 20:29:55.896516 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.887853    2566 server.go:87] "Starting device plugin registration server"
Jul 31 20:29:55.896516 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.888318    2566 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 31 20:29:55.896516 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.888330    2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 31 20:29:55.896516 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.888421    2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 31 20:29:55.896516 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.888532    2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 31 20:29:55.896516 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.888542    2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 31 20:29:55.896516 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:55.889075    2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 31 20:29:55.896516 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:55.889172    2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-89.ec2.internal\" not found"
Jul 31 20:29:55.927391 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.927346    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 31 20:29:55.928670 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.928657    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 31 20:29:55.928748 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.928690    2566 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 31 20:29:55.928748 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.928713    2566 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 31 20:29:55.928824 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:55.928746    2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 31 20:29:55.930826 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.930805    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 20:29:55.988902 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.988808    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 20:29:55.989818 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.989802    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 20:29:55.989907 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.989833    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 20:29:55.989907 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.989843    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasSufficientPID"
Jul 31 20:29:55.989907 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.989866    2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-89.ec2.internal"
Jul 31 20:29:55.995484 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:55.995468    2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-89.ec2.internal"
Jul 31 20:29:55.995544 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:55.995492    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-89.ec2.internal\": node \"ip-10-0-132-89.ec2.internal\" not found"
Jul 31 20:29:56.009433 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:56.009407    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-89.ec2.internal\" not found"
Jul 31 20:29:56.029656 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.029626    2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-89.ec2.internal"]
Jul 31 20:29:56.029724 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.029706    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 20:29:56.031373 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.031358    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 20:29:56.031446 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.031385    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 20:29:56.031446 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.031394    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasSufficientPID"
Jul 31 20:29:56.033676 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.033660    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 20:29:56.033787 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.033768    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal"
Jul 31 20:29:56.033887 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.033798    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 20:29:56.034459 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.034442    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 20:29:56.034528 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.034443    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 20:29:56.034528 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.034494    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 20:29:56.034528 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.034505    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasSufficientPID"
Jul 31 20:29:56.034648 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.034471    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 20:29:56.034648 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.034548    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasSufficientPID"
Jul 31 20:29:56.036840 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.036825    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-89.ec2.internal"
Jul 31 20:29:56.036899 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.036852    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 31 20:29:56.037578 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.037559    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 31 20:29:56.037662 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.037590    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 31 20:29:56.037662 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.037600    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeHasSufficientPID"
Jul 31 20:29:56.049752 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:56.049727    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-89.ec2.internal\" not found" node="ip-10-0-132-89.ec2.internal"
Jul 31 20:29:56.053196 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:56.053178    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-89.ec2.internal\" not found" node="ip-10-0-132-89.ec2.internal"
Jul 31 20:29:56.109639 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:56.109609    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-89.ec2.internal\" not found"
Jul 31 20:29:56.210519 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:56.210474    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-89.ec2.internal\" not found"
Jul 31 20:29:56.211610 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.211591    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c30fb18a7444f8645905067ee4b6e927-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal\" (UID: \"c30fb18a7444f8645905067ee4b6e927\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal"
Jul 31 20:29:56.211675 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.211619    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c30fb18a7444f8645905067ee4b6e927-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal\" (UID: \"c30fb18a7444f8645905067ee4b6e927\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal"
Jul 31 20:29:56.211675 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.211636    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7856e23c54e5bbf471253e5fa19904b5-config\") pod \"kube-apiserver-proxy-ip-10-0-132-89.ec2.internal\" (UID: \"7856e23c54e5bbf471253e5fa19904b5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-89.ec2.internal"
Jul 31 20:29:56.311113 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:56.311047    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-89.ec2.internal\" not found"
Jul 31 20:29:56.312176 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.312158    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c30fb18a7444f8645905067ee4b6e927-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal\" (UID: \"c30fb18a7444f8645905067ee4b6e927\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal"
Jul 31 20:29:56.312222 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.312183    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c30fb18a7444f8645905067ee4b6e927-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal\" (UID: \"c30fb18a7444f8645905067ee4b6e927\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal"
Jul 31 20:29:56.312222 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.312200    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7856e23c54e5bbf471253e5fa19904b5-config\") pod \"kube-apiserver-proxy-ip-10-0-132-89.ec2.internal\" (UID: \"7856e23c54e5bbf471253e5fa19904b5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-89.ec2.internal"
Jul 31 20:29:56.312283 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.312218    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c30fb18a7444f8645905067ee4b6e927-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal\" (UID: \"c30fb18a7444f8645905067ee4b6e927\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal"
Jul 31 20:29:56.312283 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.312246    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7856e23c54e5bbf471253e5fa19904b5-config\") pod \"kube-apiserver-proxy-ip-10-0-132-89.ec2.internal\" (UID: \"7856e23c54e5bbf471253e5fa19904b5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-89.ec2.internal"
Jul 31 20:29:56.312343 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.312289    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c30fb18a7444f8645905067ee4b6e927-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal\" (UID: \"c30fb18a7444f8645905067ee4b6e927\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal"
Jul 31 20:29:56.352344 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.352314    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal"
Jul 31 20:29:56.355478 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.355460    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-89.ec2.internal"
Jul 31 20:29:56.412103 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:56.412074    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-89.ec2.internal\" not found"
Jul 31 20:29:56.512520 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:56.512477    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-89.ec2.internal\" not found"
Jul 31 20:29:56.612100 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.612023    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 20:29:56.613049 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:56.613023    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-89.ec2.internal\" not found"
Jul 31 20:29:56.713771 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:56.713726    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-89.ec2.internal\" not found"
Jul 31 20:29:56.742980 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.742952    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 31 20:29:56.743535 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.743092    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 20:29:56.743535 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.743159    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 20:29:56.743535 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.743161    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 31 20:29:56.805017 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.804962    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 20:24:56 +0000 UTC" deadline="2028-01-13 01:33:17.384786368 +0000 UTC"
Jul 31 20:29:56.805017 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.805006    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12725h3m20.579782944s"
Jul 31 20:29:56.814299 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:56.814274    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-89.ec2.internal\" not found"
Jul 31 20:29:56.905392 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.905317    2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 20:29:56.910308 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.910288    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal"
Jul 31 20:29:56.922913 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.922890    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 20:29:56.923785 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.923771    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-89.ec2.internal"
Jul 31 20:29:56.931390 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:56.931372    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 31 20:29:57.021767 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:57.021729    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc30fb18a7444f8645905067ee4b6e927.slice/crio-9f58ceb7d75b77df76eb5d687db548a0ff39a5df192e7420006554d58fb93403 WatchSource:0}: Error finding container 9f58ceb7d75b77df76eb5d687db548a0ff39a5df192e7420006554d58fb93403: Status 404 returned error can't find the container with id 9f58ceb7d75b77df76eb5d687db548a0ff39a5df192e7420006554d58fb93403
Jul 31 20:29:57.026281 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.026263    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 20:29:57.057301 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:57.057276    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7856e23c54e5bbf471253e5fa19904b5.slice/crio-7adba660765bcb414cdf0194e324f998889deb783a9b4a444f57df6c62ec5d07 WatchSource:0}: Error finding container 7adba660765bcb414cdf0194e324f998889deb783a9b4a444f57df6c62ec5d07: Status 404 returned error can't find the container with id 7adba660765bcb414cdf0194e324f998889deb783a9b4a444f57df6c62ec5d07
Jul 31 20:29:57.654162 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.654106    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 20:29:57.693050 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.692879    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 20:29:57.790924 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.790613    2566 apiserver.go:52] "Watching apiserver"
Jul 31 20:29:57.799779 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.799750    2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 31 20:29:57.800633 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.800227    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln","openshift-image-registry/node-ca-kjc46","openshift-multus/multus-2jz7q","openshift-network-operator/iptables-alerter-h5w65","openshift-ovn-kubernetes/ovnkube-node-8trv8","kube-system/konnectivity-agent-psqjf","kube-system/kube-apiserver-proxy-ip-10-0-132-89.ec2.internal","openshift-cluster-node-tuning-operator/tuned-z4476","openshift-dns/node-resolver-7qphl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal","openshift-multus/multus-additional-cni-plugins-22922","openshift-multus/network-metrics-daemon-p75dl","openshift-network-diagnostics/network-check-target-n4b78","kube-system/global-pull-secret-syncer-zslqn"]
Jul 31 20:29:57.803233 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.803178    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:29:57.803337 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:57.803279    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:29:57.805899 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.805316    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kjc46"
Jul 31 20:29:57.810437 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.807652    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.810437 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.808722    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 31 20:29:57.810437 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.808887    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 31 20:29:57.810437 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.809049    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hlqkm\""
Jul 31 20:29:57.810437 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.809272    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 31 20:29:57.810437 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.809662    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 31 20:29:57.810437 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.810057    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h5w65"
Jul 31 20:29:57.810437 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.810146    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 31 20:29:57.810437 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.810259    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 31 20:29:57.810437 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.810334    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w8rws\""
Jul 31 20:29:57.810915 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.810855    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 31 20:29:57.815782 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.815759    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 31 20:29:57.816356 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.816334    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.817058 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.817031    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-psqjf"
Jul 31 20:29:57.817667 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.817538    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 31 20:29:57.818079 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.818052    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ht5s9\""
Jul 31 20:29:57.818079 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.818069    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 31 20:29:57.818568 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.818329    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 31 20:29:57.818568 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.818469    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:57.819911 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.819070    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 31 20:29:57.819911 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.819149    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 31 20:29:57.819911 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.819260    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 31 20:29:57.819911 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.819322    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8qhn9\""
Jul 31 20:29:57.819911 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.819693    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 31 20:29:57.821298 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.820887    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 31 20:29:57.821298 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.821187    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-node-log\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.821298 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.821211    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-run-ovn-kubernetes\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.821298 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.821254    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/34ad9000-0cac-4d3d-95a5-e2a440147d9e-ovnkube-config\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.821597 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.821428    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 31 20:29:57.821655 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.821595    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:57.823441 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.821777    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sklbh\""
Jul 31 20:29:57.823441 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.821961    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 31 20:29:57.823441 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.822190    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 31 20:29:57.823441 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.822407    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 31 20:29:57.823441 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.822416    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-48qf2\""
Jul 31 20:29:57.823441 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.822751    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 31 20:29:57.823441 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.822810    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 31 20:29:57.825169 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.824482    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w9mfk\""
Jul 31 20:29:57.825169 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.824529    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 31 20:29:57.825169 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.824686    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 31 20:29:57.825169 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.824857    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7qphl"
Jul 31 20:29:57.825970 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.825734    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/34ad9000-0cac-4d3d-95a5-e2a440147d9e-env-overrides\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.825970 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.825778    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/34ad9000-0cac-4d3d-95a5-e2a440147d9e-ovn-node-metrics-cert\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.825970 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.825804    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-cnibin\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.825970 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.825829    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-os-release\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.825970 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.825853    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-systemd-units\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.825970 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.825920    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-log-socket\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.825970 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.825947    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knbcw\" (UniqueName: \"kubernetes.io/projected/35536ea9-0cd4-4e62-9c3f-df5f2a224bd4-kube-api-access-knbcw\") pod \"node-ca-kjc46\" (UID: \"35536ea9-0cd4-4e62-9c3f-df5f2a224bd4\") " pod="openshift-image-registry/node-ca-kjc46"
Jul 31 20:29:57.826333 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.825989    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-system-cni-dir\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.826333 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826013    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-cni-binary-copy\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.826333 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826039    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-multus-socket-dir-parent\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.826333 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826064    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-run-netns\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.826333 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826088    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-var-lib-cni-bin\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.826333 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826115    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-kubelet\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.826333 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826166    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-slash\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.826333 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826210    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-etc-openvswitch\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.826333 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826236    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e87137bd-5415-48f4-b38e-ceb5f5e0b126-konnectivity-ca\") pod \"konnectivity-agent-psqjf\" (UID: \"e87137bd-5415-48f4-b38e-ceb5f5e0b126\") " pod="kube-system/konnectivity-agent-psqjf"
Jul 31 20:29:57.826333 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826261    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-hostroot\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.826333 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826285    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-multus-daemon-config\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.826333 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826326    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljnxr\" (UniqueName: \"kubernetes.io/projected/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-kube-api-access-ljnxr\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.826895 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826360    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-run-systemd\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.826895 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826388    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-var-lib-openvswitch\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.826895 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826414    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-run-multus-certs\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.826895 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826440    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-etc-kubernetes\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.826895 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826464    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-run-netns\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.826895 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826488    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-cni-netd\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.826895 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826511    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e87137bd-5415-48f4-b38e-ceb5f5e0b126-agent-certs\") pod \"konnectivity-agent-psqjf\" (UID: \"e87137bd-5415-48f4-b38e-ceb5f5e0b126\") " pod="kube-system/konnectivity-agent-psqjf"
Jul 31 20:29:57.826895 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826534    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35536ea9-0cd4-4e62-9c3f-df5f2a224bd4-host\") pod \"node-ca-kjc46\" (UID: \"35536ea9-0cd4-4e62-9c3f-df5f2a224bd4\") " pod="openshift-image-registry/node-ca-kjc46"
Jul 31 20:29:57.826895 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826558    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-run-k8s-cni-cncf-io\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.826895 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826585    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-multus-conf-dir\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.826895 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826608    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/989a725a-1ed0-4ea5-90a0-712ed039d2f3-iptables-alerter-script\") pod \"iptables-alerter-h5w65\" (UID: \"989a725a-1ed0-4ea5-90a0-712ed039d2f3\") " pod="openshift-network-operator/iptables-alerter-h5w65"
Jul 31 20:29:57.826895 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826634    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-run-openvswitch\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.826895 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826660    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-cni-bin\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.826895 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826681    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmlf8\" (UniqueName: \"kubernetes.io/projected/34ad9000-0cac-4d3d-95a5-e2a440147d9e-kube-api-access-zmlf8\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.826895 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826697    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-multus-cni-dir\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.826895 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826712    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-var-lib-cni-multus\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.826895 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826737    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/989a725a-1ed0-4ea5-90a0-712ed039d2f3-host-slash\") pod \"iptables-alerter-h5w65\" (UID: \"989a725a-1ed0-4ea5-90a0-712ed039d2f3\") " pod="openshift-network-operator/iptables-alerter-h5w65"
Jul 31 20:29:57.827673 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826752    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-run-ovn\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.827673 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826768    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/35536ea9-0cd4-4e62-9c3f-df5f2a224bd4-serviceca\") pod \"node-ca-kjc46\" (UID: \"35536ea9-0cd4-4e62-9c3f-df5f2a224bd4\") " pod="openshift-image-registry/node-ca-kjc46"
Jul 31 20:29:57.827673 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826800    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-var-lib-kubelet\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.827673 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826814    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxrq6\" (UniqueName: \"kubernetes.io/projected/989a725a-1ed0-4ea5-90a0-712ed039d2f3-kube-api-access-bxrq6\") pod \"iptables-alerter-h5w65\" (UID: \"989a725a-1ed0-4ea5-90a0-712ed039d2f3\") " pod="openshift-network-operator/iptables-alerter-h5w65"
Jul 31 20:29:57.827673 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826830    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.827673 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826859    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/34ad9000-0cac-4d3d-95a5-e2a440147d9e-ovnkube-script-lib\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.827673 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.826874    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-999p9\" (UniqueName: \"kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9\") pod \"network-check-target-n4b78\" (UID: \"02901a22-831e-45fa-a04d-dc48ec82dd78\") " pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:29:57.830500 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.829340    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6zphn\""
Jul 31 20:29:57.830500 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.829544    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 31 20:29:57.830500 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.829784    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 31 20:29:57.830500 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.829981    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 31 20:29:57.830500 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.830444    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:29:57.830801 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:57.830605    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:29:57.831340 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.831321    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:57.834170 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.834124    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 31 20:29:57.834967 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.834564    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5t7pr\""
Jul 31 20:29:57.834967 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.834686    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 31 20:29:57.834967 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.834946    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:29:57.835161 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:57.835006    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:29:57.854061 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.853762    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p7r79"
Jul 31 20:29:57.862570 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.862190    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p7r79"
Jul 31 20:29:57.912162 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.912122    2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 31 20:29:57.927245 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.927207    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjvs2\" (UniqueName: \"kubernetes.io/projected/488c36c4-397a-46d9-a06a-5a6f800e6afb-kube-api-access-vjvs2\") pod \"node-resolver-7qphl\" (UID: \"488c36c4-397a-46d9-a06a-5a6f800e6afb\") " pod="openshift-dns/node-resolver-7qphl"
Jul 31 20:29:57.927494 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.927449    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs\") pod \"network-metrics-daemon-p75dl\" (UID: \"08a2bbf1-6485-4039-bb50-d2b54965d862\") " pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:29:57.927589 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.927514    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-kubelet\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.927589 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.927545    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e87137bd-5415-48f4-b38e-ceb5f5e0b126-konnectivity-ca\") pod \"konnectivity-agent-psqjf\" (UID: \"e87137bd-5415-48f4-b38e-ceb5f5e0b126\") " pod="kube-system/konnectivity-agent-psqjf"
Jul 31 20:29:57.927700 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.927571    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv8v2\" (UniqueName: \"kubernetes.io/projected/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-kube-api-access-jv8v2\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:57.927700 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.927601    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-kubelet\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.927700 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.927613    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-lib-modules\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:57.927700 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.927640    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vl6v\" (UniqueName: \"kubernetes.io/projected/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-kube-api-access-4vl6v\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:57.927700 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.927668    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-var-lib-openvswitch\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.927974 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.927718    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-cnibin\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:57.927974 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.927746    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-run-netns\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.927974 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.927885    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-var-lib-openvswitch\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.927974 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.927882    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-cni-netd\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.927974 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.927954    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-cni-netd\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.928299 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928005    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-run-netns\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.928299 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928024    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e87137bd-5415-48f4-b38e-ceb5f5e0b126-agent-certs\") pod \"konnectivity-agent-psqjf\" (UID: \"e87137bd-5415-48f4-b38e-ceb5f5e0b126\") " pod="kube-system/konnectivity-agent-psqjf"
Jul 31 20:29:57.928299 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928081    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35536ea9-0cd4-4e62-9c3f-df5f2a224bd4-host\") pod \"node-ca-kjc46\" (UID: \"35536ea9-0cd4-4e62-9c3f-df5f2a224bd4\") " pod="openshift-image-registry/node-ca-kjc46"
Jul 31 20:29:57.928299 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928120    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-run-k8s-cni-cncf-io\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.928299 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928152    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-etc-selinux\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:57.928299 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928195    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-sysctl-conf\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:57.928299 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928240    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-run-openvswitch\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.928299 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928249    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-run-k8s-cni-cncf-io\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.928299 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928297    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35536ea9-0cd4-4e62-9c3f-df5f2a224bd4-host\") pod \"node-ca-kjc46\" (UID: \"35536ea9-0cd4-4e62-9c3f-df5f2a224bd4\") " pod="openshift-image-registry/node-ca-kjc46"
Jul 31 20:29:57.928776 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928316    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-run-openvswitch\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.928776 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928330    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e87137bd-5415-48f4-b38e-ceb5f5e0b126-konnectivity-ca\") pod \"konnectivity-agent-psqjf\" (UID: \"e87137bd-5415-48f4-b38e-ceb5f5e0b126\") " pod="kube-system/konnectivity-agent-psqjf"
Jul 31 20:29:57.928776 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928361    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-cni-bin\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.928776 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928406    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmlf8\" (UniqueName: \"kubernetes.io/projected/34ad9000-0cac-4d3d-95a5-e2a440147d9e-kube-api-access-zmlf8\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.928776 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928440    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-cni-bin\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.928776 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928490    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/989a725a-1ed0-4ea5-90a0-712ed039d2f3-host-slash\") pod \"iptables-alerter-h5w65\" (UID: \"989a725a-1ed0-4ea5-90a0-712ed039d2f3\") " pod="openshift-network-operator/iptables-alerter-h5w65"
Jul 31 20:29:57.928776 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928512    2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 31 20:29:57.928776 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928608    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-registration-dir\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:57.928776 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928630    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/488c36c4-397a-46d9-a06a-5a6f800e6afb-hosts-file\") pod \"node-resolver-7qphl\" (UID: \"488c36c4-397a-46d9-a06a-5a6f800e6afb\") " pod="openshift-dns/node-resolver-7qphl"
Jul 31 20:29:57.928776 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928663    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-cni-binary-copy\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:57.928776 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928695    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/989a725a-1ed0-4ea5-90a0-712ed039d2f3-host-slash\") pod \"iptables-alerter-h5w65\" (UID: \"989a725a-1ed0-4ea5-90a0-712ed039d2f3\") " pod="openshift-network-operator/iptables-alerter-h5w65"
Jul 31 20:29:57.928776 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928713    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxrq6\" (UniqueName: \"kubernetes.io/projected/989a725a-1ed0-4ea5-90a0-712ed039d2f3-kube-api-access-bxrq6\") pod \"iptables-alerter-h5w65\" (UID: \"989a725a-1ed0-4ea5-90a0-712ed039d2f3\") " pod="openshift-network-operator/iptables-alerter-h5w65"
Jul 31 20:29:57.929354 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928787    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-sysconfig\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:57.929354 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928847    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-system-cni-dir\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:57.929354 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928891    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:57.929354 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928933    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt2lt\" (UniqueName: \"kubernetes.io/projected/08a2bbf1-6485-4039-bb50-d2b54965d862-kube-api-access-qt2lt\") pod \"network-metrics-daemon-p75dl\" (UID: \"08a2bbf1-6485-4039-bb50-d2b54965d862\") " pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:29:57.929354 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.928956    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-device-dir\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:57.929354 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.929029    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-node-log\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.929354 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.929067    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/34ad9000-0cac-4d3d-95a5-e2a440147d9e-env-overrides\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.929354 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.929096    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-node-log\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.929354 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.929091    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/34ad9000-0cac-4d3d-95a5-e2a440147d9e-ovn-node-metrics-cert\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.929354 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.929149    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-run-multus-certs\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.929354 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.929277    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-run\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:57.929354 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.929290    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-run-multus-certs\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.929354 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.929303    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-tuned\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.933450    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-systemd-units\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.933729    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/34ad9000-0cac-4d3d-95a5-e2a440147d9e-env-overrides\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.934316    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e87137bd-5415-48f4-b38e-ceb5f5e0b126-agent-certs\") pod \"konnectivity-agent-psqjf\" (UID: \"e87137bd-5415-48f4-b38e-ceb5f5e0b126\") " pod="kube-system/konnectivity-agent-psqjf"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936075    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-systemd-units\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936137    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-log-socket\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936188    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-system-cni-dir\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936223    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-run-netns\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936260    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/989a725a-1ed0-4ea5-90a0-712ed039d2f3-iptables-alerter-script\") pod \"iptables-alerter-h5w65\" (UID: \"989a725a-1ed0-4ea5-90a0-712ed039d2f3\") " pod="openshift-network-operator/iptables-alerter-h5w65"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936314    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-sys\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936349    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4203794-32f9-4de5-b9e8-519ad9022bb5-tmp\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936386    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-slash\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936429    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-etc-openvswitch\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936466    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-hostroot\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936502    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-multus-daemon-config\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936571    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljnxr\" (UniqueName: \"kubernetes.io/projected/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-kube-api-access-ljnxr\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936616    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-systemd\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936655    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7bda5031-9205-4c6f-a712-57bfa836841a-dbus\") pod \"global-pull-secret-syncer-zslqn\" (UID: \"7bda5031-9205-4c6f-a712-57bfa836841a\") " pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:29:57.938015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936691    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-run-systemd\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.939060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936732    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-etc-kubernetes\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.939060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936768    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-sys-fs\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:57.939060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936796    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-host\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:57.939060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936835    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret\") pod \"global-pull-secret-syncer-zslqn\" (UID: \"7bda5031-9205-4c6f-a712-57bfa836841a\") " pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:29:57.939060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936869    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-multus-conf-dir\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.939060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936903    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-sysctl-d\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:57.939060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936938    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-var-lib-kubelet\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:57.939060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.936976    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qjtf\" (UniqueName: \"kubernetes.io/projected/a4203794-32f9-4de5-b9e8-519ad9022bb5-kube-api-access-7qjtf\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:57.939060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937016    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7bda5031-9205-4c6f-a712-57bfa836841a-kubelet-config\") pod \"global-pull-secret-syncer-zslqn\" (UID: \"7bda5031-9205-4c6f-a712-57bfa836841a\") " pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:29:57.939060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937060    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-multus-cni-dir\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.939060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937097    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-var-lib-cni-multus\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.939060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937135    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-kubernetes\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:57.939060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937178    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-run-ovn\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.939060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937219    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/35536ea9-0cd4-4e62-9c3f-df5f2a224bd4-serviceca\") pod \"node-ca-kjc46\" (UID: \"35536ea9-0cd4-4e62-9c3f-df5f2a224bd4\") " pod="openshift-image-registry/node-ca-kjc46"
Jul 31 20:29:57.939060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937286    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-var-lib-kubelet\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.939060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937323    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:57.939060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937364    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-log-socket\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.939969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937377    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:57.939969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937433    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.939969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937444    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-system-cni-dir\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.939969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937473    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/34ad9000-0cac-4d3d-95a5-e2a440147d9e-ovnkube-script-lib\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.939969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937515    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-999p9\" (UniqueName: \"kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9\") pod \"network-check-target-n4b78\" (UID: \"02901a22-831e-45fa-a04d-dc48ec82dd78\") " pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:29:57.939969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937548    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-modprobe-d\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:57.939969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937581    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-os-release\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:57.939969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937613    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:57.939969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937644    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-run-ovn-kubernetes\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.939969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937697    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/34ad9000-0cac-4d3d-95a5-e2a440147d9e-ovnkube-config\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.939969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937732    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-cnibin\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.939969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937765    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-os-release\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.939969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937818    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-socket-dir\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:57.939969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937901    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knbcw\" (UniqueName: \"kubernetes.io/projected/35536ea9-0cd4-4e62-9c3f-df5f2a224bd4-kube-api-access-knbcw\") pod \"node-ca-kjc46\" (UID: \"35536ea9-0cd4-4e62-9c3f-df5f2a224bd4\") " pod="openshift-image-registry/node-ca-kjc46"
Jul 31 20:29:57.939969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.937969    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-cni-binary-copy\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.939969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.938009    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-multus-socket-dir-parent\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.939969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.938053    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-var-lib-cni-bin\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.938089    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/488c36c4-397a-46d9-a06a-5a6f800e6afb-tmp-dir\") pod \"node-resolver-7qphl\" (UID: \"488c36c4-397a-46d9-a06a-5a6f800e6afb\") " pod="openshift-dns/node-resolver-7qphl"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.938189    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/34ad9000-0cac-4d3d-95a5-e2a440147d9e-ovn-node-metrics-cert\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.938366    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-var-lib-cni-bin\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.938379    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-multus-socket-dir-parent\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.938429    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-slash\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.938435    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-run-systemd\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.938508    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-etc-kubernetes\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.938735    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-multus-conf-dir\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.938739    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.938792    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-run-netns\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.938795    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-host-run-ovn-kubernetes\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.938946    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-cnibin\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.939018    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-os-release\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.939026    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-cni-binary-copy\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.939171    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-hostroot\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.939269    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-etc-openvswitch\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.939441    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-multus-cni-dir\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.940864 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.939493    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-var-lib-cni-multus\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.941743 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.939584    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/34ad9000-0cac-4d3d-95a5-e2a440147d9e-ovnkube-config\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.941743 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.939719    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-host-var-lib-kubelet\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.941743 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.939760    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/34ad9000-0cac-4d3d-95a5-e2a440147d9e-run-ovn\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.941743 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.939769    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/34ad9000-0cac-4d3d-95a5-e2a440147d9e-ovnkube-script-lib\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.941743 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.940148    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-multus-daemon-config\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.941743 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.940162    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/35536ea9-0cd4-4e62-9c3f-df5f2a224bd4-serviceca\") pod \"node-ca-kjc46\" (UID: \"35536ea9-0cd4-4e62-9c3f-df5f2a224bd4\") " pod="openshift-image-registry/node-ca-kjc46"
Jul 31 20:29:57.941743 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.940949    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/989a725a-1ed0-4ea5-90a0-712ed039d2f3-iptables-alerter-script\") pod \"iptables-alerter-h5w65\" (UID: \"989a725a-1ed0-4ea5-90a0-712ed039d2f3\") " pod="openshift-network-operator/iptables-alerter-h5w65"
Jul 31 20:29:57.942082 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.941768    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxrq6\" (UniqueName: \"kubernetes.io/projected/989a725a-1ed0-4ea5-90a0-712ed039d2f3-kube-api-access-bxrq6\") pod \"iptables-alerter-h5w65\" (UID: \"989a725a-1ed0-4ea5-90a0-712ed039d2f3\") " pod="openshift-network-operator/iptables-alerter-h5w65"
Jul 31 20:29:57.942143 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.942062    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-89.ec2.internal" event={"ID":"7856e23c54e5bbf471253e5fa19904b5","Type":"ContainerStarted","Data":"7adba660765bcb414cdf0194e324f998889deb783a9b4a444f57df6c62ec5d07"}
Jul 31 20:29:57.942269 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.942227    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmlf8\" (UniqueName: \"kubernetes.io/projected/34ad9000-0cac-4d3d-95a5-e2a440147d9e-kube-api-access-zmlf8\") pod \"ovnkube-node-8trv8\" (UID: \"34ad9000-0cac-4d3d-95a5-e2a440147d9e\") " pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:57.944125 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.944097    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal" event={"ID":"c30fb18a7444f8645905067ee4b6e927","Type":"ContainerStarted","Data":"9f58ceb7d75b77df76eb5d687db548a0ff39a5df192e7420006554d58fb93403"}
Jul 31 20:29:57.944329 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:57.944301    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 20:29:57.944329 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:57.944328    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 20:29:57.944474 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:57.944342    2566 projected.go:196] Error preparing data for projected volume kube-api-access-999p9 for pod openshift-network-diagnostics/network-check-target-n4b78: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:29:57.944474 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:57.944451    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9 podName:02901a22-831e-45fa-a04d-dc48ec82dd78 nodeName:}" failed. No retries permitted until 2026-07-31 20:29:58.444427689 +0000 UTC m=+3.049820164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-999p9" (UniqueName: "kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9") pod "network-check-target-n4b78" (UID: "02901a22-831e-45fa-a04d-dc48ec82dd78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:29:57.945357 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.945299    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljnxr\" (UniqueName: \"kubernetes.io/projected/d58cbbfa-0e7c-41b6-ab6b-9ff49744843e-kube-api-access-ljnxr\") pod \"multus-2jz7q\" (UID: \"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e\") " pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:57.947916 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:57.947894    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knbcw\" (UniqueName: \"kubernetes.io/projected/35536ea9-0cd4-4e62-9c3f-df5f2a224bd4-kube-api-access-knbcw\") pod \"node-ca-kjc46\" (UID: \"35536ea9-0cd4-4e62-9c3f-df5f2a224bd4\") " pod="openshift-image-registry/node-ca-kjc46"
Jul 31 20:29:58.041672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039196    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:58.041672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039255    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:58.041672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039306    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-modprobe-d\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.041672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039308    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:58.041672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039350    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-os-release\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:58.041672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039377    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:58.041672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039408    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-socket-dir\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:58.041672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039440    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/488c36c4-397a-46d9-a06a-5a6f800e6afb-tmp-dir\") pod \"node-resolver-7qphl\" (UID: \"488c36c4-397a-46d9-a06a-5a6f800e6afb\") " pod="openshift-dns/node-resolver-7qphl"
Jul 31 20:29:58.041672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039464    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjvs2\" (UniqueName: \"kubernetes.io/projected/488c36c4-397a-46d9-a06a-5a6f800e6afb-kube-api-access-vjvs2\") pod \"node-resolver-7qphl\" (UID: \"488c36c4-397a-46d9-a06a-5a6f800e6afb\") " pod="openshift-dns/node-resolver-7qphl"
Jul 31 20:29:58.041672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039481    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-modprobe-d\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.041672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039498    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs\") pod \"network-metrics-daemon-p75dl\" (UID: \"08a2bbf1-6485-4039-bb50-d2b54965d862\") " pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:29:58.041672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039527    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv8v2\" (UniqueName: \"kubernetes.io/projected/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-kube-api-access-jv8v2\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:58.041672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039553    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-lib-modules\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.041672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039578    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vl6v\" (UniqueName: \"kubernetes.io/projected/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-kube-api-access-4vl6v\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:58.041672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039604    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-cnibin\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:58.041672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039644    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-etc-selinux\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:58.041672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039677    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-sysctl-conf\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.042719 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039705    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-registration-dir\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:58.042719 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039730    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/488c36c4-397a-46d9-a06a-5a6f800e6afb-hosts-file\") pod \"node-resolver-7qphl\" (UID: \"488c36c4-397a-46d9-a06a-5a6f800e6afb\") " pod="openshift-dns/node-resolver-7qphl"
Jul 31 20:29:58.042719 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039756    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-cni-binary-copy\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:58.042719 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039782    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-sysconfig\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.042719 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039806    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-system-cni-dir\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:58.042719 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039835    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:58.042719 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039862    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt2lt\" (UniqueName: \"kubernetes.io/projected/08a2bbf1-6485-4039-bb50-d2b54965d862-kube-api-access-qt2lt\") pod \"network-metrics-daemon-p75dl\" (UID: \"08a2bbf1-6485-4039-bb50-d2b54965d862\") " pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:29:58.042719 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039904    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-device-dir\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:58.042719 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039935    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-run\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.042719 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039962    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-tuned\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.042719 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039966    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:58.042719 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.039992    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-sys\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.042719 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040017    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4203794-32f9-4de5-b9e8-519ad9022bb5-tmp\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.042719 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040046    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-systemd\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.042719 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040060    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-os-release\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:58.042719 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040070    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7bda5031-9205-4c6f-a712-57bfa836841a-dbus\") pod \"global-pull-secret-syncer-zslqn\" (UID: \"7bda5031-9205-4c6f-a712-57bfa836841a\") " pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:29:58.042719 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040097    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-sys-fs\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:58.043584 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040121    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-host\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.043584 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040159    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret\") pod \"global-pull-secret-syncer-zslqn\" (UID: \"7bda5031-9205-4c6f-a712-57bfa836841a\") " pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:29:58.043584 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040182    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:58.043584 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040186    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-sysctl-d\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.043584 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040242    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-var-lib-kubelet\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.043584 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040269    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qjtf\" (UniqueName: \"kubernetes.io/projected/a4203794-32f9-4de5-b9e8-519ad9022bb5-kube-api-access-7qjtf\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.043584 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040296    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7bda5031-9205-4c6f-a712-57bfa836841a-kubelet-config\") pod \"global-pull-secret-syncer-zslqn\" (UID: \"7bda5031-9205-4c6f-a712-57bfa836841a\") " pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:29:58.043584 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040326    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-kubernetes\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.043584 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040428    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-kubernetes\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.043584 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:58.040585    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:29:58.043584 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040601    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-sysctl-conf\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.043584 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:58.040644    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs podName:08a2bbf1-6485-4039-bb50-d2b54965d862 nodeName:}" failed. No retries permitted until 2026-07-31 20:29:58.540627021 +0000 UTC m=+3.146019482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs") pod "network-metrics-daemon-p75dl" (UID: "08a2bbf1-6485-4039-bb50-d2b54965d862") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:29:58.043584 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040662    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-registration-dir\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:58.043584 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040717    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/488c36c4-397a-46d9-a06a-5a6f800e6afb-hosts-file\") pod \"node-resolver-7qphl\" (UID: \"488c36c4-397a-46d9-a06a-5a6f800e6afb\") " pod="openshift-dns/node-resolver-7qphl"
Jul 31 20:29:58.043584 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040919    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-lib-modules\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.043584 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.041146    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-cnibin\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:58.043584 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.041186    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-cni-binary-copy\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:58.044462 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.041274    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7bda5031-9205-4c6f-a712-57bfa836841a-dbus\") pod \"global-pull-secret-syncer-zslqn\" (UID: \"7bda5031-9205-4c6f-a712-57bfa836841a\") " pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:29:58.044462 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.041279    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-systemd\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.044462 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.041295    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-var-lib-kubelet\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.044462 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.041295    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-device-dir\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:58.044462 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.041366    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-sys-fs\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:58.044462 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.041380    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-system-cni-dir\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:58.044462 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:58.041412    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 20:29:58.044462 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.041422    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-sys\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.044462 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:58.041459    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret podName:7bda5031-9205-4c6f-a712-57bfa836841a nodeName:}" failed. No retries permitted until 2026-07-31 20:29:58.541443771 +0000 UTC m=+3.146836231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret") pod "global-pull-secret-syncer-zslqn" (UID: "7bda5031-9205-4c6f-a712-57bfa836841a") : object "kube-system"/"original-pull-secret" not registered
Jul 31 20:29:58.044462 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.041471    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-run\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.044462 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.041480    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-sysctl-d\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.044462 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.041514    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-host\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.044462 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.040272    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-socket-dir\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:58.044462 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.041533    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7bda5031-9205-4c6f-a712-57bfa836841a-kubelet-config\") pod \"global-pull-secret-syncer-zslqn\" (UID: \"7bda5031-9205-4c6f-a712-57bfa836841a\") " pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:29:58.044462 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.041576    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-sysconfig\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.044462 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.041635    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-etc-selinux\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:58.044462 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.041778    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/488c36c4-397a-46d9-a06a-5a6f800e6afb-tmp-dir\") pod \"node-resolver-7qphl\" (UID: \"488c36c4-397a-46d9-a06a-5a6f800e6afb\") " pod="openshift-dns/node-resolver-7qphl"
Jul 31 20:29:58.045346 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.041900    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:58.045346 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.044342    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4203794-32f9-4de5-b9e8-519ad9022bb5-tmp\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.045346 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.044405    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a4203794-32f9-4de5-b9e8-519ad9022bb5-etc-tuned\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.050299 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.050243    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjvs2\" (UniqueName: \"kubernetes.io/projected/488c36c4-397a-46d9-a06a-5a6f800e6afb-kube-api-access-vjvs2\") pod \"node-resolver-7qphl\" (UID: \"488c36c4-397a-46d9-a06a-5a6f800e6afb\") " pod="openshift-dns/node-resolver-7qphl"
Jul 31 20:29:58.050433 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.050341    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt2lt\" (UniqueName: \"kubernetes.io/projected/08a2bbf1-6485-4039-bb50-d2b54965d862-kube-api-access-qt2lt\") pod \"network-metrics-daemon-p75dl\" (UID: \"08a2bbf1-6485-4039-bb50-d2b54965d862\") " pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:29:58.051618 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.051590    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qjtf\" (UniqueName: \"kubernetes.io/projected/a4203794-32f9-4de5-b9e8-519ad9022bb5-kube-api-access-7qjtf\") pod \"tuned-z4476\" (UID: \"a4203794-32f9-4de5-b9e8-519ad9022bb5\") " pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.052292 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.052268    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv8v2\" (UniqueName: \"kubernetes.io/projected/a3a113ef-fe19-4bcd-bb87-def5e0ee4a72-kube-api-access-jv8v2\") pod \"aws-ebs-csi-driver-node-bbsln\" (UID: \"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:58.052666 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.052644    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vl6v\" (UniqueName: \"kubernetes.io/projected/cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2-kube-api-access-4vl6v\") pod \"multus-additional-cni-plugins-22922\" (UID: \"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2\") " pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:58.131355 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.131311    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kjc46"
Jul 31 20:29:58.143762 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.143726    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2jz7q"
Jul 31 20:29:58.152948 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.152917    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h5w65"
Jul 31 20:29:58.161125 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.161091    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:29:58.168256 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.168219    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-psqjf"
Jul 31 20:29:58.186376 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.186334    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln"
Jul 31 20:29:58.193426 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.193398    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z4476"
Jul 31 20:29:58.202364 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.202344    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7qphl"
Jul 31 20:29:58.209383 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.209357    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-22922"
Jul 31 20:29:58.545317 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.545275    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret\") pod \"global-pull-secret-syncer-zslqn\" (UID: \"7bda5031-9205-4c6f-a712-57bfa836841a\") " pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:29:58.545505 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.545338    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-999p9\" (UniqueName: \"kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9\") pod \"network-check-target-n4b78\" (UID: \"02901a22-831e-45fa-a04d-dc48ec82dd78\") " pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:29:58.545505 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.545388    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs\") pod \"network-metrics-daemon-p75dl\" (UID: \"08a2bbf1-6485-4039-bb50-d2b54965d862\") " pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:29:58.545505 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:58.545436    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 20:29:58.545505 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:58.545452    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 20:29:58.545505 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:58.545500    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 20:29:58.545697 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:58.545518    2566 projected.go:196] Error preparing data for projected volume kube-api-access-999p9 for pod openshift-network-diagnostics/network-check-target-n4b78: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:29:58.545697 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:58.545531    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret podName:7bda5031-9205-4c6f-a712-57bfa836841a nodeName:}" failed. No retries permitted until 2026-07-31 20:29:59.545509863 +0000 UTC m=+4.150902321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret") pod "global-pull-secret-syncer-zslqn" (UID: "7bda5031-9205-4c6f-a712-57bfa836841a") : object "kube-system"/"original-pull-secret" not registered
Jul 31 20:29:58.545697 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:58.545503    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:29:58.545697 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:58.545583    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9 podName:02901a22-831e-45fa-a04d-dc48ec82dd78 nodeName:}" failed. No retries permitted until 2026-07-31 20:29:59.545561531 +0000 UTC m=+4.150953996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-999p9" (UniqueName: "kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9") pod "network-check-target-n4b78" (UID: "02901a22-831e-45fa-a04d-dc48ec82dd78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:29:58.545697 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:58.545604    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs podName:08a2bbf1-6485-4039-bb50-d2b54965d862 nodeName:}" failed. No retries permitted until 2026-07-31 20:29:59.545594492 +0000 UTC m=+4.150986948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs") pod "network-metrics-daemon-p75dl" (UID: "08a2bbf1-6485-4039-bb50-d2b54965d862") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:29:58.867380 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.867284    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 20:24:58 +0000 UTC" deadline="2028-02-06 00:01:20.88596494 +0000 UTC"
Jul 31 20:29:58.867380 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.867323    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13299h31m22.018646481s"
Jul 31 20:29:58.929857 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:58.929827    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:29:58.930041 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:58.929970    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:29:59.153322 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:59.153285    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ad9000_0cac_4d3d_95a5_e2a440147d9e.slice/crio-b133f0b3eef129e247a5a6985da60836fc7c24139a3af1262e8ff5c0ae2f0a90 WatchSource:0}: Error finding container b133f0b3eef129e247a5a6985da60836fc7c24139a3af1262e8ff5c0ae2f0a90: Status 404 returned error can't find the container with id b133f0b3eef129e247a5a6985da60836fc7c24139a3af1262e8ff5c0ae2f0a90
Jul 31 20:29:59.155294 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:59.155268    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod989a725a_1ed0_4ea5_90a0_712ed039d2f3.slice/crio-2cf38da481441a783d30bd5bceaffbf30483c989ca4628f306ddf4a2a4c0f4fe WatchSource:0}: Error finding container 2cf38da481441a783d30bd5bceaffbf30483c989ca4628f306ddf4a2a4c0f4fe: Status 404 returned error can't find the container with id 2cf38da481441a783d30bd5bceaffbf30483c989ca4628f306ddf4a2a4c0f4fe
Jul 31 20:29:59.160267 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:59.160241    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd58cbbfa_0e7c_41b6_ab6b_9ff49744843e.slice/crio-5d1c11c7df621f3231cce08a9e95a8629ef2f24c92a88ff28b3300564d7163b6 WatchSource:0}: Error finding container 5d1c11c7df621f3231cce08a9e95a8629ef2f24c92a88ff28b3300564d7163b6: Status 404 returned error can't find the container with id 5d1c11c7df621f3231cce08a9e95a8629ef2f24c92a88ff28b3300564d7163b6
Jul 31 20:29:59.161912 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:59.161888    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod488c36c4_397a_46d9_a06a_5a6f800e6afb.slice/crio-42f238a2b40cda28f15790069c251c95ee33a810c76e669d780d6798c0c061b5 WatchSource:0}: Error finding container 42f238a2b40cda28f15790069c251c95ee33a810c76e669d780d6798c0c061b5: Status 404 returned error can't find the container with id 42f238a2b40cda28f15790069c251c95ee33a810c76e669d780d6798c0c061b5
Jul 31 20:29:59.163859 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:59.163832    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1a2985_5bf1_43cb_8172_3ee7f2f4afc2.slice/crio-27775e072d6b806e3397407c8e7fc3751dd35b87a190181692baba5124a1ca6c WatchSource:0}: Error finding container 27775e072d6b806e3397407c8e7fc3751dd35b87a190181692baba5124a1ca6c: Status 404 returned error can't find the container with id 27775e072d6b806e3397407c8e7fc3751dd35b87a190181692baba5124a1ca6c
Jul 31 20:29:59.164370 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:59.164340    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35536ea9_0cd4_4e62_9c3f_df5f2a224bd4.slice/crio-167ab2659c9a9c83b1dca38cdf44db80efb024631bfe1de97d29756c704dac29 WatchSource:0}: Error finding container 167ab2659c9a9c83b1dca38cdf44db80efb024631bfe1de97d29756c704dac29: Status 404 returned error can't find the container with id 167ab2659c9a9c83b1dca38cdf44db80efb024631bfe1de97d29756c704dac29
Jul 31 20:29:59.166137 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:59.166111    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4203794_32f9_4de5_b9e8_519ad9022bb5.slice/crio-4fff986b1e04f60546d502d66907e94da9de079a50087316ca045902fd893fb4 WatchSource:0}: Error finding container 4fff986b1e04f60546d502d66907e94da9de079a50087316ca045902fd893fb4: Status 404 returned error can't find the container with id 4fff986b1e04f60546d502d66907e94da9de079a50087316ca045902fd893fb4
Jul 31 20:29:59.167080 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:59.167060    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3a113ef_fe19_4bcd_bb87_def5e0ee4a72.slice/crio-c7ad9b8f40e04c0a29f69793c74c68b9de1d04346b6a18702fd7c751ca443d16 WatchSource:0}: Error finding container c7ad9b8f40e04c0a29f69793c74c68b9de1d04346b6a18702fd7c751ca443d16: Status 404 returned error can't find the container with id c7ad9b8f40e04c0a29f69793c74c68b9de1d04346b6a18702fd7c751ca443d16
Jul 31 20:29:59.168146 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:29:59.168100    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode87137bd_5415_48f4_b38e_ceb5f5e0b126.slice/crio-60d19e1a507d3e28ef3752dff1cf70cf2d1bee55822ada2a43d1c875fd94c8f6 WatchSource:0}: Error finding container 60d19e1a507d3e28ef3752dff1cf70cf2d1bee55822ada2a43d1c875fd94c8f6: Status 404 returned error can't find the container with id 60d19e1a507d3e28ef3752dff1cf70cf2d1bee55822ada2a43d1c875fd94c8f6
Jul 31 20:29:59.450791 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:59.449599    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 31 20:29:59.552939 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:59.552884    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret\") pod \"global-pull-secret-syncer-zslqn\" (UID: \"7bda5031-9205-4c6f-a712-57bfa836841a\") " pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:29:59.553101 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:59.552970    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-999p9\" (UniqueName: \"kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9\") pod \"network-check-target-n4b78\" (UID: \"02901a22-831e-45fa-a04d-dc48ec82dd78\") " pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:29:59.553101 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:59.553011    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs\") pod \"network-metrics-daemon-p75dl\" (UID: \"08a2bbf1-6485-4039-bb50-d2b54965d862\") " pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:29:59.553101 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:59.553054    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 20:29:59.553275 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:59.553137    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret podName:7bda5031-9205-4c6f-a712-57bfa836841a nodeName:}" failed. No retries permitted until 2026-07-31 20:30:01.553115987 +0000 UTC m=+6.158508467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret") pod "global-pull-secret-syncer-zslqn" (UID: "7bda5031-9205-4c6f-a712-57bfa836841a") : object "kube-system"/"original-pull-secret" not registered
Jul 31 20:29:59.553275 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:59.553138    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:29:59.553275 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:59.553145    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 20:29:59.553275 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:59.553195    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 20:29:59.553275 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:59.553209    2566 projected.go:196] Error preparing data for projected volume kube-api-access-999p9 for pod openshift-network-diagnostics/network-check-target-n4b78: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:29:59.553275 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:59.553221    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs podName:08a2bbf1-6485-4039-bb50-d2b54965d862 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:01.553179524 +0000 UTC m=+6.158572001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs") pod "network-metrics-daemon-p75dl" (UID: "08a2bbf1-6485-4039-bb50-d2b54965d862") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:29:59.553275 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:59.553268    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9 podName:02901a22-831e-45fa-a04d-dc48ec82dd78 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:01.553254443 +0000 UTC m=+6.158646901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-999p9" (UniqueName: "kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9") pod "network-check-target-n4b78" (UID: "02901a22-831e-45fa-a04d-dc48ec82dd78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:29:59.867991 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:59.867914    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 20:24:58 +0000 UTC" deadline="2028-01-25 19:53:16.295196857 +0000 UTC"
Jul 31 20:29:59.867991 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:59.867988    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13031h23m16.427213151s"
Jul 31 20:29:59.936306 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:59.936277    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:29:59.936507 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:59.936408    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:29:59.936870 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:59.936825    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:29:59.936946 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:29:59.936921    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:29:59.951049 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:59.950963    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kjc46" event={"ID":"35536ea9-0cd4-4e62-9c3f-df5f2a224bd4","Type":"ContainerStarted","Data":"167ab2659c9a9c83b1dca38cdf44db80efb024631bfe1de97d29756c704dac29"}
Jul 31 20:29:59.954179 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:59.954086    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7qphl" event={"ID":"488c36c4-397a-46d9-a06a-5a6f800e6afb","Type":"ContainerStarted","Data":"42f238a2b40cda28f15790069c251c95ee33a810c76e669d780d6798c0c061b5"}
Jul 31 20:29:59.960990 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:59.960884    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2jz7q" event={"ID":"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e","Type":"ContainerStarted","Data":"5d1c11c7df621f3231cce08a9e95a8629ef2f24c92a88ff28b3300564d7163b6"}
Jul 31 20:29:59.967207 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:59.966545    2566 generic.go:356] "Generic (PLEG): container finished" podID="c30fb18a7444f8645905067ee4b6e927" containerID="8dc04f00db4a9b1008f495d2cdfccd678a849a9b61d5695cd4fc2205fd773305" exitCode=0
Jul 31 20:29:59.967207 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:59.966618    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal" event={"ID":"c30fb18a7444f8645905067ee4b6e927","Type":"ContainerDied","Data":"8dc04f00db4a9b1008f495d2cdfccd678a849a9b61d5695cd4fc2205fd773305"}
Jul 31 20:29:59.973442 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:29:59.973345    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h5w65" event={"ID":"989a725a-1ed0-4ea5-90a0-712ed039d2f3","Type":"ContainerStarted","Data":"2cf38da481441a783d30bd5bceaffbf30483c989ca4628f306ddf4a2a4c0f4fe"}
Jul 31 20:30:00.002622 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:00.002577    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8" event={"ID":"34ad9000-0cac-4d3d-95a5-e2a440147d9e","Type":"ContainerStarted","Data":"b133f0b3eef129e247a5a6985da60836fc7c24139a3af1262e8ff5c0ae2f0a90"}
Jul 31 20:30:00.023046 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:00.023003    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-89.ec2.internal" event={"ID":"7856e23c54e5bbf471253e5fa19904b5","Type":"ContainerStarted","Data":"757c87e57e91cda735f5312fc1378f8a181cae68dc76891ec9578eb50d4d9b94"}
Jul 31 20:30:00.034022 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:00.033983    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln" event={"ID":"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72","Type":"ContainerStarted","Data":"c7ad9b8f40e04c0a29f69793c74c68b9de1d04346b6a18702fd7c751ca443d16"}
Jul 31 20:30:00.046095 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:00.045997    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-psqjf" event={"ID":"e87137bd-5415-48f4-b38e-ceb5f5e0b126","Type":"ContainerStarted","Data":"60d19e1a507d3e28ef3752dff1cf70cf2d1bee55822ada2a43d1c875fd94c8f6"}
Jul 31 20:30:00.051582 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:00.051511    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z4476" event={"ID":"a4203794-32f9-4de5-b9e8-519ad9022bb5","Type":"ContainerStarted","Data":"4fff986b1e04f60546d502d66907e94da9de079a50087316ca045902fd893fb4"}
Jul 31 20:30:00.071246 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:00.071204    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-22922" event={"ID":"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2","Type":"ContainerStarted","Data":"27775e072d6b806e3397407c8e7fc3751dd35b87a190181692baba5124a1ca6c"}
Jul 31 20:30:00.929302 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:00.929271    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:00.929815 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:00.929437    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:30:01.104898 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:01.104855    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal" event={"ID":"c30fb18a7444f8645905067ee4b6e927","Type":"ContainerStarted","Data":"356df0eec829f1f81a51a380754aa01108038bcf319e8d112621d87202a81d3f"}
Jul 31 20:30:01.120154 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:01.120068    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-89.ec2.internal" podStartSLOduration=4.120039989 podStartE2EDuration="4.120039989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:00.039526373 +0000 UTC m=+4.644918853" watchObservedRunningTime="2026-07-31 20:30:01.120039989 +0000 UTC m=+5.725432467"
Jul 31 20:30:01.572865 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:01.572826    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret\") pod \"global-pull-secret-syncer-zslqn\" (UID: \"7bda5031-9205-4c6f-a712-57bfa836841a\") " pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:01.573071 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:01.572889    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-999p9\" (UniqueName: \"kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9\") pod \"network-check-target-n4b78\" (UID: \"02901a22-831e-45fa-a04d-dc48ec82dd78\") " pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:01.573071 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:01.572927    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs\") pod \"network-metrics-daemon-p75dl\" (UID: \"08a2bbf1-6485-4039-bb50-d2b54965d862\") " pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:01.573071 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:01.573040    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:30:01.573278 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:01.573087    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs podName:08a2bbf1-6485-4039-bb50-d2b54965d862 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:05.573073019 +0000 UTC m=+10.178465477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs") pod "network-metrics-daemon-p75dl" (UID: "08a2bbf1-6485-4039-bb50-d2b54965d862") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:30:01.573847 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:01.573477    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 20:30:01.573847 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:01.573535    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret podName:7bda5031-9205-4c6f-a712-57bfa836841a nodeName:}" failed. No retries permitted until 2026-07-31 20:30:05.573518667 +0000 UTC m=+10.178911126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret") pod "global-pull-secret-syncer-zslqn" (UID: "7bda5031-9205-4c6f-a712-57bfa836841a") : object "kube-system"/"original-pull-secret" not registered
Jul 31 20:30:01.573847 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:01.573637    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 20:30:01.573847 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:01.573653    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 20:30:01.573847 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:01.573666    2566 projected.go:196] Error preparing data for projected volume kube-api-access-999p9 for pod openshift-network-diagnostics/network-check-target-n4b78: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:30:01.573847 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:01.573701    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9 podName:02901a22-831e-45fa-a04d-dc48ec82dd78 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:05.573689411 +0000 UTC m=+10.179081871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-999p9" (UniqueName: "kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9") pod "network-check-target-n4b78" (UID: "02901a22-831e-45fa-a04d-dc48ec82dd78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:30:01.944680 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:01.943671    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:01.944680 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:01.943801    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:30:01.944680 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:01.944209    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:01.944680 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:01.944412    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:30:02.929334 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:02.929297    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:02.929546 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:02.929453    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:30:03.929825 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:03.929783    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:03.930314 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:03.929916    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:30:03.930396 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:03.930320    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:03.930396 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:03.930388    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:30:04.930019 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:04.929538    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:04.930019 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:04.929696    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:30:05.611232 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:05.611188    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs\") pod \"network-metrics-daemon-p75dl\" (UID: \"08a2bbf1-6485-4039-bb50-d2b54965d862\") " pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:05.611432 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:05.611256    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret\") pod \"global-pull-secret-syncer-zslqn\" (UID: \"7bda5031-9205-4c6f-a712-57bfa836841a\") " pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:05.611432 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:05.611290    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-999p9\" (UniqueName: \"kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9\") pod \"network-check-target-n4b78\" (UID: \"02901a22-831e-45fa-a04d-dc48ec82dd78\") " pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:05.611432 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:05.611427    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 20:30:05.611625 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:05.611446    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 20:30:05.611625 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:05.611456    2566 projected.go:196] Error preparing data for projected volume kube-api-access-999p9 for pod openshift-network-diagnostics/network-check-target-n4b78: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:30:05.611625 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:05.611511    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9 podName:02901a22-831e-45fa-a04d-dc48ec82dd78 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:13.611496156 +0000 UTC m=+18.216888611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-999p9" (UniqueName: "kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9") pod "network-check-target-n4b78" (UID: "02901a22-831e-45fa-a04d-dc48ec82dd78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:30:05.611926 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:05.611910    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:30:05.611976 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:05.611966    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs podName:08a2bbf1-6485-4039-bb50-d2b54965d862 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:13.611951497 +0000 UTC m=+18.217343954 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs") pod "network-metrics-daemon-p75dl" (UID: "08a2bbf1-6485-4039-bb50-d2b54965d862") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:30:05.612015 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:05.612010    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 20:30:05.612050 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:05.612037    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret podName:7bda5031-9205-4c6f-a712-57bfa836841a nodeName:}" failed. No retries permitted until 2026-07-31 20:30:13.612027336 +0000 UTC m=+18.217419792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret") pod "global-pull-secret-syncer-zslqn" (UID: "7bda5031-9205-4c6f-a712-57bfa836841a") : object "kube-system"/"original-pull-secret" not registered
Jul 31 20:30:05.935584 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:05.935507    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:05.935584 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:05.935565    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:05.936130 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:05.935664    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:30:05.936130 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:05.935801    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:30:06.928932 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:06.928895    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:06.929304 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:06.929044    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:30:07.934693 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:07.934656    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:07.935167 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:07.934789    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:30:07.935466 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:07.935442    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:07.935581 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:07.935558    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:30:08.929100 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:08.929062    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:08.929324 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:08.929298    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:30:09.932203 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:09.932175    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:09.932596 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:09.932175    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:09.932596 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:09.932269    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:30:09.932596 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:09.932334    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:30:10.929115 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:10.929074    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:10.929306 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:10.929216    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:30:11.932115 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:11.932079    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:11.932115 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:11.932098    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:11.932654 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:11.932205    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:30:11.932654 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:11.932326    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:30:12.929396 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:12.929357    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:12.929619 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:12.929486    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:30:13.676968 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:13.676933    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret\") pod \"global-pull-secret-syncer-zslqn\" (UID: \"7bda5031-9205-4c6f-a712-57bfa836841a\") " pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:13.676968 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:13.676975    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-999p9\" (UniqueName: \"kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9\") pod \"network-check-target-n4b78\" (UID: \"02901a22-831e-45fa-a04d-dc48ec82dd78\") " pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:13.677495 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:13.677001    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs\") pod \"network-metrics-daemon-p75dl\" (UID: \"08a2bbf1-6485-4039-bb50-d2b54965d862\") " pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:13.677495 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:13.677099    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:30:13.677495 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:13.677101    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 20:30:13.677495 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:13.677111    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 20:30:13.677495 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:13.677180    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs podName:08a2bbf1-6485-4039-bb50-d2b54965d862 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:29.677141681 +0000 UTC m=+34.282534134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs") pod "network-metrics-daemon-p75dl" (UID: "08a2bbf1-6485-4039-bb50-d2b54965d862") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:30:13.677495 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:13.677192    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 20:30:13.677495 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:13.677199    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret podName:7bda5031-9205-4c6f-a712-57bfa836841a nodeName:}" failed. No retries permitted until 2026-07-31 20:30:29.677189061 +0000 UTC m=+34.282581520 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret") pod "global-pull-secret-syncer-zslqn" (UID: "7bda5031-9205-4c6f-a712-57bfa836841a") : object "kube-system"/"original-pull-secret" not registered
Jul 31 20:30:13.677495 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:13.677207    2566 projected.go:196] Error preparing data for projected volume kube-api-access-999p9 for pod openshift-network-diagnostics/network-check-target-n4b78: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:30:13.677495 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:13.677241    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9 podName:02901a22-831e-45fa-a04d-dc48ec82dd78 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:29.677231473 +0000 UTC m=+34.282623928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-999p9" (UniqueName: "kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9") pod "network-check-target-n4b78" (UID: "02901a22-831e-45fa-a04d-dc48ec82dd78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:30:13.929643 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:13.929547    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:13.929812 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:13.929703    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:30:13.929812 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:13.929753    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:13.929890 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:13.929855    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:30:14.929940 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:14.929901    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:14.930372 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:14.930024    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:30:15.929874 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:15.929837    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:15.930050 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:15.929931    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:15.930050 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:15.929963    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:30:15.930050 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:15.929999    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:30:16.929945 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:16.929904    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:16.930115 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:16.930034    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:30:17.928930 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:17.928892    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:17.929131 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:17.929011    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:30:17.929131 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:17.929071    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:17.929270 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:17.929201    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:30:18.929445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:18.929416    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:18.929977 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:18.929525    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:30:19.147216 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:19.147010    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z4476" event={"ID":"a4203794-32f9-4de5-b9e8-519ad9022bb5","Type":"ContainerStarted","Data":"c37e1001c18525418fc1b4fe1a3ecfef6be7df19a2c77d3fc596a67fb7f014b5"}
Jul 31 20:30:19.168008 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:19.167945    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z4476" podStartSLOduration=3.345903994 podStartE2EDuration="23.167926312s" totalImagesPullingTime="19.822022318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:19.167040081 +0000 UTC m=+23.772432557" watchObservedRunningTime="2026-07-31 20:30:19.167926312 +0000 UTC m=+23.773318789"
Jul 31 20:30:19.168280 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:19.168129    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-89.ec2.internal" podStartSLOduration=22.168122801 podStartE2EDuration="22.168122801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:01.121678128 +0000 UTC m=+5.727070609" watchObservedRunningTime="2026-07-31 20:30:19.168122801 +0000 UTC m=+23.773515279"
Jul 31 20:30:19.929725 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:19.929480    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:19.930531 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:19.929529    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:19.930531 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:19.929839    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:30:19.930531 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:19.929914    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:30:20.150951 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.150915    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln" event={"ID":"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72","Type":"ContainerStarted","Data":"b9a550224a4c88a04906e3c6c19c3dcf9e0a7d5dcb98f2ba492f895e90217acf"}
Jul 31 20:30:20.152537 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.152508    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-psqjf" event={"ID":"e87137bd-5415-48f4-b38e-ceb5f5e0b126","Type":"ContainerStarted","Data":"c538a231530a4ff060410a0b7f48dfbf2b3173853f345f986b6082006fa310a7"}
Jul 31 20:30:20.154062 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.154035    2566 generic.go:356] "Generic (PLEG): container finished" podID="cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2" containerID="dbcd37fd8a72f1d3acc177e514ec7627ebe2708c297ab053a57da79d95e879c0" exitCode=0
Jul 31 20:30:20.154199 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.154113    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-22922" event={"ID":"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2","Type":"ContainerDied","Data":"dbcd37fd8a72f1d3acc177e514ec7627ebe2708c297ab053a57da79d95e879c0"}
Jul 31 20:30:20.155839 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.155715    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kjc46" event={"ID":"35536ea9-0cd4-4e62-9c3f-df5f2a224bd4","Type":"ContainerStarted","Data":"86bc1e9dff8d6b0ffdb148b4a9cdae9bba6cccbd2dc662fe55bc1303396c375b"}
Jul 31 20:30:20.157425 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.157404    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7qphl" event={"ID":"488c36c4-397a-46d9-a06a-5a6f800e6afb","Type":"ContainerStarted","Data":"7d045a46597aaf42a24f6987e063c36021b63cf6f55555ee1ab8914c4998a8f3"}
Jul 31 20:30:20.159018 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.158996    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2jz7q" event={"ID":"d58cbbfa-0e7c-41b6-ab6b-9ff49744843e","Type":"ContainerStarted","Data":"2ec92af1e33cff8488e219eae84d864325497423499447080b537f48fddd2dae"}
Jul 31 20:30:20.162385 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.162367    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8" event={"ID":"34ad9000-0cac-4d3d-95a5-e2a440147d9e","Type":"ContainerStarted","Data":"07a0d5feb64e31b32ea6948357cb9f4196427188491498258f99f8213a7debd7"}
Jul 31 20:30:20.162484 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.162432    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8" event={"ID":"34ad9000-0cac-4d3d-95a5-e2a440147d9e","Type":"ContainerStarted","Data":"3777f84844c4a9bf04fce6969a60a104cb078ba357bab00b2c5a9c228549e033"}
Jul 31 20:30:20.162484 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.162463    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8" event={"ID":"34ad9000-0cac-4d3d-95a5-e2a440147d9e","Type":"ContainerStarted","Data":"2ea1eea43bbb02e63776ec3f56eb9995a9bbd1d48c687a19cda6d3f03a3fa8d9"}
Jul 31 20:30:20.162567 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.162495    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8" event={"ID":"34ad9000-0cac-4d3d-95a5-e2a440147d9e","Type":"ContainerStarted","Data":"2f539818ea9db5afab760fa0c0339b1d6993c613f72599693b795e55c8851b3b"}
Jul 31 20:30:20.162567 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.162530    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8" event={"ID":"34ad9000-0cac-4d3d-95a5-e2a440147d9e","Type":"ContainerStarted","Data":"ef2db045ae4c65ae106b5d4f70e37255cab0e5e879b766c9de4947cee099bc9b"}
Jul 31 20:30:20.162567 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.162556    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8" event={"ID":"34ad9000-0cac-4d3d-95a5-e2a440147d9e","Type":"ContainerStarted","Data":"9e6ae338a5d561211459a9759c33860dacd8fd21fe8a796b4be51019751ea308"}
Jul 31 20:30:20.185655 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.185501    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-psqjf" podStartSLOduration=4.422150088 podStartE2EDuration="24.185479324s" totalImagesPullingTime="19.763329236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:20.185375757 +0000 UTC m=+24.790768225" watchObservedRunningTime="2026-07-31 20:30:20.185479324 +0000 UTC m=+24.790871801"
Jul 31 20:30:20.220885 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.220818    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kjc46" podStartSLOduration=4.411948251 podStartE2EDuration="24.220796196s" totalImagesPullingTime="19.808847945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:20.201838744 +0000 UTC m=+24.807231231" watchObservedRunningTime="2026-07-31 20:30:20.220796196 +0000 UTC m=+24.826188675"
Jul 31 20:30:20.221046 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.220928    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2jz7q" podStartSLOduration=4.340476029 podStartE2EDuration="24.220921287s" totalImagesPullingTime="19.880445258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:20.220191111 +0000 UTC m=+24.825583587" watchObservedRunningTime="2026-07-31 20:30:20.220921287 +0000 UTC m=+24.826313764"
Jul 31 20:30:20.240097 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.240044    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7qphl" podStartSLOduration=4.435994942 podStartE2EDuration="24.240026929s" totalImagesPullingTime="19.804031987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:20.239851973 +0000 UTC m=+24.845244671" watchObservedRunningTime="2026-07-31 20:30:20.240026929 +0000 UTC m=+24.845419404"
Jul 31 20:30:20.739928 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.739902    2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 31 20:30:20.901793 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.901624    2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T20:30:20.739922433Z","UUID":"8adb2419-ed32-4581-9a62-9ddbce0634a5","Handler":null,"Name":"","Endpoint":""}
Jul 31 20:30:20.903376 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.903346    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 31 20:30:20.903515 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.903394    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 31 20:30:20.929057 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:20.929023    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:20.929284 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:20.929174    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:30:21.167891 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:21.167809    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln" event={"ID":"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72","Type":"ContainerStarted","Data":"12fb60686166d0338d2d2319de3ad01d7e272fb34671054b686f445f86127c81"}
Jul 31 20:30:21.169917 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:21.169874    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h5w65" event={"ID":"989a725a-1ed0-4ea5-90a0-712ed039d2f3","Type":"ContainerStarted","Data":"ec6a9b23b31d218afcc81e7ca2fecba99f7e9b618cda567ecd1a3798e1b11366"}
Jul 31 20:30:21.929916 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:21.929815    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:21.930078 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:21.929980    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:30:21.930078 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:21.930038    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:21.930216 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:21.930128    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:30:22.175030 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:22.174986    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln" event={"ID":"a3a113ef-fe19-4bcd-bb87-def5e0ee4a72","Type":"ContainerStarted","Data":"fc4c0fc3095bf38321f405a06ac1f331c25708037e1c32e415943f993ee51bc4"}
Jul 31 20:30:22.180757 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:22.180659    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8" event={"ID":"34ad9000-0cac-4d3d-95a5-e2a440147d9e","Type":"ContainerStarted","Data":"fade6e546ab577b0f11bde8eb51fa2b392cba673933d8bb0115a0d8ec6e2ed39"}
Jul 31 20:30:22.200164 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:22.200105    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bbsln" podStartSLOduration=4.116813877 podStartE2EDuration="26.20008723s" totalImagesPullingTime="22.083273353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:22.199816168 +0000 UTC m=+26.805208644" watchObservedRunningTime="2026-07-31 20:30:22.20008723 +0000 UTC m=+26.805479708"
Jul 31 20:30:22.200345 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:22.200318    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h5w65" podStartSLOduration=6.37134361 podStartE2EDuration="26.200311598s" totalImagesPullingTime="19.828967988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:21.191256944 +0000 UTC m=+25.796649420" watchObservedRunningTime="2026-07-31 20:30:22.200311598 +0000 UTC m=+26.805704075"
Jul 31 20:30:22.929852 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:22.929819    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:22.930022 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:22.929964    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:30:23.930035 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:23.929851    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:23.930476 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:23.929926    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:23.930476 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:23.930168    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:30:23.930476 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:23.930238    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:30:24.248745 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:24.248722    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-psqjf"
Jul 31 20:30:24.249292 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:24.249273    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-psqjf"
Jul 31 20:30:24.929800 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:24.929634    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:24.929940 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:24.929878    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:30:25.191263 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:25.191183    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8" event={"ID":"34ad9000-0cac-4d3d-95a5-e2a440147d9e","Type":"ContainerStarted","Data":"c9bcbd866efaff834f4bcffb37638cb44be40763ee1abbba6ee8e53fe115d49f"}
Jul 31 20:30:25.192034 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:25.191446    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:30:25.192034 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:25.191513    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:30:25.193119 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:25.193082    2566 generic.go:356] "Generic (PLEG): container finished" podID="cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2" containerID="21f6efbc9a9da7192c00b42d7f9d333419503b1ea0d49e23a2741a057cadaeec" exitCode=0
Jul 31 20:30:25.193230 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:25.193176    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-22922" event={"ID":"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2","Type":"ContainerDied","Data":"21f6efbc9a9da7192c00b42d7f9d333419503b1ea0d49e23a2741a057cadaeec"}
Jul 31 20:30:25.193378 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:25.193358    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-psqjf"
Jul 31 20:30:25.193753 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:25.193730    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-psqjf"
Jul 31 20:30:25.210869 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:25.210837    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:30:25.217306 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:25.217259    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8" podStartSLOduration=9.33201717 podStartE2EDuration="29.217246317s" totalImagesPullingTime="19.885229147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:25.215966662 +0000 UTC m=+29.821359138" watchObservedRunningTime="2026-07-31 20:30:25.217246317 +0000 UTC m=+29.822638793"
Jul 31 20:30:25.930217 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:25.930191    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:25.930332 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:25.930214    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:25.930386 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:25.930329    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:30:25.930456 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:25.930423    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:30:26.198094 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:26.198002    2566 generic.go:356] "Generic (PLEG): container finished" podID="cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2" containerID="4b8980bc560cbed9798535b174659f259068d18a7257259f1b2f5e92871d7692" exitCode=0
Jul 31 20:30:26.198511 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:26.198087    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-22922" event={"ID":"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2","Type":"ContainerDied","Data":"4b8980bc560cbed9798535b174659f259068d18a7257259f1b2f5e92871d7692"}
Jul 31 20:30:26.198511 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:26.198265    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:30:26.216368 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:26.216337    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:30:26.692982 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:26.692952    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n4b78"]
Jul 31 20:30:26.693195 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:26.693090    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:26.693258 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:26.693214    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:30:26.696420 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:26.696381    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zslqn"]
Jul 31 20:30:26.696575 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:26.696507    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:26.696656 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:26.696629    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:30:26.697268 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:26.697246    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p75dl"]
Jul 31 20:30:26.697366 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:26.697354    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:26.697473 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:26.697451    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:30:27.929869 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:27.929839    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:27.930368 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:27.929848    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:27.930368 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:27.929948    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:30:27.930368 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:27.929847    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:27.930368 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:27.930031    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:30:27.930368 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:27.930131    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:30:28.205969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:28.205937    2566 generic.go:356] "Generic (PLEG): container finished" podID="cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2" containerID="43b11b81a56b13fa75d5ce21e4b2bd5785ff6f58c8ae803896f3f7cf29f28037" exitCode=0
Jul 31 20:30:28.206100 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:28.206018    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-22922" event={"ID":"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2","Type":"ContainerDied","Data":"43b11b81a56b13fa75d5ce21e4b2bd5785ff6f58c8ae803896f3f7cf29f28037"}
Jul 31 20:30:29.692698 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:29.692511    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret\") pod \"global-pull-secret-syncer-zslqn\" (UID: \"7bda5031-9205-4c6f-a712-57bfa836841a\") " pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:29.693252 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:29.692713    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-999p9\" (UniqueName: \"kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9\") pod \"network-check-target-n4b78\" (UID: \"02901a22-831e-45fa-a04d-dc48ec82dd78\") " pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:29.693252 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:29.692744    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs\") pod \"network-metrics-daemon-p75dl\" (UID: \"08a2bbf1-6485-4039-bb50-d2b54965d862\") " pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:29.693252 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:29.692660    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 31 20:30:29.693252 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:29.692823    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret podName:7bda5031-9205-4c6f-a712-57bfa836841a nodeName:}" failed. No retries permitted until 2026-07-31 20:31:01.692807047 +0000 UTC m=+66.298199501 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret") pod "global-pull-secret-syncer-zslqn" (UID: "7bda5031-9205-4c6f-a712-57bfa836841a") : object "kube-system"/"original-pull-secret" not registered
Jul 31 20:30:29.693252 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:29.692833    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:30:29.693252 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:29.692849    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 31 20:30:29.693252 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:29.692868    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 31 20:30:29.693252 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:29.692876    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs podName:08a2bbf1-6485-4039-bb50-d2b54965d862 nodeName:}" failed. No retries permitted until 2026-07-31 20:31:01.692863358 +0000 UTC m=+66.298255813 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs") pod "network-metrics-daemon-p75dl" (UID: "08a2bbf1-6485-4039-bb50-d2b54965d862") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 31 20:30:29.693252 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:29.692877    2566 projected.go:196] Error preparing data for projected volume kube-api-access-999p9 for pod openshift-network-diagnostics/network-check-target-n4b78: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:30:29.693252 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:29.692912    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9 podName:02901a22-831e-45fa-a04d-dc48ec82dd78 nodeName:}" failed. No retries permitted until 2026-07-31 20:31:01.692902687 +0000 UTC m=+66.298295142 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-999p9" (UniqueName: "kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9") pod "network-check-target-n4b78" (UID: "02901a22-831e-45fa-a04d-dc48ec82dd78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 31 20:30:29.929417 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:29.929382    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:29.929587 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:29.929390    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:29.929587 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:29.929491    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zslqn" podUID="7bda5031-9205-4c6f-a712-57bfa836841a"
Jul 31 20:30:29.929661 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:29.929584    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n4b78" podUID="02901a22-831e-45fa-a04d-dc48ec82dd78"
Jul 31 20:30:29.929661 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:29.929389    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:29.929730 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:29.929693    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p75dl" podUID="08a2bbf1-6485-4039-bb50-d2b54965d862"
Jul 31 20:30:31.735037 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.735005    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-89.ec2.internal" event="NodeReady"
Jul 31 20:30:31.735440 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.735184    2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 31 20:30:31.766888 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.766848    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77b8bc847-ddshz"]
Jul 31 20:30:31.816887 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.816853    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qxwsp"]
Jul 31 20:30:31.817133 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.816999    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:31.819859 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.819822    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 31 20:30:31.820000 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.819940    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 31 20:30:31.820125 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.820105    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2j4vz\""
Jul 31 20:30:31.820288 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.820266    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 31 20:30:31.825077 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.825057    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 31 20:30:31.829690 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.829670    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qp9gw"]
Jul 31 20:30:31.829793 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.829775    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qxwsp"
Jul 31 20:30:31.832284 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.832261    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jbv2m\""
Jul 31 20:30:31.832380 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.832303    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 31 20:30:31.832483 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.832463    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 31 20:30:31.832602 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.832527    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 31 20:30:31.845772 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.845747    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77b8bc847-ddshz"]
Jul 31 20:30:31.845772 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.845775    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qxwsp"]
Jul 31 20:30:31.845918 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.845790    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qp9gw"]
Jul 31 20:30:31.845918 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.845851    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:31.848014 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.847997    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 31 20:30:31.848135 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.848050    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w7w5c\""
Jul 31 20:30:31.848135 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.848094    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 31 20:30:31.907831 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.907802    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-ca-trust-extracted\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:31.907995 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.907858    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-trusted-ca\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:31.907995 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.907879    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4zjz\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-kube-api-access-j4zjz\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:31.907995 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.907937    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-bound-sa-token\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:31.907995 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.907967    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-image-registry-private-configuration\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:31.907995 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.907994    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:31.908166 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.908010    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-certificates\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:31.908166 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.908030    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-installation-pull-secrets\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:31.929192 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.929159    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:30:31.929367 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.929167    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:30:31.929367 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.929167    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:30:31.931889 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.931861    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 20:30:31.931889 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.931865    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 20:30:31.932076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.932022    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 20:30:31.932138 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.932122    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 20:30:31.932372 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.932351    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9lfhf\""
Jul 31 20:30:31.932465 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:31.932355    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w6hmj\""
Jul 31 20:30:32.009294 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.009255    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-bound-sa-token\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:32.009294 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.009302    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls\") pod \"dns-default-qp9gw\" (UID: \"ccbc72eb-a594-4bde-867d-19dfb2f78bf1\") " pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:32.009556 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.009324    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c18b2c8-16d4-4814-81a3-ecc36a1b3482-cert\") pod \"ingress-canary-qxwsp\" (UID: \"5c18b2c8-16d4-4814-81a3-ecc36a1b3482\") " pod="openshift-ingress-canary/ingress-canary-qxwsp"
Jul 31 20:30:32.009556 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.009421    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-image-registry-private-configuration\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:32.009556 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.009461    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4gff\" (UniqueName: \"kubernetes.io/projected/5c18b2c8-16d4-4814-81a3-ecc36a1b3482-kube-api-access-v4gff\") pod \"ingress-canary-qxwsp\" (UID: \"5c18b2c8-16d4-4814-81a3-ecc36a1b3482\") " pod="openshift-ingress-canary/ingress-canary-qxwsp"
Jul 31 20:30:32.009556 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.009496    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:32.009556 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.009524    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-certificates\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:32.009815 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.009561    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-installation-pull-secrets\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:32.009815 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:32.009597    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 20:30:32.009815 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.009611    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-ca-trust-extracted\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:32.009815 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:32.009616    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b8bc847-ddshz: secret "image-registry-tls" not found
Jul 31 20:30:32.009815 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:32.009693    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls podName:e3e98058-4022-41fd-9a1c-10b2d8fe5ef7 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:32.50967225 +0000 UTC m=+37.115064718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls") pod "image-registry-77b8bc847-ddshz" (UID: "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7") : secret "image-registry-tls" not found
Jul 31 20:30:32.010071 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.009951    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-tmp-dir\") pod \"dns-default-qp9gw\" (UID: \"ccbc72eb-a594-4bde-867d-19dfb2f78bf1\") " pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:32.010071 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.010028    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-trusted-ca\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:32.010071 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.010033    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-ca-trust-extracted\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:32.010071 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.010052    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-config-volume\") pod \"dns-default-qp9gw\" (UID: \"ccbc72eb-a594-4bde-867d-19dfb2f78bf1\") " pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:32.010302 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.010079    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4zjz\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-kube-api-access-j4zjz\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:32.010302 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.010112    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2jt4\" (UniqueName: \"kubernetes.io/projected/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-kube-api-access-h2jt4\") pod \"dns-default-qp9gw\" (UID: \"ccbc72eb-a594-4bde-867d-19dfb2f78bf1\") " pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:32.010302 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.010203    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-certificates\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:32.010904 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.010879    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-trusted-ca\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:32.014546 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.014524    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-image-registry-private-configuration\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:32.014546 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.014537    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-installation-pull-secrets\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:32.020408 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.020379    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-bound-sa-token\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:32.020614 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.020594    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4zjz\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-kube-api-access-j4zjz\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:32.111311 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.111214    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-tmp-dir\") pod \"dns-default-qp9gw\" (UID: \"ccbc72eb-a594-4bde-867d-19dfb2f78bf1\") " pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:32.111311 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.111304    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-config-volume\") pod \"dns-default-qp9gw\" (UID: \"ccbc72eb-a594-4bde-867d-19dfb2f78bf1\") " pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:32.111543 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.111337    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2jt4\" (UniqueName: \"kubernetes.io/projected/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-kube-api-access-h2jt4\") pod \"dns-default-qp9gw\" (UID: \"ccbc72eb-a594-4bde-867d-19dfb2f78bf1\") " pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:32.111543 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.111386    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls\") pod \"dns-default-qp9gw\" (UID: \"ccbc72eb-a594-4bde-867d-19dfb2f78bf1\") " pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:32.111543 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.111408    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c18b2c8-16d4-4814-81a3-ecc36a1b3482-cert\") pod \"ingress-canary-qxwsp\" (UID: \"5c18b2c8-16d4-4814-81a3-ecc36a1b3482\") " pod="openshift-ingress-canary/ingress-canary-qxwsp"
Jul 31 20:30:32.111543 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.111432    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4gff\" (UniqueName: \"kubernetes.io/projected/5c18b2c8-16d4-4814-81a3-ecc36a1b3482-kube-api-access-v4gff\") pod \"ingress-canary-qxwsp\" (UID: \"5c18b2c8-16d4-4814-81a3-ecc36a1b3482\") " pod="openshift-ingress-canary/ingress-canary-qxwsp"
Jul 31 20:30:32.112134 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.112112    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-tmp-dir\") pod \"dns-default-qp9gw\" (UID: \"ccbc72eb-a594-4bde-867d-19dfb2f78bf1\") " pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:32.112622 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.112602    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-config-volume\") pod \"dns-default-qp9gw\" (UID: \"ccbc72eb-a594-4bde-867d-19dfb2f78bf1\") " pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:32.113252 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:32.113227    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 20:30:32.113356 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:32.113298    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls podName:ccbc72eb-a594-4bde-867d-19dfb2f78bf1 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:32.613279056 +0000 UTC m=+37.218671513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls") pod "dns-default-qp9gw" (UID: "ccbc72eb-a594-4bde-867d-19dfb2f78bf1") : secret "dns-default-metrics-tls" not found
Jul 31 20:30:32.116364 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.116341    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c18b2c8-16d4-4814-81a3-ecc36a1b3482-cert\") pod \"ingress-canary-qxwsp\" (UID: \"5c18b2c8-16d4-4814-81a3-ecc36a1b3482\") " pod="openshift-ingress-canary/ingress-canary-qxwsp"
Jul 31 20:30:32.119683 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.119659    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4gff\" (UniqueName: \"kubernetes.io/projected/5c18b2c8-16d4-4814-81a3-ecc36a1b3482-kube-api-access-v4gff\") pod \"ingress-canary-qxwsp\" (UID: \"5c18b2c8-16d4-4814-81a3-ecc36a1b3482\") " pod="openshift-ingress-canary/ingress-canary-qxwsp"
Jul 31 20:30:32.120696 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.120675    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2jt4\" (UniqueName: \"kubernetes.io/projected/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-kube-api-access-h2jt4\") pod \"dns-default-qp9gw\" (UID: \"ccbc72eb-a594-4bde-867d-19dfb2f78bf1\") " pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:32.138884 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.138851    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qxwsp"
Jul 31 20:30:32.515580 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.515482    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:32.515754 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:32.515683    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 20:30:32.515754 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:32.515709    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b8bc847-ddshz: secret "image-registry-tls" not found
Jul 31 20:30:32.515859 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:32.515782    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls podName:e3e98058-4022-41fd-9a1c-10b2d8fe5ef7 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:33.515760221 +0000 UTC m=+38.121152696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls") pod "image-registry-77b8bc847-ddshz" (UID: "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7") : secret "image-registry-tls" not found
Jul 31 20:30:32.616483 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:32.616447    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls\") pod \"dns-default-qp9gw\" (UID: \"ccbc72eb-a594-4bde-867d-19dfb2f78bf1\") " pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:32.616633 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:32.616567    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 20:30:32.616633 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:32.616624    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls podName:ccbc72eb-a594-4bde-867d-19dfb2f78bf1 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:33.616610269 +0000 UTC m=+38.222002723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls") pod "dns-default-qp9gw" (UID: "ccbc72eb-a594-4bde-867d-19dfb2f78bf1") : secret "dns-default-metrics-tls" not found
Jul 31 20:30:33.524043 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:33.524001    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:33.524710 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:33.524129    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 20:30:33.524710 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:33.524140    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b8bc847-ddshz: secret "image-registry-tls" not found
Jul 31 20:30:33.524710 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:33.524207    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls podName:e3e98058-4022-41fd-9a1c-10b2d8fe5ef7 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:35.524193894 +0000 UTC m=+40.129586347 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls") pod "image-registry-77b8bc847-ddshz" (UID: "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7") : secret "image-registry-tls" not found
Jul 31 20:30:33.624668 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:33.624638    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls\") pod \"dns-default-qp9gw\" (UID: \"ccbc72eb-a594-4bde-867d-19dfb2f78bf1\") " pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:33.624840 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:33.624821    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 20:30:33.624919 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:33.624908    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls podName:ccbc72eb-a594-4bde-867d-19dfb2f78bf1 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:35.624891499 +0000 UTC m=+40.230283953 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls") pod "dns-default-qp9gw" (UID: "ccbc72eb-a594-4bde-867d-19dfb2f78bf1") : secret "dns-default-metrics-tls" not found
Jul 31 20:30:33.659453 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:33.659420    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qxwsp"]
Jul 31 20:30:33.709640 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:30:33.709604    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c18b2c8_16d4_4814_81a3_ecc36a1b3482.slice/crio-a5c340c2f17bdd09f0e16f75ff4bb33dac4d44e06cf4e62c601e778a327a33b3 WatchSource:0}: Error finding container a5c340c2f17bdd09f0e16f75ff4bb33dac4d44e06cf4e62c601e778a327a33b3: Status 404 returned error can't find the container with id a5c340c2f17bdd09f0e16f75ff4bb33dac4d44e06cf4e62c601e778a327a33b3
Jul 31 20:30:34.224060 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:34.223848    2566 generic.go:356] "Generic (PLEG): container finished" podID="cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2" containerID="8310d7044da62f02bfbea5e65881eb4f108e9568936c7d7cf21b2c73e90313cc" exitCode=0
Jul 31 20:30:34.224299 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:34.223936    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-22922" event={"ID":"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2","Type":"ContainerDied","Data":"8310d7044da62f02bfbea5e65881eb4f108e9568936c7d7cf21b2c73e90313cc"}
Jul 31 20:30:34.225303 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:34.225281    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qxwsp" event={"ID":"5c18b2c8-16d4-4814-81a3-ecc36a1b3482","Type":"ContainerStarted","Data":"a5c340c2f17bdd09f0e16f75ff4bb33dac4d44e06cf4e62c601e778a327a33b3"}
Jul 31 20:30:35.233320 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:35.233285    2566 generic.go:356] "Generic (PLEG): container finished" podID="cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2" containerID="0d0664174fba46e0fcb124f6bb01cfe2c72f57c7069352cc52689c67c6b813ad" exitCode=0
Jul 31 20:30:35.233872 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:35.233337    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-22922" event={"ID":"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2","Type":"ContainerDied","Data":"0d0664174fba46e0fcb124f6bb01cfe2c72f57c7069352cc52689c67c6b813ad"}
Jul 31 20:30:35.538998 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:35.538901    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:35.539186 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:35.539073    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 20:30:35.539186 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:35.539099    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b8bc847-ddshz: secret "image-registry-tls" not found
Jul 31 20:30:35.539186 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:35.539181    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls podName:e3e98058-4022-41fd-9a1c-10b2d8fe5ef7 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:39.539164806 +0000 UTC m=+44.144557278 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls") pod "image-registry-77b8bc847-ddshz" (UID: "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7") : secret "image-registry-tls" not found
Jul 31 20:30:35.639840 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:35.639795    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls\") pod \"dns-default-qp9gw\" (UID: \"ccbc72eb-a594-4bde-867d-19dfb2f78bf1\") " pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:35.640034 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:35.639946    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 20:30:35.640034 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:35.640028    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls podName:ccbc72eb-a594-4bde-867d-19dfb2f78bf1 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:39.640006619 +0000 UTC m=+44.245399073 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls") pod "dns-default-qp9gw" (UID: "ccbc72eb-a594-4bde-867d-19dfb2f78bf1") : secret "dns-default-metrics-tls" not found
Jul 31 20:30:36.238969 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.238931    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-22922" event={"ID":"cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2","Type":"ContainerStarted","Data":"e4fdeb5e45dd8c332800cdef0f4c88f3365463953bcf340436a90807615c3877"}
Jul 31 20:30:36.262899 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.262788    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-22922" podStartSLOduration=8.185438297 podStartE2EDuration="40.262766872s" totalImagesPullingTime="32.077328575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:36.261278515 +0000 UTC m=+40.866670990" watchObservedRunningTime="2026-07-31 20:30:36.262766872 +0000 UTC m=+40.868159350"
Jul 31 20:30:36.687607 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.687431    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f5h8r"]
Jul 31 20:30:36.707084 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.707058    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f5h8r"]
Jul 31 20:30:36.707260 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.707202    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:36.709471 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.709409    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 31 20:30:36.709656 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.709614    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 31 20:30:36.709656 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.709633    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 31 20:30:36.709814 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.709713    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 31 20:30:36.709814 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.709775    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cdl8z\""
Jul 31 20:30:36.849400 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.849362    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-data-volume\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:36.849400 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.849404    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8cf2\" (UniqueName: \"kubernetes.io/projected/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-api-access-v8cf2\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:36.849614 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.849461    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:36.849614 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.849499    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-crio-socket\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:36.849614 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.849544    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:36.869227 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.869197    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-4zmqz"]
Jul 31 20:30:36.891072 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.891041    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-4zmqz"]
Jul 31 20:30:36.891239 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.891139    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4zmqz"
Jul 31 20:30:36.893794 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.893768    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 31 20:30:36.893794 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.893774    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 31 20:30:36.893982 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.893838    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rswdt\""
Jul 31 20:30:36.950250 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.950139    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-crio-socket\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:36.950250 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.950199    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:36.950250 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.950239    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-data-volume\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:36.950477 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:36.950353    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 20:30:36.950477 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.950388    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-crio-socket\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:36.950477 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.950407    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8cf2\" (UniqueName: \"kubernetes.io/projected/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-api-access-v8cf2\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:36.950477 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:36.950442    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-rbac-proxy-cm podName:bf9b88d6-16ce-40dd-a570-d7671d2d47ba nodeName:}" failed. No retries permitted until 2026-07-31 20:30:37.450420733 +0000 UTC m=+42.055813214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f5h8r" (UID: "bf9b88d6-16ce-40dd-a570-d7671d2d47ba") : configmap "kube-rbac-proxy" not found
Jul 31 20:30:36.950609 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.950521    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:36.950642 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:36.950606    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:36.950642 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:36.950636    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls podName:bf9b88d6-16ce-40dd-a570-d7671d2d47ba nodeName:}" failed. No retries permitted until 2026-07-31 20:30:37.45062723 +0000 UTC m=+42.056019683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f5h8r" (UID: "bf9b88d6-16ce-40dd-a570-d7671d2d47ba") : secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:36.950858 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.950841    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-data-volume\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:36.961301 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:36.961267    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8cf2\" (UniqueName: \"kubernetes.io/projected/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-api-access-v8cf2\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:37.050959 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:37.050916    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9dfm\" (UniqueName: \"kubernetes.io/projected/ecc06171-a30a-4a1b-9483-9cb7ec6eac68-kube-api-access-s9dfm\") pod \"migrator-68bc745d87-4zmqz\" (UID: \"ecc06171-a30a-4a1b-9483-9cb7ec6eac68\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4zmqz"
Jul 31 20:30:37.151368 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:37.151334    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9dfm\" (UniqueName: \"kubernetes.io/projected/ecc06171-a30a-4a1b-9483-9cb7ec6eac68-kube-api-access-s9dfm\") pod \"migrator-68bc745d87-4zmqz\" (UID: \"ecc06171-a30a-4a1b-9483-9cb7ec6eac68\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4zmqz"
Jul 31 20:30:37.160122 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:37.160083    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9dfm\" (UniqueName: \"kubernetes.io/projected/ecc06171-a30a-4a1b-9483-9cb7ec6eac68-kube-api-access-s9dfm\") pod \"migrator-68bc745d87-4zmqz\" (UID: \"ecc06171-a30a-4a1b-9483-9cb7ec6eac68\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4zmqz"
Jul 31 20:30:37.199470 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:37.199428    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4zmqz"
Jul 31 20:30:37.243308 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:37.243267    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qxwsp" event={"ID":"5c18b2c8-16d4-4814-81a3-ecc36a1b3482","Type":"ContainerStarted","Data":"caf5040e183dc32f90997053056eb6606c82026fe5fbc398c578b54be262a642"}
Jul 31 20:30:37.341744 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:37.341657    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qxwsp" podStartSLOduration=3.748193481 podStartE2EDuration="6.341638695s" totalImagesPullingTime="2.593445214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:37.260288141 +0000 UTC m=+41.865680618" watchObservedRunningTime="2026-07-31 20:30:37.341638695 +0000 UTC m=+41.947031170"
Jul 31 20:30:37.342479 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:37.342460    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-4zmqz"]
Jul 31 20:30:37.345498 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:30:37.345472    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc06171_a30a_4a1b_9483_9cb7ec6eac68.slice/crio-4df59d23b31109e863cffdf0ab8f69d431d5e46c3715ee9ebc70f9849692236d WatchSource:0}: Error finding container 4df59d23b31109e863cffdf0ab8f69d431d5e46c3715ee9ebc70f9849692236d: Status 404 returned error can't find the container with id 4df59d23b31109e863cffdf0ab8f69d431d5e46c3715ee9ebc70f9849692236d
Jul 31 20:30:37.453983 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:37.453942    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:37.454197 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:37.453999    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:37.454197 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:37.454086    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 20:30:37.454197 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:37.454094    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:37.454197 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:37.454188    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-rbac-proxy-cm podName:bf9b88d6-16ce-40dd-a570-d7671d2d47ba nodeName:}" failed. No retries permitted until 2026-07-31 20:30:38.454136094 +0000 UTC m=+43.059528547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f5h8r" (UID: "bf9b88d6-16ce-40dd-a570-d7671d2d47ba") : configmap "kube-rbac-proxy" not found
Jul 31 20:30:37.454353 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:37.454209    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls podName:bf9b88d6-16ce-40dd-a570-d7671d2d47ba nodeName:}" failed. No retries permitted until 2026-07-31 20:30:38.454199596 +0000 UTC m=+43.059592051 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f5h8r" (UID: "bf9b88d6-16ce-40dd-a570-d7671d2d47ba") : secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:38.246893 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:38.246856    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4zmqz" event={"ID":"ecc06171-a30a-4a1b-9483-9cb7ec6eac68","Type":"ContainerStarted","Data":"4df59d23b31109e863cffdf0ab8f69d431d5e46c3715ee9ebc70f9849692236d"}
Jul 31 20:30:38.249437 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:38.249414    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7qphl_488c36c4-397a-46d9-a06a-5a6f800e6afb/dns-node-resolver/0.log"
Jul 31 20:30:38.460287 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:38.460256    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:38.460475 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:38.460374    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 20:30:38.460475 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:38.460380    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:38.460475 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:38.460442    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-rbac-proxy-cm podName:bf9b88d6-16ce-40dd-a570-d7671d2d47ba nodeName:}" failed. No retries permitted until 2026-07-31 20:30:40.460423644 +0000 UTC m=+45.065816117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f5h8r" (UID: "bf9b88d6-16ce-40dd-a570-d7671d2d47ba") : configmap "kube-rbac-proxy" not found
Jul 31 20:30:38.460618 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:38.460488    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:38.460618 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:38.460524    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls podName:bf9b88d6-16ce-40dd-a570-d7671d2d47ba nodeName:}" failed. No retries permitted until 2026-07-31 20:30:40.460513003 +0000 UTC m=+45.065905462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f5h8r" (UID: "bf9b88d6-16ce-40dd-a570-d7671d2d47ba") : secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:38.896130 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:38.896100    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-qn4m6"]
Jul 31 20:30:38.911824 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:38.911791    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-qn4m6"]
Jul 31 20:30:38.911966 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:38.911853    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-qn4m6"
Jul 31 20:30:38.914438 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:38.914416    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-jct6v\""
Jul 31 20:30:38.914438 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:38.914428    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 31 20:30:38.915964 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:38.915945    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 31 20:30:38.916094 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:38.915975    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 31 20:30:38.916094 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:38.915997    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 31 20:30:38.965078 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:38.965037    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/af206a25-a5a4-461d-9735-df1e96967225-signing-key\") pod \"service-ca-98c88fbb5-qn4m6\" (UID: \"af206a25-a5a4-461d-9735-df1e96967225\") " pod="openshift-service-ca/service-ca-98c88fbb5-qn4m6"
Jul 31 20:30:38.965078 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:38.965085    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bch7\" (UniqueName: \"kubernetes.io/projected/af206a25-a5a4-461d-9735-df1e96967225-kube-api-access-7bch7\") pod \"service-ca-98c88fbb5-qn4m6\" (UID: \"af206a25-a5a4-461d-9735-df1e96967225\") " pod="openshift-service-ca/service-ca-98c88fbb5-qn4m6"
Jul 31 20:30:38.965315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:38.965235    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/af206a25-a5a4-461d-9735-df1e96967225-signing-cabundle\") pod \"service-ca-98c88fbb5-qn4m6\" (UID: \"af206a25-a5a4-461d-9735-df1e96967225\") " pod="openshift-service-ca/service-ca-98c88fbb5-qn4m6"
Jul 31 20:30:39.066492 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:39.066467    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bch7\" (UniqueName: \"kubernetes.io/projected/af206a25-a5a4-461d-9735-df1e96967225-kube-api-access-7bch7\") pod \"service-ca-98c88fbb5-qn4m6\" (UID: \"af206a25-a5a4-461d-9735-df1e96967225\") " pod="openshift-service-ca/service-ca-98c88fbb5-qn4m6"
Jul 31 20:30:39.066605 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:39.066556    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/af206a25-a5a4-461d-9735-df1e96967225-signing-cabundle\") pod \"service-ca-98c88fbb5-qn4m6\" (UID: \"af206a25-a5a4-461d-9735-df1e96967225\") " pod="openshift-service-ca/service-ca-98c88fbb5-qn4m6"
Jul 31 20:30:39.066605 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:39.066593    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/af206a25-a5a4-461d-9735-df1e96967225-signing-key\") pod \"service-ca-98c88fbb5-qn4m6\" (UID: \"af206a25-a5a4-461d-9735-df1e96967225\") " pod="openshift-service-ca/service-ca-98c88fbb5-qn4m6"
Jul 31 20:30:39.067236 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:39.067214    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/af206a25-a5a4-461d-9735-df1e96967225-signing-cabundle\") pod \"service-ca-98c88fbb5-qn4m6\" (UID: \"af206a25-a5a4-461d-9735-df1e96967225\") " pod="openshift-service-ca/service-ca-98c88fbb5-qn4m6"
Jul 31 20:30:39.068866 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:39.068850    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/af206a25-a5a4-461d-9735-df1e96967225-signing-key\") pod \"service-ca-98c88fbb5-qn4m6\" (UID: \"af206a25-a5a4-461d-9735-df1e96967225\") " pod="openshift-service-ca/service-ca-98c88fbb5-qn4m6"
Jul 31 20:30:39.075073 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:39.075044    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bch7\" (UniqueName: \"kubernetes.io/projected/af206a25-a5a4-461d-9735-df1e96967225-kube-api-access-7bch7\") pod \"service-ca-98c88fbb5-qn4m6\" (UID: \"af206a25-a5a4-461d-9735-df1e96967225\") " pod="openshift-service-ca/service-ca-98c88fbb5-qn4m6"
Jul 31 20:30:39.220762 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:39.220716    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-qn4m6"
Jul 31 20:30:39.249778 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:39.249741    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kjc46_35536ea9-0cd4-4e62-9c3f-df5f2a224bd4/node-ca/0.log"
Jul 31 20:30:39.250381 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:39.250362    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4zmqz" event={"ID":"ecc06171-a30a-4a1b-9483-9cb7ec6eac68","Type":"ContainerStarted","Data":"b4d26b558a18bdb347386fe4db6997cbda3f556e7d62617a81bb2d972bde2a7a"}
Jul 31 20:30:39.377848 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:39.377809    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-qn4m6"]
Jul 31 20:30:39.381244 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:30:39.381205    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf206a25_a5a4_461d_9735_df1e96967225.slice/crio-4f4eeb94748895554b0899e4fac0c9612bf9e57b19e33072d004f4551b34f202 WatchSource:0}: Error finding container 4f4eeb94748895554b0899e4fac0c9612bf9e57b19e33072d004f4551b34f202: Status 404 returned error can't find the container with id 4f4eeb94748895554b0899e4fac0c9612bf9e57b19e33072d004f4551b34f202
Jul 31 20:30:39.570044 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:39.570008    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:39.570215 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:39.570180    2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 31 20:30:39.570215 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:39.570197    2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b8bc847-ddshz: secret "image-registry-tls" not found
Jul 31 20:30:39.570309 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:39.570250    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls podName:e3e98058-4022-41fd-9a1c-10b2d8fe5ef7 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:47.570235555 +0000 UTC m=+52.175628009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls") pod "image-registry-77b8bc847-ddshz" (UID: "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7") : secret "image-registry-tls" not found
Jul 31 20:30:39.670936 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:39.670895    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls\") pod \"dns-default-qp9gw\" (UID: \"ccbc72eb-a594-4bde-867d-19dfb2f78bf1\") " pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:39.671103 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:39.671056    2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 31 20:30:39.671142 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:39.671124    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls podName:ccbc72eb-a594-4bde-867d-19dfb2f78bf1 nodeName:}" failed. No retries permitted until 2026-07-31 20:30:47.671107713 +0000 UTC m=+52.276500166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls") pod "dns-default-qp9gw" (UID: "ccbc72eb-a594-4bde-867d-19dfb2f78bf1") : secret "dns-default-metrics-tls" not found
Jul 31 20:30:40.051046 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:40.051011    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qxwsp_5c18b2c8-16d4-4814-81a3-ecc36a1b3482/serve-healthcheck-canary/0.log"
Jul 31 20:30:40.255190 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:40.255130    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4zmqz" event={"ID":"ecc06171-a30a-4a1b-9483-9cb7ec6eac68","Type":"ContainerStarted","Data":"aa55d3e8a3568f7955954e80b8a648ca74bcf7e7112d393533056e36803b6b82"}
Jul 31 20:30:40.256409 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:40.256380    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-qn4m6" event={"ID":"af206a25-a5a4-461d-9735-df1e96967225","Type":"ContainerStarted","Data":"4f4eeb94748895554b0899e4fac0c9612bf9e57b19e33072d004f4551b34f202"}
Jul 31 20:30:40.271368 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:40.271315    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-4zmqz" podStartSLOduration=2.591455786 podStartE2EDuration="4.271300569s" totalImagesPullingTime="1.679844783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:40.270968752 +0000 UTC m=+44.876361224" watchObservedRunningTime="2026-07-31 20:30:40.271300569 +0000 UTC m=+44.876693046"
Jul 31 20:30:40.478556 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:40.478460    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:40.478556 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:40.478540    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:40.478794 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:40.478580    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:40.478794 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:40.478626    2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 31 20:30:40.478794 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:40.478658    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls podName:bf9b88d6-16ce-40dd-a570-d7671d2d47ba nodeName:}" failed. No retries permitted until 2026-07-31 20:30:44.478638043 +0000 UTC m=+49.084030500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f5h8r" (UID: "bf9b88d6-16ce-40dd-a570-d7671d2d47ba") : secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:40.478794 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:40.478674    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-rbac-proxy-cm podName:bf9b88d6-16ce-40dd-a570-d7671d2d47ba nodeName:}" failed. No retries permitted until 2026-07-31 20:30:44.4786675 +0000 UTC m=+49.084059954 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f5h8r" (UID: "bf9b88d6-16ce-40dd-a570-d7671d2d47ba") : configmap "kube-rbac-proxy" not found
Jul 31 20:30:42.263041 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:42.263005    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-qn4m6" event={"ID":"af206a25-a5a4-461d-9735-df1e96967225","Type":"ContainerStarted","Data":"2ce598bb6205a04204c314391244854caa74c052836f9730686c94b6480664d1"}
Jul 31 20:30:42.276855 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:42.276802    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-qn4m6" podStartSLOduration=1.974837676 podStartE2EDuration="4.276783662s" totalImagesPullingTime="2.301945986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:42.276456416 +0000 UTC m=+46.881848904" watchObservedRunningTime="2026-07-31 20:30:42.276783662 +0000 UTC m=+46.882176135"
Jul 31 20:30:44.512786 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:44.512725    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:44.513229 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:44.512835    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:44.513229 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:44.512924    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:44.513229 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:44.512978    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls podName:bf9b88d6-16ce-40dd-a570-d7671d2d47ba nodeName:}" failed. No retries permitted until 2026-07-31 20:30:52.512961969 +0000 UTC m=+57.118354427 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f5h8r" (UID: "bf9b88d6-16ce-40dd-a570-d7671d2d47ba") : secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:44.513346 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:44.513286    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:47.638024 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:47.637979    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:47.640487 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:47.640468    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls\") pod \"image-registry-77b8bc847-ddshz\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") " pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:47.728614 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:47.728579    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:47.738892 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:47.738853    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls\") pod \"dns-default-qp9gw\" (UID: \"ccbc72eb-a594-4bde-867d-19dfb2f78bf1\") " pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:47.741326 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:47.741295    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccbc72eb-a594-4bde-867d-19dfb2f78bf1-metrics-tls\") pod \"dns-default-qp9gw\" (UID: \"ccbc72eb-a594-4bde-867d-19dfb2f78bf1\") " pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:47.755161 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:47.755118    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:47.918759 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:47.918714    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77b8bc847-ddshz"]
Jul 31 20:30:47.921844 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:30:47.921812    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e98058_4022_41fd_9a1c_10b2d8fe5ef7.slice/crio-ec532b3939189f54c4f578f9e3634236f07d23e126a91eeee3214e5d631ac982 WatchSource:0}: Error finding container ec532b3939189f54c4f578f9e3634236f07d23e126a91eeee3214e5d631ac982: Status 404 returned error can't find the container with id ec532b3939189f54c4f578f9e3634236f07d23e126a91eeee3214e5d631ac982
Jul 31 20:30:47.936198 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:47.936169    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qp9gw"]
Jul 31 20:30:47.938969 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:30:47.938946    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbc72eb_a594_4bde_867d_19dfb2f78bf1.slice/crio-1481ad36ff431899e3f75d25171b7b808bba6c410a1d74fcf25669bcbd4809d5 WatchSource:0}: Error finding container 1481ad36ff431899e3f75d25171b7b808bba6c410a1d74fcf25669bcbd4809d5: Status 404 returned error can't find the container with id 1481ad36ff431899e3f75d25171b7b808bba6c410a1d74fcf25669bcbd4809d5
Jul 31 20:30:48.279739 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:48.279643    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qp9gw" event={"ID":"ccbc72eb-a594-4bde-867d-19dfb2f78bf1","Type":"ContainerStarted","Data":"1481ad36ff431899e3f75d25171b7b808bba6c410a1d74fcf25669bcbd4809d5"}
Jul 31 20:30:48.281238 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:48.281213    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b8bc847-ddshz" event={"ID":"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7","Type":"ContainerStarted","Data":"a4edef822d3d8093ec1b8d76c2dd70032afc15afbbc4a74522ca46dba66049a6"}
Jul 31 20:30:48.281359 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:48.281253    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b8bc847-ddshz" event={"ID":"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7","Type":"ContainerStarted","Data":"ec532b3939189f54c4f578f9e3634236f07d23e126a91eeee3214e5d631ac982"}
Jul 31 20:30:48.281359 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:48.281352    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:30:48.298526 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:48.298475    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77b8bc847-ddshz" podStartSLOduration=35.298458573 podStartE2EDuration="35.298458573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:48.297809765 +0000 UTC m=+52.903202242" watchObservedRunningTime="2026-07-31 20:30:48.298458573 +0000 UTC m=+52.903851048"
Jul 31 20:30:50.288958 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:50.288861    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qp9gw" event={"ID":"ccbc72eb-a594-4bde-867d-19dfb2f78bf1","Type":"ContainerStarted","Data":"761761cb7117867175931d564eafe5e77108890b3d6964d40d8205faa69a4b21"}
Jul 31 20:30:50.288958 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:50.288924    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qp9gw" event={"ID":"ccbc72eb-a594-4bde-867d-19dfb2f78bf1","Type":"ContainerStarted","Data":"72453c3c539d36558c6c7cff47d2ebb696a3543ed40fad21d085f24dbfa42ec1"}
Jul 31 20:30:50.289459 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:50.289009    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:30:50.306335 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:50.306289    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qp9gw" podStartSLOduration=17.245105704 podStartE2EDuration="19.306273772s" totalImagesPullingTime="2.061168068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:30:50.304561111 +0000 UTC m=+54.909953599" watchObservedRunningTime="2026-07-31 20:30:50.306273772 +0000 UTC m=+54.911666279"
Jul 31 20:30:52.579350 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:52.579310    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:30:52.579814 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:52.579468    2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:52.579814 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:30:52.579534    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls podName:bf9b88d6-16ce-40dd-a570-d7671d2d47ba nodeName:}" failed. No retries permitted until 2026-07-31 20:31:08.57951605 +0000 UTC m=+73.184908509 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f5h8r" (UID: "bf9b88d6-16ce-40dd-a570-d7671d2d47ba") : secret "insights-runtime-extractor-tls" not found
Jul 31 20:30:58.218253 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.218215    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8trv8"
Jul 31 20:30:58.695472 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.695443    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-lf9bg"]
Jul 31 20:30:58.698300 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.698276    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-lf9bg"
Jul 31 20:30:58.698971 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.698950    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4696467d-jhwk7"]
Jul 31 20:30:58.700427 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.700409    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4696467d-jhwk7"
Jul 31 20:30:58.701335 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.701312    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 31 20:30:58.701424 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.701314    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 31 20:30:58.701674 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.701659    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-thtsk\""
Jul 31 20:30:58.704256 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.704237    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 31 20:30:58.704382 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.704260    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 31 20:30:58.704382 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.704361    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 31 20:30:58.704526 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.704514    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rlrdb\""
Jul 31 20:30:58.704617 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.704597    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 31 20:30:58.706229 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.706021    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"]
Jul 31 20:30:58.707878 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.707859    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.710423 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.710402    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 31 20:30:58.710899 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.710884    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 31 20:30:58.710994 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.710899    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 31 20:30:58.711380 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.711360    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 31 20:30:58.715397 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.715379    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-lf9bg"]
Jul 31 20:30:58.716025 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.716011    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4696467d-jhwk7"]
Jul 31 20:30:58.725845 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.725820    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"]
Jul 31 20:30:58.789967 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.789937    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77b8bc847-ddshz"]
Jul 31 20:30:58.826906 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.826877    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4cd0d500-315e-42ab-8b88-53c01d76bef0-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-lf9bg\" (UID: \"4cd0d500-315e-42ab-8b88-53c01d76bef0\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-lf9bg"
Jul 31 20:30:58.826906 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.826909    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/daba63af-fa2b-4f8e-bc40-9da878a92f9b-hub\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.827098 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.826934    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2fc413c7-5fe9-4aac-b3f1-348a686030ae-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d4696467d-jhwk7\" (UID: \"2fc413c7-5fe9-4aac-b3f1-348a686030ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4696467d-jhwk7"
Jul 31 20:30:58.827098 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.827060    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4cd0d500-315e-42ab-8b88-53c01d76bef0-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-lf9bg\" (UID: \"4cd0d500-315e-42ab-8b88-53c01d76bef0\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-lf9bg"
Jul 31 20:30:58.827185 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.827104    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxnpd\" (UniqueName: \"kubernetes.io/projected/daba63af-fa2b-4f8e-bc40-9da878a92f9b-kube-api-access-rxnpd\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.827185 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.827163    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/daba63af-fa2b-4f8e-bc40-9da878a92f9b-ca\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.827248 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.827213    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/daba63af-fa2b-4f8e-bc40-9da878a92f9b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.827248 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.827231    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/daba63af-fa2b-4f8e-bc40-9da878a92f9b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.827316 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.827266    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/daba63af-fa2b-4f8e-bc40-9da878a92f9b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.827316 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.827282    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rfrn\" (UniqueName: \"kubernetes.io/projected/2fc413c7-5fe9-4aac-b3f1-348a686030ae-kube-api-access-6rfrn\") pod \"managed-serviceaccount-addon-agent-6d4696467d-jhwk7\" (UID: \"2fc413c7-5fe9-4aac-b3f1-348a686030ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4696467d-jhwk7"
Jul 31 20:30:58.877887 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.877851    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-755899888f-568sg"]
Jul 31 20:30:58.879515 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.879501    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:58.895462 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.895435    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-755899888f-568sg"]
Jul 31 20:30:58.928171 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928113    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-bound-sa-token\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:58.928343 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928187    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4cd0d500-315e-42ab-8b88-53c01d76bef0-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-lf9bg\" (UID: \"4cd0d500-315e-42ab-8b88-53c01d76bef0\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-lf9bg"
Jul 31 20:30:58.928343 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928212    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-ca-trust-extracted\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:58.928343 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928229    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-installation-pull-secrets\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:58.928343 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928254    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz9xr\" (UniqueName: \"kubernetes.io/projected/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-kube-api-access-tz9xr\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:58.928343 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928281    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxnpd\" (UniqueName: \"kubernetes.io/projected/daba63af-fa2b-4f8e-bc40-9da878a92f9b-kube-api-access-rxnpd\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.928343 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928308    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-image-registry-private-configuration\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:58.928343 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928328    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/daba63af-fa2b-4f8e-bc40-9da878a92f9b-ca\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.928620 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928351    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/daba63af-fa2b-4f8e-bc40-9da878a92f9b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.928620 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928376    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-registry-certificates\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:58.928620 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928490    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/daba63af-fa2b-4f8e-bc40-9da878a92f9b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.928620 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928522    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-trusted-ca\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:58.928620 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928554    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/daba63af-fa2b-4f8e-bc40-9da878a92f9b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.928620 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928580    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rfrn\" (UniqueName: \"kubernetes.io/projected/2fc413c7-5fe9-4aac-b3f1-348a686030ae-kube-api-access-6rfrn\") pod \"managed-serviceaccount-addon-agent-6d4696467d-jhwk7\" (UID: \"2fc413c7-5fe9-4aac-b3f1-348a686030ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4696467d-jhwk7"
Jul 31 20:30:58.928620 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928616    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4cd0d500-315e-42ab-8b88-53c01d76bef0-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-lf9bg\" (UID: \"4cd0d500-315e-42ab-8b88-53c01d76bef0\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-lf9bg"
Jul 31 20:30:58.928976 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928639    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-registry-tls\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:58.928976 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928668    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/daba63af-fa2b-4f8e-bc40-9da878a92f9b-hub\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.928976 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.928696    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2fc413c7-5fe9-4aac-b3f1-348a686030ae-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d4696467d-jhwk7\" (UID: \"2fc413c7-5fe9-4aac-b3f1-348a686030ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4696467d-jhwk7"
Jul 31 20:30:58.929365 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.929314    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/daba63af-fa2b-4f8e-bc40-9da878a92f9b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.930080 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.930055    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4cd0d500-315e-42ab-8b88-53c01d76bef0-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-lf9bg\" (UID: \"4cd0d500-315e-42ab-8b88-53c01d76bef0\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-lf9bg"
Jul 31 20:30:58.931492 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.931471    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/daba63af-fa2b-4f8e-bc40-9da878a92f9b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.931585 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.931496    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/daba63af-fa2b-4f8e-bc40-9da878a92f9b-ca\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.931585 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.931533    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4cd0d500-315e-42ab-8b88-53c01d76bef0-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-lf9bg\" (UID: \"4cd0d500-315e-42ab-8b88-53c01d76bef0\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-lf9bg"
Jul 31 20:30:58.931675 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.931649    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/daba63af-fa2b-4f8e-bc40-9da878a92f9b-hub\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.931893 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.931873    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/daba63af-fa2b-4f8e-bc40-9da878a92f9b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:58.931989 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.931951    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2fc413c7-5fe9-4aac-b3f1-348a686030ae-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d4696467d-jhwk7\" (UID: \"2fc413c7-5fe9-4aac-b3f1-348a686030ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4696467d-jhwk7"
Jul 31 20:30:58.939100 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.939075    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rfrn\" (UniqueName: \"kubernetes.io/projected/2fc413c7-5fe9-4aac-b3f1-348a686030ae-kube-api-access-6rfrn\") pod \"managed-serviceaccount-addon-agent-6d4696467d-jhwk7\" (UID: \"2fc413c7-5fe9-4aac-b3f1-348a686030ae\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4696467d-jhwk7"
Jul 31 20:30:58.939434 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:58.939412    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxnpd\" (UniqueName: \"kubernetes.io/projected/daba63af-fa2b-4f8e-bc40-9da878a92f9b-kube-api-access-rxnpd\") pod \"cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs\" (UID: \"daba63af-fa2b-4f8e-bc40-9da878a92f9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:59.009370 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.009282    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-lf9bg"
Jul 31 20:30:59.020700 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.020672    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4696467d-jhwk7"
Jul 31 20:30:59.028337 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.028311    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"
Jul 31 20:30:59.029565 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.029531    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-registry-tls\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:59.029667 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.029596    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-bound-sa-token\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:59.029667 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.029650    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-ca-trust-extracted\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:59.029777 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.029674    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-installation-pull-secrets\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:59.029777 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.029746    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz9xr\" (UniqueName: \"kubernetes.io/projected/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-kube-api-access-tz9xr\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:59.030002 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.029788    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-image-registry-private-configuration\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:59.030002 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.029842    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-registry-certificates\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:59.030002 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.029876    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-trusted-ca\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:59.030179 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.030055    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-ca-trust-extracted\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:59.031586 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.031540    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-trusted-ca\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:59.031586 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.031572    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-registry-certificates\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:59.033165 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.033123    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-registry-tls\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:59.033265 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.033222    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-image-registry-private-configuration\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:59.033854 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.033837    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-installation-pull-secrets\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:59.043531 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.043508    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz9xr\" (UniqueName: \"kubernetes.io/projected/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-kube-api-access-tz9xr\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:59.043760 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.043738    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bee5ec02-2c87-47c7-a9e9-d3232b1ab96c-bound-sa-token\") pod \"image-registry-755899888f-568sg\" (UID: \"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c\") " pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:59.163042 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.162955    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-lf9bg"]
Jul 31 20:30:59.165624 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:30:59.165595    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd0d500_315e_42ab_8b88_53c01d76bef0.slice/crio-e14efdb53ff5b570aa28a09cf6cab34908c29b67812dfe81f72287de16a0013c WatchSource:0}: Error finding container e14efdb53ff5b570aa28a09cf6cab34908c29b67812dfe81f72287de16a0013c: Status 404 returned error can't find the container with id e14efdb53ff5b570aa28a09cf6cab34908c29b67812dfe81f72287de16a0013c
Jul 31 20:30:59.199803 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.199764    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:30:59.317174 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.317126    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-lf9bg" event={"ID":"4cd0d500-315e-42ab-8b88-53c01d76bef0","Type":"ContainerStarted","Data":"e14efdb53ff5b570aa28a09cf6cab34908c29b67812dfe81f72287de16a0013c"}
Jul 31 20:30:59.323815 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.323796    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-755899888f-568sg"]
Jul 31 20:30:59.326059 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:30:59.326035    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbee5ec02_2c87_47c7_a9e9_d3232b1ab96c.slice/crio-95df5cec7e4bf417cb75cb04d0aa0bc2968a4f00ffb79e036e9f33b1549dad63 WatchSource:0}: Error finding container 95df5cec7e4bf417cb75cb04d0aa0bc2968a4f00ffb79e036e9f33b1549dad63: Status 404 returned error can't find the container with id 95df5cec7e4bf417cb75cb04d0aa0bc2968a4f00ffb79e036e9f33b1549dad63
Jul 31 20:30:59.384507 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.384345    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4696467d-jhwk7"]
Jul 31 20:30:59.387091 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:30:59.387069    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs"]
Jul 31 20:30:59.387851 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:30:59.387829    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fc413c7_5fe9_4aac_b3f1_348a686030ae.slice/crio-6a131872ae55a6668c76b84f325c9b76583363bd0862a3ad2608daaf8f97fe8f WatchSource:0}: Error finding container 6a131872ae55a6668c76b84f325c9b76583363bd0862a3ad2608daaf8f97fe8f: Status 404 returned error can't find the container with id 6a131872ae55a6668c76b84f325c9b76583363bd0862a3ad2608daaf8f97fe8f
Jul 31 20:30:59.391159 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:30:59.391122    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddaba63af_fa2b_4f8e_bc40_9da878a92f9b.slice/crio-38c31f71f3bef7d81e15094318a6d44943abd54efd14c554c65df126e5769a3b WatchSource:0}: Error finding container 38c31f71f3bef7d81e15094318a6d44943abd54efd14c554c65df126e5769a3b: Status 404 returned error can't find the container with id 38c31f71f3bef7d81e15094318a6d44943abd54efd14c554c65df126e5769a3b
Jul 31 20:31:00.295493 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:00.295378    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qp9gw"
Jul 31 20:31:00.339209 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:00.339093    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs" event={"ID":"daba63af-fa2b-4f8e-bc40-9da878a92f9b","Type":"ContainerStarted","Data":"38c31f71f3bef7d81e15094318a6d44943abd54efd14c554c65df126e5769a3b"}
Jul 31 20:31:00.346197 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:00.345346    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-755899888f-568sg" event={"ID":"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c","Type":"ContainerStarted","Data":"966ecb8aa47b38a68d830f4b52d0be1c2bc37bca1e1fbab41a4acecf63ec7c95"}
Jul 31 20:31:00.346197 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:00.345405    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-755899888f-568sg" event={"ID":"bee5ec02-2c87-47c7-a9e9-d3232b1ab96c","Type":"ContainerStarted","Data":"95df5cec7e4bf417cb75cb04d0aa0bc2968a4f00ffb79e036e9f33b1549dad63"}
Jul 31 20:31:00.346197 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:00.346103    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:31:00.351048 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:00.350993    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4696467d-jhwk7" event={"ID":"2fc413c7-5fe9-4aac-b3f1-348a686030ae","Type":"ContainerStarted","Data":"6a131872ae55a6668c76b84f325c9b76583363bd0862a3ad2608daaf8f97fe8f"}
Jul 31 20:31:00.368495 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:00.368410    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-755899888f-568sg" podStartSLOduration=2.368390091 podStartE2EDuration="2.368390091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:00.367430932 +0000 UTC m=+64.972823445" watchObservedRunningTime="2026-07-31 20:31:00.368390091 +0000 UTC m=+64.973782567"
Jul 31 20:31:01.755576 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:01.755539    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret\") pod \"global-pull-secret-syncer-zslqn\" (UID: \"7bda5031-9205-4c6f-a712-57bfa836841a\") " pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:31:01.755998 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:01.755617    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-999p9\" (UniqueName: \"kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9\") pod \"network-check-target-n4b78\" (UID: \"02901a22-831e-45fa-a04d-dc48ec82dd78\") " pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:31:01.755998 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:01.755646    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs\") pod \"network-metrics-daemon-p75dl\" (UID: \"08a2bbf1-6485-4039-bb50-d2b54965d862\") " pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:31:01.758013 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:01.757984    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 31 20:31:01.759075 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:01.759057    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 31 20:31:01.759215 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:01.759061    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 31 20:31:01.768292 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:01.768263    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 31 20:31:01.774545 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:01.774516    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7bda5031-9205-4c6f-a712-57bfa836841a-original-pull-secret\") pod \"global-pull-secret-syncer-zslqn\" (UID: \"7bda5031-9205-4c6f-a712-57bfa836841a\") " pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:31:01.774674 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:01.774548    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/08a2bbf1-6485-4039-bb50-d2b54965d862-metrics-certs\") pod \"network-metrics-daemon-p75dl\" (UID: \"08a2bbf1-6485-4039-bb50-d2b54965d862\") " pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:31:01.779496 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:01.779469    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-999p9\" (UniqueName: \"kubernetes.io/projected/02901a22-831e-45fa-a04d-dc48ec82dd78-kube-api-access-999p9\") pod \"network-check-target-n4b78\" (UID: \"02901a22-831e-45fa-a04d-dc48ec82dd78\") " pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:31:01.941525 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:01.941492    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9lfhf\""
Jul 31 20:31:01.945464 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:01.945437    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zslqn"
Jul 31 20:31:01.949560 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:01.949522    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p75dl"
Jul 31 20:31:01.953295 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:01.953271    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w6hmj\""
Jul 31 20:31:01.961442 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:01.961415    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:31:04.513792 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:04.513506    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zslqn"]
Jul 31 20:31:04.517000 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:31:04.516969    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bda5031_9205_4c6f_a712_57bfa836841a.slice/crio-8c46d479f3d37b422b5f5549ddd84738d23492ba1394907e2111a7c8bafdc6f1 WatchSource:0}: Error finding container 8c46d479f3d37b422b5f5549ddd84738d23492ba1394907e2111a7c8bafdc6f1: Status 404 returned error can't find the container with id 8c46d479f3d37b422b5f5549ddd84738d23492ba1394907e2111a7c8bafdc6f1
Jul 31 20:31:04.527399 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:04.527108    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p75dl"]
Jul 31 20:31:04.532056 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:31:04.532026    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08a2bbf1_6485_4039_bb50_d2b54965d862.slice/crio-9c3cecc7c162ce349707201b42a5c17ed468819c9f46f3e7e44ff1f65d50e03b WatchSource:0}: Error finding container 9c3cecc7c162ce349707201b42a5c17ed468819c9f46f3e7e44ff1f65d50e03b: Status 404 returned error can't find the container with id 9c3cecc7c162ce349707201b42a5c17ed468819c9f46f3e7e44ff1f65d50e03b
Jul 31 20:31:04.546986 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:04.546916    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n4b78"]
Jul 31 20:31:05.376745 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:05.376706    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p75dl" event={"ID":"08a2bbf1-6485-4039-bb50-d2b54965d862","Type":"ContainerStarted","Data":"9c3cecc7c162ce349707201b42a5c17ed468819c9f46f3e7e44ff1f65d50e03b"}
Jul 31 20:31:05.379023 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:05.378988    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-lf9bg" event={"ID":"4cd0d500-315e-42ab-8b88-53c01d76bef0","Type":"ContainerStarted","Data":"8ceea4c4a887b63fb4c18c1a2359f8d03d6fada83a79a485008a284d827cc890"}
Jul 31 20:31:05.382203 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:05.382177    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs" event={"ID":"daba63af-fa2b-4f8e-bc40-9da878a92f9b","Type":"ContainerStarted","Data":"badb649726cff6f846d7514ee6e76acec233d254751be3b9b2dc22877b869e05"}
Jul 31 20:31:05.382304 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:05.382223    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs" event={"ID":"daba63af-fa2b-4f8e-bc40-9da878a92f9b","Type":"ContainerStarted","Data":"92b2c852d996fff87c7e7389fd73f12c62e8734c4eeac5713f60f8435dde5626"}
Jul 31 20:31:05.382304 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:05.382243    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs" event={"ID":"daba63af-fa2b-4f8e-bc40-9da878a92f9b","Type":"ContainerStarted","Data":"e821784982beb69af811b8b64a89d25acd72a09c879d2b1e5be941118753a0c5"}
Jul 31 20:31:05.384104 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:05.384078    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4696467d-jhwk7" event={"ID":"2fc413c7-5fe9-4aac-b3f1-348a686030ae","Type":"ContainerStarted","Data":"68c1483d87d8e725a2d217bdf2121ca03dda15455eab43a1030b7c9303664f26"}
Jul 31 20:31:05.385840 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:05.385813    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zslqn" event={"ID":"7bda5031-9205-4c6f-a712-57bfa836841a","Type":"ContainerStarted","Data":"8c46d479f3d37b422b5f5549ddd84738d23492ba1394907e2111a7c8bafdc6f1"}
Jul 31 20:31:05.387135 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:05.387112    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n4b78" event={"ID":"02901a22-831e-45fa-a04d-dc48ec82dd78","Type":"ContainerStarted","Data":"1a6ee190796eb102ecd0091b991e0d37ba57fca34b982311b41b54d99f8ea2ea"}
Jul 31 20:31:05.394082 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:05.394033    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-lf9bg" podStartSLOduration=5.54336665 podStartE2EDuration="7.394013738s" totalImagesPullingTime="1.850647088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:05.393245596 +0000 UTC m=+69.998638083" watchObservedRunningTime="2026-07-31 20:31:05.394013738 +0000 UTC m=+69.999406222"
Jul 31 20:31:05.407729 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:05.407671    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4696467d-jhwk7" podStartSLOduration=2.456595001 podStartE2EDuration="7.40765058s" totalImagesPullingTime="4.951055579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:05.40642005 +0000 UTC m=+70.011812528" watchObservedRunningTime="2026-07-31 20:31:05.40765058 +0000 UTC m=+70.013043057"
Jul 31 20:31:05.425831 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:05.425766    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f7dc5b5bd-tlqbs" podStartSLOduration=2.476652532 podStartE2EDuration="7.425741445s" totalImagesPullingTime="4.949088913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:05.424312225 +0000 UTC m=+70.029704702" watchObservedRunningTime="2026-07-31 20:31:05.425741445 +0000 UTC m=+70.031133923"
Jul 31 20:31:06.395026 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:06.394874    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p75dl" event={"ID":"08a2bbf1-6485-4039-bb50-d2b54965d862","Type":"ContainerStarted","Data":"fd7694a6f8577cd0f205cf60d15e0b6fc5a0360437e0750ae68ab4b5ebea2055"}
Jul 31 20:31:06.395026 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:06.394970    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p75dl" event={"ID":"08a2bbf1-6485-4039-bb50-d2b54965d862","Type":"ContainerStarted","Data":"319bc7dcb0d32b648f7dd368a1a3eb8d37d6e8fcd6680278673eb91023c8b1e9"}
Jul 31 20:31:06.410856 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:06.410802    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p75dl" podStartSLOduration=69.404136982 podStartE2EDuration="1m10.410780978s" totalImagesPullingTime="1.006643996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:06.409402682 +0000 UTC m=+71.014795160" watchObservedRunningTime="2026-07-31 20:31:06.410780978 +0000 UTC m=+71.016173456"
Jul 31 20:31:08.619366 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:08.619328    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:31:08.621980 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:08.621952    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf9b88d6-16ce-40dd-a570-d7671d2d47ba-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f5h8r\" (UID: \"bf9b88d6-16ce-40dd-a570-d7671d2d47ba\") " pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:31:08.795987 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:08.795957    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:31:08.818424 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:08.818228    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cdl8z\""
Jul 31 20:31:08.827642 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:08.827388    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f5h8r"
Jul 31 20:31:09.650672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:09.650647    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f5h8r"]
Jul 31 20:31:09.653754 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:31:09.653726    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9b88d6_16ce_40dd_a570_d7671d2d47ba.slice/crio-c3574ab0ba308379d721d3828ee225fad52aa9bb14cde8054427fce9be71afbb WatchSource:0}: Error finding container c3574ab0ba308379d721d3828ee225fad52aa9bb14cde8054427fce9be71afbb: Status 404 returned error can't find the container with id c3574ab0ba308379d721d3828ee225fad52aa9bb14cde8054427fce9be71afbb
Jul 31 20:31:10.411408 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:10.411374    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zslqn" event={"ID":"7bda5031-9205-4c6f-a712-57bfa836841a","Type":"ContainerStarted","Data":"83c8a32a591cc775a50f0c86ba833b61ea957654a947cc47fd9a4c43533d9b1a"}
Jul 31 20:31:10.412923 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:10.412899    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n4b78" event={"ID":"02901a22-831e-45fa-a04d-dc48ec82dd78","Type":"ContainerStarted","Data":"6fe51796043e94eb251f767c009eae2b43e71c0db99114d890333884b78ff433"}
Jul 31 20:31:10.413058 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:10.412980    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:31:10.414349 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:10.414320    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f5h8r" event={"ID":"bf9b88d6-16ce-40dd-a570-d7671d2d47ba","Type":"ContainerStarted","Data":"55e8dfafae2a7910c7db99c8846bee252581392caec816cd55118af8260b6c42"}
Jul 31 20:31:10.414464 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:10.414368    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f5h8r" event={"ID":"bf9b88d6-16ce-40dd-a570-d7671d2d47ba","Type":"ContainerStarted","Data":"c3574ab0ba308379d721d3828ee225fad52aa9bb14cde8054427fce9be71afbb"}
Jul 31 20:31:10.427139 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:10.427096    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zslqn" podStartSLOduration=69.424755501 podStartE2EDuration="1m14.427080244s" totalImagesPullingTime="5.002324743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:10.426221006 +0000 UTC m=+75.031613521" watchObservedRunningTime="2026-07-31 20:31:10.427080244 +0000 UTC m=+75.032472750"
Jul 31 20:31:10.442268 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:10.442221    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n4b78" podStartSLOduration=69.478335504 podStartE2EDuration="1m14.442204618s" totalImagesPullingTime="4.963869114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:29:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:10.441202983 +0000 UTC m=+75.046595460" watchObservedRunningTime="2026-07-31 20:31:10.442204618 +0000 UTC m=+75.047597096"
Jul 31 20:31:11.422687 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:11.422646    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f5h8r" event={"ID":"bf9b88d6-16ce-40dd-a570-d7671d2d47ba","Type":"ContainerStarted","Data":"bac4dfe1e95cae5bcfded6d75bd4b886e14681d1832484ca6ae654152d9746fd"}
Jul 31 20:31:12.428647 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:12.428612    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f5h8r" event={"ID":"bf9b88d6-16ce-40dd-a570-d7671d2d47ba","Type":"ContainerStarted","Data":"491fab28b2d57bdd96e792ab0179c62d62fbeadfadc9387dfbca0f5fcf5e4003"}
Jul 31 20:31:12.445695 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:12.445646    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f5h8r" podStartSLOduration=34.537648078 podStartE2EDuration="36.445628175s" totalImagesPullingTime="1.907980097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 20:30:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:12.444664765 +0000 UTC m=+77.050057241" watchObservedRunningTime="2026-07-31 20:31:12.445628175 +0000 UTC m=+77.051020651"
Jul 31 20:31:18.493970 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.493827    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ntvcs"]
Jul 31 20:31:18.498439 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.498418    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.501091 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.501066    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 31 20:31:18.501226 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.501198    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mbphr\""
Jul 31 20:31:18.501335 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.501076    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 31 20:31:18.501409 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.501101    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 31 20:31:18.501474 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.501180    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 31 20:31:18.501958 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.501940    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 31 20:31:18.502091 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.502049    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 31 20:31:18.595757 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.595723    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.596012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.595791    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c244498-e878-4f76-b956-078e288a29ea-metrics-client-ca\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.596012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.595816    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8c244498-e878-4f76-b956-078e288a29ea-root\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.596012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.595877    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.596012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.595928    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c244498-e878-4f76-b956-078e288a29ea-sys\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.596012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.595957    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl44q\" (UniqueName: \"kubernetes.io/projected/8c244498-e878-4f76-b956-078e288a29ea-kube-api-access-jl44q\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.596012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.595992    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-tls\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.596288 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.596026    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-wtmp\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.596288 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.596053    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-textfile\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.697130 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.697101    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.697130 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.697160    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c244498-e878-4f76-b956-078e288a29ea-metrics-client-ca\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.697401 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.697182    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8c244498-e878-4f76-b956-078e288a29ea-root\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.697401 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.697211    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.697401 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.697322    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8c244498-e878-4f76-b956-078e288a29ea-root\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.697401 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.697328    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c244498-e878-4f76-b956-078e288a29ea-sys\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.697401 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.697370    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl44q\" (UniqueName: \"kubernetes.io/projected/8c244498-e878-4f76-b956-078e288a29ea-kube-api-access-jl44q\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.697652 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.697411    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-tls\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.697652 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.697441    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c244498-e878-4f76-b956-078e288a29ea-sys\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.697652 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.697448    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-wtmp\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.697652 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.697476    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-textfile\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.697830 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:31:18.697750    2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 31 20:31:18.697882 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.697836    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-textfile\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.697882 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.697842    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.697882 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:31:18.697857    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-tls podName:8c244498-e878-4f76-b956-078e288a29ea nodeName:}" failed. No retries permitted until 2026-07-31 20:31:19.197833922 +0000 UTC m=+83.803226378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-tls") pod "node-exporter-ntvcs" (UID: "8c244498-e878-4f76-b956-078e288a29ea") : secret "node-exporter-tls" not found
Jul 31 20:31:18.698024 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.697858    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-wtmp\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.698024 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.697892    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c244498-e878-4f76-b956-078e288a29ea-metrics-client-ca\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.699936 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.699911    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:18.708232 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:18.708208    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl44q\" (UniqueName: \"kubernetes.io/projected/8c244498-e878-4f76-b956-078e288a29ea-kube-api-access-jl44q\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:19.202752 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:19.202719    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-tls\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:19.205303 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:19.205277    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8c244498-e878-4f76-b956-078e288a29ea-node-exporter-tls\") pod \"node-exporter-ntvcs\" (UID: \"8c244498-e878-4f76-b956-078e288a29ea\") " pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:19.408341 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:19.408306    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ntvcs"
Jul 31 20:31:19.423696 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:31:19.423666    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c244498_e878_4f76_b956_078e288a29ea.slice/crio-373ea9f350522513f0605daa890440487730370d909abe2ea02ebec788da5f36 WatchSource:0}: Error finding container 373ea9f350522513f0605daa890440487730370d909abe2ea02ebec788da5f36: Status 404 returned error can't find the container with id 373ea9f350522513f0605daa890440487730370d909abe2ea02ebec788da5f36
Jul 31 20:31:19.453769 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:19.453664    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ntvcs" event={"ID":"8c244498-e878-4f76-b956-078e288a29ea","Type":"ContainerStarted","Data":"373ea9f350522513f0605daa890440487730370d909abe2ea02ebec788da5f36"}
Jul 31 20:31:21.463612 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:21.463575    2566 generic.go:356] "Generic (PLEG): container finished" podID="8c244498-e878-4f76-b956-078e288a29ea" containerID="4f128ba46f0b3f8dc0661a5a960daacb6426ba2eb454f36d85593c1c00d20a93" exitCode=0
Jul 31 20:31:21.464026 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:21.463657    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ntvcs" event={"ID":"8c244498-e878-4f76-b956-078e288a29ea","Type":"ContainerDied","Data":"4f128ba46f0b3f8dc0661a5a960daacb6426ba2eb454f36d85593c1c00d20a93"}
Jul 31 20:31:22.362525 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:22.362494    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-755899888f-568sg"
Jul 31 20:31:22.469834 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:22.469801    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ntvcs" event={"ID":"8c244498-e878-4f76-b956-078e288a29ea","Type":"ContainerStarted","Data":"cb64c66970b90d9bdebb3764f1cf8758d2a91897fbd7807e46e214e55e8a16e1"}
Jul 31 20:31:22.470238 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:22.469857    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ntvcs" event={"ID":"8c244498-e878-4f76-b956-078e288a29ea","Type":"ContainerStarted","Data":"ccc96dff1e9058d6b6b916f162c0ee5916de27b0b58ac8f9069b0eecec85d157"}
Jul 31 20:31:22.488329 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:22.488277    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ntvcs" podStartSLOduration=3.376536907 podStartE2EDuration="4.48826062s" totalImagesPullingTime="1.038387444s" totalInitContainerRuntime="73.336269ms" isStatefulPod=true podCreationTimestamp="2026-07-31 20:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:31:22.487498166 +0000 UTC m=+87.092890639" watchObservedRunningTime="2026-07-31 20:31:22.48826062 +0000 UTC m=+87.093653095"
Jul 31 20:31:23.808833 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:23.808781    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77b8bc847-ddshz" podUID="e3e98058-4022-41fd-9a1c-10b2d8fe5ef7" containerName="registry" containerID="cri-o://a4edef822d3d8093ec1b8d76c2dd70032afc15afbbc4a74522ca46dba66049a6" gracePeriod=30
Jul 31 20:31:24.046424 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.046397    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:31:24.141728 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.141636    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-ca-trust-extracted\") pod \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") "
Jul 31 20:31:24.141728 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.141677    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-installation-pull-secrets\") pod \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") "
Jul 31 20:31:24.141728 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.141699    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls\") pod \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") "
Jul 31 20:31:24.142010 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.141821    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-certificates\") pod \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") "
Jul 31 20:31:24.142010 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.141870    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4zjz\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-kube-api-access-j4zjz\") pod \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") "
Jul 31 20:31:24.142010 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.141896    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-trusted-ca\") pod \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") "
Jul 31 20:31:24.142010 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.141917    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-bound-sa-token\") pod \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") "
Jul 31 20:31:24.142010 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.141946    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-image-registry-private-configuration\") pod \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\" (UID: \"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7\") "
Jul 31 20:31:24.142371 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.142304    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7" (UID: "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:31:24.142371 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.142323    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7" (UID: "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:31:24.144457 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.144430    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7" (UID: "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:31:24.144612 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.144590    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7" (UID: "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:31:24.144714 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.144691    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7" (UID: "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:31:24.144823 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.144802    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7" (UID: "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:31:24.145023 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.145002    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-kube-api-access-j4zjz" (OuterVolumeSpecName: "kube-api-access-j4zjz") pod "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7" (UID: "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7"). InnerVolumeSpecName "kube-api-access-j4zjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:31:24.150781 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.150755    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7" (UID: "e3e98058-4022-41fd-9a1c-10b2d8fe5ef7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:31:24.243246 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.243212    2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-certificates\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:31:24.243246 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.243242    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4zjz\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-kube-api-access-j4zjz\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:31:24.243246 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.243252    2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-trusted-ca\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:31:24.243459 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.243261    2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-bound-sa-token\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:31:24.243459 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.243269    2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-image-registry-private-configuration\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:31:24.243459 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.243278    2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-ca-trust-extracted\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:31:24.243459 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.243286    2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-installation-pull-secrets\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:31:24.243459 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.243294    2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7-registry-tls\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:31:24.478376 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.478286    2566 generic.go:356] "Generic (PLEG): container finished" podID="e3e98058-4022-41fd-9a1c-10b2d8fe5ef7" containerID="a4edef822d3d8093ec1b8d76c2dd70032afc15afbbc4a74522ca46dba66049a6" exitCode=0
Jul 31 20:31:24.478376 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.478343    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b8bc847-ddshz"
Jul 31 20:31:24.478646 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.478352    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b8bc847-ddshz" event={"ID":"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7","Type":"ContainerDied","Data":"a4edef822d3d8093ec1b8d76c2dd70032afc15afbbc4a74522ca46dba66049a6"}
Jul 31 20:31:24.478646 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.478480    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b8bc847-ddshz" event={"ID":"e3e98058-4022-41fd-9a1c-10b2d8fe5ef7","Type":"ContainerDied","Data":"ec532b3939189f54c4f578f9e3634236f07d23e126a91eeee3214e5d631ac982"}
Jul 31 20:31:24.478646 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.478507    2566 scope.go:117] "RemoveContainer" containerID="a4edef822d3d8093ec1b8d76c2dd70032afc15afbbc4a74522ca46dba66049a6"
Jul 31 20:31:24.486766 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.486748    2566 scope.go:117] "RemoveContainer" containerID="a4edef822d3d8093ec1b8d76c2dd70032afc15afbbc4a74522ca46dba66049a6"
Jul 31 20:31:24.487041 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:31:24.487023    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4edef822d3d8093ec1b8d76c2dd70032afc15afbbc4a74522ca46dba66049a6\": container with ID starting with a4edef822d3d8093ec1b8d76c2dd70032afc15afbbc4a74522ca46dba66049a6 not found: ID does not exist" containerID="a4edef822d3d8093ec1b8d76c2dd70032afc15afbbc4a74522ca46dba66049a6"
Jul 31 20:31:24.487083 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.487050    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4edef822d3d8093ec1b8d76c2dd70032afc15afbbc4a74522ca46dba66049a6"} err="failed to get container status \"a4edef822d3d8093ec1b8d76c2dd70032afc15afbbc4a74522ca46dba66049a6\": rpc error: code = NotFound desc = could not find container \"a4edef822d3d8093ec1b8d76c2dd70032afc15afbbc4a74522ca46dba66049a6\": container with ID starting with a4edef822d3d8093ec1b8d76c2dd70032afc15afbbc4a74522ca46dba66049a6 not found: ID does not exist"
Jul 31 20:31:24.512564 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.512534    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77b8bc847-ddshz"]
Jul 31 20:31:24.528067 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:24.527615    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77b8bc847-ddshz"]
Jul 31 20:31:25.933784 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:25.933745    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3e98058-4022-41fd-9a1c-10b2d8fe5ef7" path="/var/lib/kubelet/pods/e3e98058-4022-41fd-9a1c-10b2d8fe5ef7/volumes"
Jul 31 20:31:41.424892 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:31:41.424856    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n4b78"
Jul 31 20:34:55.825085 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:34:55.825055    2566 kubelet.go:1648] "Image garbage collection succeeded"
Jul 31 20:36:08.000620 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.000584    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"]
Jul 31 20:36:08.001097 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.000847    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3e98058-4022-41fd-9a1c-10b2d8fe5ef7" containerName="registry"
Jul 31 20:36:08.001097 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.000858    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3e98058-4022-41fd-9a1c-10b2d8fe5ef7" containerName="registry"
Jul 31 20:36:08.001097 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.000911    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3e98058-4022-41fd-9a1c-10b2d8fe5ef7" containerName="registry"
Jul 31 20:36:08.003817 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.003797    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:08.006297 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.006273    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 31 20:36:08.006445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.006317    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 31 20:36:08.006445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.006372    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 31 20:36:08.006445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.006320    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-66k6x\""
Jul 31 20:36:08.006445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.006323    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 31 20:36:08.024181 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.024133    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"]
Jul 31 20:36:08.138544 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.138505    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/87ee0c76-8d85-4e82-bd19-67d24055cd43-apiservice-cert\") pod \"opendatahub-operator-controller-manager-786d856849-wrnv2\" (UID: \"87ee0c76-8d85-4e82-bd19-67d24055cd43\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:08.138544 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.138544    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87ee0c76-8d85-4e82-bd19-67d24055cd43-tmp\") pod \"opendatahub-operator-controller-manager-786d856849-wrnv2\" (UID: \"87ee0c76-8d85-4e82-bd19-67d24055cd43\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:08.138763 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.138562    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87ee0c76-8d85-4e82-bd19-67d24055cd43-webhook-cert\") pod \"opendatahub-operator-controller-manager-786d856849-wrnv2\" (UID: \"87ee0c76-8d85-4e82-bd19-67d24055cd43\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:08.138763 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.138579    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/87ee0c76-8d85-4e82-bd19-67d24055cd43-manifests\") pod \"opendatahub-operator-controller-manager-786d856849-wrnv2\" (UID: \"87ee0c76-8d85-4e82-bd19-67d24055cd43\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:08.138763 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.138656    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lld2l\" (UniqueName: \"kubernetes.io/projected/87ee0c76-8d85-4e82-bd19-67d24055cd43-kube-api-access-lld2l\") pod \"opendatahub-operator-controller-manager-786d856849-wrnv2\" (UID: \"87ee0c76-8d85-4e82-bd19-67d24055cd43\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:08.239841 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.239804    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87ee0c76-8d85-4e82-bd19-67d24055cd43-tmp\") pod \"opendatahub-operator-controller-manager-786d856849-wrnv2\" (UID: \"87ee0c76-8d85-4e82-bd19-67d24055cd43\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:08.239841 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.239842    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87ee0c76-8d85-4e82-bd19-67d24055cd43-webhook-cert\") pod \"opendatahub-operator-controller-manager-786d856849-wrnv2\" (UID: \"87ee0c76-8d85-4e82-bd19-67d24055cd43\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:08.240057 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.239863    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/87ee0c76-8d85-4e82-bd19-67d24055cd43-manifests\") pod \"opendatahub-operator-controller-manager-786d856849-wrnv2\" (UID: \"87ee0c76-8d85-4e82-bd19-67d24055cd43\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:08.240057 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.239890    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lld2l\" (UniqueName: \"kubernetes.io/projected/87ee0c76-8d85-4e82-bd19-67d24055cd43-kube-api-access-lld2l\") pod \"opendatahub-operator-controller-manager-786d856849-wrnv2\" (UID: \"87ee0c76-8d85-4e82-bd19-67d24055cd43\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:08.240057 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.239939    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/87ee0c76-8d85-4e82-bd19-67d24055cd43-apiservice-cert\") pod \"opendatahub-operator-controller-manager-786d856849-wrnv2\" (UID: \"87ee0c76-8d85-4e82-bd19-67d24055cd43\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:08.240341 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.240314    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/87ee0c76-8d85-4e82-bd19-67d24055cd43-manifests\") pod \"opendatahub-operator-controller-manager-786d856849-wrnv2\" (UID: \"87ee0c76-8d85-4e82-bd19-67d24055cd43\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:08.242380 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.242355    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87ee0c76-8d85-4e82-bd19-67d24055cd43-tmp\") pod \"opendatahub-operator-controller-manager-786d856849-wrnv2\" (UID: \"87ee0c76-8d85-4e82-bd19-67d24055cd43\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:08.242492 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.242475    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/87ee0c76-8d85-4e82-bd19-67d24055cd43-apiservice-cert\") pod \"opendatahub-operator-controller-manager-786d856849-wrnv2\" (UID: \"87ee0c76-8d85-4e82-bd19-67d24055cd43\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:08.242613 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.242595    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/87ee0c76-8d85-4e82-bd19-67d24055cd43-webhook-cert\") pod \"opendatahub-operator-controller-manager-786d856849-wrnv2\" (UID: \"87ee0c76-8d85-4e82-bd19-67d24055cd43\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:08.249936 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.249911    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lld2l\" (UniqueName: \"kubernetes.io/projected/87ee0c76-8d85-4e82-bd19-67d24055cd43-kube-api-access-lld2l\") pod \"opendatahub-operator-controller-manager-786d856849-wrnv2\" (UID: \"87ee0c76-8d85-4e82-bd19-67d24055cd43\") " pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:08.313078 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.313042    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:08.447324 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.447220    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"]
Jul 31 20:36:08.450180 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:36:08.450130    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ee0c76_8d85_4e82_bd19_67d24055cd43.slice/crio-9f77a813f2d5a590eadb84e89435d7b039d28bbb63e9da058139aa97ba1887ba WatchSource:0}: Error finding container 9f77a813f2d5a590eadb84e89435d7b039d28bbb63e9da058139aa97ba1887ba: Status 404 returned error can't find the container with id 9f77a813f2d5a590eadb84e89435d7b039d28bbb63e9da058139aa97ba1887ba
Jul 31 20:36:08.451859 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:08.451839    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 20:36:09.409877 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:09.409841    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2" event={"ID":"87ee0c76-8d85-4e82-bd19-67d24055cd43","Type":"ContainerStarted","Data":"9f77a813f2d5a590eadb84e89435d7b039d28bbb63e9da058139aa97ba1887ba"}
Jul 31 20:36:12.422853 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:12.422817    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2" event={"ID":"87ee0c76-8d85-4e82-bd19-67d24055cd43","Type":"ContainerStarted","Data":"59fd322a6480db9e603a99097c798f3fc760f96b023278e511854f25fde7f504"}
Jul 31 20:36:13.427497 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:13.427464    2566 generic.go:356] "Generic (PLEG): container finished" podID="87ee0c76-8d85-4e82-bd19-67d24055cd43" containerID="59fd322a6480db9e603a99097c798f3fc760f96b023278e511854f25fde7f504" exitCode=0
Jul 31 20:36:13.427991 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:13.427556    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2" event={"ID":"87ee0c76-8d85-4e82-bd19-67d24055cd43","Type":"ContainerDied","Data":"59fd322a6480db9e603a99097c798f3fc760f96b023278e511854f25fde7f504"}
Jul 31 20:36:14.434978 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:14.434940    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2" event={"ID":"87ee0c76-8d85-4e82-bd19-67d24055cd43","Type":"ContainerStarted","Data":"04227c46387fbe04a135661df1c6a2f55cb2f4b8042771a0bfa2be8caf078077"}
Jul 31 20:36:14.435481 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:14.435087    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:14.457634 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:14.457561    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2" podStartSLOduration=2.873626634 podStartE2EDuration="7.457536771s" totalImagesPullingTime="3.558965641s" totalInitContainerRuntime="1.024944496s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:36:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:36:14.454746291 +0000 UTC m=+379.060138770" watchObservedRunningTime="2026-07-31 20:36:14.457536771 +0000 UTC m=+379.062929249"
Jul 31 20:36:25.441285 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:25.441252    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-786d856849-wrnv2"
Jul 31 20:36:28.900647 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:28.900611    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d469b876d-gtw46"]
Jul 31 20:36:28.908929 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:28.908903    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d469b876d-gtw46"
Jul 31 20:36:28.911791 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:28.911760    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 31 20:36:28.911959 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:28.911940    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 31 20:36:28.912066 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:28.912047    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 31 20:36:28.912700 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:28.912682    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 31 20:36:28.916095 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:28.916074    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d469b876d-gtw46"]
Jul 31 20:36:29.005247 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.005214    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bnb5\" (UniqueName: \"kubernetes.io/projected/45faa39f-02fc-4802-9cfb-c3b1d2f22b4e-kube-api-access-6bnb5\") pod \"kube-auth-proxy-6d469b876d-gtw46\" (UID: \"45faa39f-02fc-4802-9cfb-c3b1d2f22b4e\") " pod="openshift-ingress/kube-auth-proxy-6d469b876d-gtw46"
Jul 31 20:36:29.005421 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.005276    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45faa39f-02fc-4802-9cfb-c3b1d2f22b4e-tmp\") pod \"kube-auth-proxy-6d469b876d-gtw46\" (UID: \"45faa39f-02fc-4802-9cfb-c3b1d2f22b4e\") " pod="openshift-ingress/kube-auth-proxy-6d469b876d-gtw46"
Jul 31 20:36:29.005421 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.005309    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45faa39f-02fc-4802-9cfb-c3b1d2f22b4e-tls-certs\") pod \"kube-auth-proxy-6d469b876d-gtw46\" (UID: \"45faa39f-02fc-4802-9cfb-c3b1d2f22b4e\") " pod="openshift-ingress/kube-auth-proxy-6d469b876d-gtw46"
Jul 31 20:36:29.106124 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.106085    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45faa39f-02fc-4802-9cfb-c3b1d2f22b4e-tmp\") pod \"kube-auth-proxy-6d469b876d-gtw46\" (UID: \"45faa39f-02fc-4802-9cfb-c3b1d2f22b4e\") " pod="openshift-ingress/kube-auth-proxy-6d469b876d-gtw46"
Jul 31 20:36:29.106331 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.106140    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45faa39f-02fc-4802-9cfb-c3b1d2f22b4e-tls-certs\") pod \"kube-auth-proxy-6d469b876d-gtw46\" (UID: \"45faa39f-02fc-4802-9cfb-c3b1d2f22b4e\") " pod="openshift-ingress/kube-auth-proxy-6d469b876d-gtw46"
Jul 31 20:36:29.106331 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.106211    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bnb5\" (UniqueName: \"kubernetes.io/projected/45faa39f-02fc-4802-9cfb-c3b1d2f22b4e-kube-api-access-6bnb5\") pod \"kube-auth-proxy-6d469b876d-gtw46\" (UID: \"45faa39f-02fc-4802-9cfb-c3b1d2f22b4e\") " pod="openshift-ingress/kube-auth-proxy-6d469b876d-gtw46"
Jul 31 20:36:29.106414 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:36:29.106332    2566 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 31 20:36:29.106449 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:36:29.106416    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45faa39f-02fc-4802-9cfb-c3b1d2f22b4e-tls-certs podName:45faa39f-02fc-4802-9cfb-c3b1d2f22b4e nodeName:}" failed. No retries permitted until 2026-07-31 20:36:29.606395487 +0000 UTC m=+394.211787940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/45faa39f-02fc-4802-9cfb-c3b1d2f22b4e-tls-certs") pod "kube-auth-proxy-6d469b876d-gtw46" (UID: "45faa39f-02fc-4802-9cfb-c3b1d2f22b4e") : secret "kube-auth-proxy-tls" not found
Jul 31 20:36:29.108811 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.108784    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45faa39f-02fc-4802-9cfb-c3b1d2f22b4e-tmp\") pod \"kube-auth-proxy-6d469b876d-gtw46\" (UID: \"45faa39f-02fc-4802-9cfb-c3b1d2f22b4e\") " pod="openshift-ingress/kube-auth-proxy-6d469b876d-gtw46"
Jul 31 20:36:29.116641 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.116618    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5wx6h"]
Jul 31 20:36:29.119536 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.119519    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5wx6h"
Jul 31 20:36:29.122224 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.122205    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 31 20:36:29.122224 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.122218    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7djdq\""
Jul 31 20:36:29.126460 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.126441    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bnb5\" (UniqueName: \"kubernetes.io/projected/45faa39f-02fc-4802-9cfb-c3b1d2f22b4e-kube-api-access-6bnb5\") pod \"kube-auth-proxy-6d469b876d-gtw46\" (UID: \"45faa39f-02fc-4802-9cfb-c3b1d2f22b4e\") " pod="openshift-ingress/kube-auth-proxy-6d469b876d-gtw46"
Jul 31 20:36:29.132396 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.132375    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5wx6h"]
Jul 31 20:36:29.207107 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.207028    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz77m\" (UniqueName: \"kubernetes.io/projected/b87b9f5a-74ab-4ac5-8960-4b38d16c9e66-kube-api-access-rz77m\") pod \"odh-model-controller-7998c67dc4-5wx6h\" (UID: \"b87b9f5a-74ab-4ac5-8960-4b38d16c9e66\") " pod="opendatahub/odh-model-controller-7998c67dc4-5wx6h"
Jul 31 20:36:29.207281 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.207173    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b87b9f5a-74ab-4ac5-8960-4b38d16c9e66-cert\") pod \"odh-model-controller-7998c67dc4-5wx6h\" (UID: \"b87b9f5a-74ab-4ac5-8960-4b38d16c9e66\") " pod="opendatahub/odh-model-controller-7998c67dc4-5wx6h"
Jul 31 20:36:29.307839 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.307806    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b87b9f5a-74ab-4ac5-8960-4b38d16c9e66-cert\") pod \"odh-model-controller-7998c67dc4-5wx6h\" (UID: \"b87b9f5a-74ab-4ac5-8960-4b38d16c9e66\") " pod="opendatahub/odh-model-controller-7998c67dc4-5wx6h"
Jul 31 20:36:29.307839 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.307841    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz77m\" (UniqueName: \"kubernetes.io/projected/b87b9f5a-74ab-4ac5-8960-4b38d16c9e66-kube-api-access-rz77m\") pod \"odh-model-controller-7998c67dc4-5wx6h\" (UID: \"b87b9f5a-74ab-4ac5-8960-4b38d16c9e66\") " pod="opendatahub/odh-model-controller-7998c67dc4-5wx6h"
Jul 31 20:36:29.310476 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.310442    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b87b9f5a-74ab-4ac5-8960-4b38d16c9e66-cert\") pod \"odh-model-controller-7998c67dc4-5wx6h\" (UID: \"b87b9f5a-74ab-4ac5-8960-4b38d16c9e66\") " pod="opendatahub/odh-model-controller-7998c67dc4-5wx6h"
Jul 31 20:36:29.316008 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.315982    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz77m\" (UniqueName: \"kubernetes.io/projected/b87b9f5a-74ab-4ac5-8960-4b38d16c9e66-kube-api-access-rz77m\") pod \"odh-model-controller-7998c67dc4-5wx6h\" (UID: \"b87b9f5a-74ab-4ac5-8960-4b38d16c9e66\") " pod="opendatahub/odh-model-controller-7998c67dc4-5wx6h"
Jul 31 20:36:29.437827 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.437792    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5wx6h"
Jul 31 20:36:29.577680 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.577654    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5wx6h"]
Jul 31 20:36:29.580484 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:36:29.580441    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb87b9f5a_74ab_4ac5_8960_4b38d16c9e66.slice/crio-7f7ef1100231e18f0e90af5d05678df261b6f6fa97773ac2c216ea503dd41fa4 WatchSource:0}: Error finding container 7f7ef1100231e18f0e90af5d05678df261b6f6fa97773ac2c216ea503dd41fa4: Status 404 returned error can't find the container with id 7f7ef1100231e18f0e90af5d05678df261b6f6fa97773ac2c216ea503dd41fa4
Jul 31 20:36:29.610053 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.610018    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45faa39f-02fc-4802-9cfb-c3b1d2f22b4e-tls-certs\") pod \"kube-auth-proxy-6d469b876d-gtw46\" (UID: \"45faa39f-02fc-4802-9cfb-c3b1d2f22b4e\") " pod="openshift-ingress/kube-auth-proxy-6d469b876d-gtw46"
Jul 31 20:36:29.612522 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.612503    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45faa39f-02fc-4802-9cfb-c3b1d2f22b4e-tls-certs\") pod \"kube-auth-proxy-6d469b876d-gtw46\" (UID: \"45faa39f-02fc-4802-9cfb-c3b1d2f22b4e\") " pod="openshift-ingress/kube-auth-proxy-6d469b876d-gtw46"
Jul 31 20:36:29.820597 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.820554    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d469b876d-gtw46"
Jul 31 20:36:29.905801 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.905773    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-96ls9"]
Jul 31 20:36:29.909016 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.908995    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-96ls9"
Jul 31 20:36:29.911713 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.911410    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-fjxcd\""
Jul 31 20:36:29.911713 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.911519    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 31 20:36:29.919511 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.919479    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-96ls9"]
Jul 31 20:36:29.967880 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:29.967844    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d469b876d-gtw46"]
Jul 31 20:36:29.972737 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:36:29.972695    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45faa39f_02fc_4802_9cfb_c3b1d2f22b4e.slice/crio-efc0feed51b2048853401262498730f19fdf67402b3e20e99fb53313f21ca362 WatchSource:0}: Error finding container efc0feed51b2048853401262498730f19fdf67402b3e20e99fb53313f21ca362: Status 404 returned error can't find the container with id efc0feed51b2048853401262498730f19fdf67402b3e20e99fb53313f21ca362
Jul 31 20:36:30.011949 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.011902    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/009ff44f-1a56-48bb-b6e2-607feda4ad9f-tls-certs\") pod \"model-serving-api-54d89bd5fc-96ls9\" (UID: \"009ff44f-1a56-48bb-b6e2-607feda4ad9f\") " pod="opendatahub/model-serving-api-54d89bd5fc-96ls9"
Jul 31 20:36:30.012197 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.011981    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzd5x\" (UniqueName: \"kubernetes.io/projected/009ff44f-1a56-48bb-b6e2-607feda4ad9f-kube-api-access-fzd5x\") pod \"model-serving-api-54d89bd5fc-96ls9\" (UID: \"009ff44f-1a56-48bb-b6e2-607feda4ad9f\") " pod="opendatahub/model-serving-api-54d89bd5fc-96ls9"
Jul 31 20:36:30.112876 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.112783    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/009ff44f-1a56-48bb-b6e2-607feda4ad9f-tls-certs\") pod \"model-serving-api-54d89bd5fc-96ls9\" (UID: \"009ff44f-1a56-48bb-b6e2-607feda4ad9f\") " pod="opendatahub/model-serving-api-54d89bd5fc-96ls9"
Jul 31 20:36:30.112876 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.112833    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzd5x\" (UniqueName: \"kubernetes.io/projected/009ff44f-1a56-48bb-b6e2-607feda4ad9f-kube-api-access-fzd5x\") pod \"model-serving-api-54d89bd5fc-96ls9\" (UID: \"009ff44f-1a56-48bb-b6e2-607feda4ad9f\") " pod="opendatahub/model-serving-api-54d89bd5fc-96ls9"
Jul 31 20:36:30.115451 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.115426    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/009ff44f-1a56-48bb-b6e2-607feda4ad9f-tls-certs\") pod \"model-serving-api-54d89bd5fc-96ls9\" (UID: \"009ff44f-1a56-48bb-b6e2-607feda4ad9f\") " pod="opendatahub/model-serving-api-54d89bd5fc-96ls9"
Jul 31 20:36:30.124303 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.124275    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzd5x\" (UniqueName: \"kubernetes.io/projected/009ff44f-1a56-48bb-b6e2-607feda4ad9f-kube-api-access-fzd5x\") pod \"model-serving-api-54d89bd5fc-96ls9\" (UID: \"009ff44f-1a56-48bb-b6e2-607feda4ad9f\") " pod="opendatahub/model-serving-api-54d89bd5fc-96ls9"
Jul 31 20:36:30.191665 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.190752    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"]
Jul 31 20:36:30.194352 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.194321    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.196771 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.196735    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 31 20:36:30.196880 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.196749    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 31 20:36:30.196953 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.196749    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 31 20:36:30.197022 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.196997    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 31 20:36:30.197075 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.197019    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vfdxx\""
Jul 31 20:36:30.208008 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.207982    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"]
Jul 31 20:36:30.223953 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.223923    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-96ls9"
Jul 31 20:36:30.315839 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.314732    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.315839 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.314792    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/947b871d-eeae-49ec-82cb-677e41461210-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.315839 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.314833    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j5k6\" (UniqueName: \"kubernetes.io/projected/947b871d-eeae-49ec-82cb-677e41461210-kube-api-access-5j5k6\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.315839 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.314872    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/947b871d-eeae-49ec-82cb-677e41461210-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.315839 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.314934    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/947b871d-eeae-49ec-82cb-677e41461210-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.315839 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.315000    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.315839 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.315031    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.371547 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.371465    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-96ls9"]
Jul 31 20:36:30.375397 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:36:30.375362    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009ff44f_1a56_48bb_b6e2_607feda4ad9f.slice/crio-65fdd5d0c41dce91700195cb8cd41d5873cfde030454ae8a8749b67aadb8b78a WatchSource:0}: Error finding container 65fdd5d0c41dce91700195cb8cd41d5873cfde030454ae8a8749b67aadb8b78a: Status 404 returned error can't find the container with id 65fdd5d0c41dce91700195cb8cd41d5873cfde030454ae8a8749b67aadb8b78a
Jul 31 20:36:30.416207 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.416171    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j5k6\" (UniqueName: \"kubernetes.io/projected/947b871d-eeae-49ec-82cb-677e41461210-kube-api-access-5j5k6\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.416207 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.416225    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/947b871d-eeae-49ec-82cb-677e41461210-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.416463 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.416249    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/947b871d-eeae-49ec-82cb-677e41461210-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.416463 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.416288    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.416463 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.416309    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.416463 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.416362    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.416463 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.416399    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/947b871d-eeae-49ec-82cb-677e41461210-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.417012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.416958    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/947b871d-eeae-49ec-82cb-677e41461210-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.419091 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.419067    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/947b871d-eeae-49ec-82cb-677e41461210-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.419336 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.419308    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.419410 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.419348    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.419463 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.419423    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.424265 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.424245    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/947b871d-eeae-49ec-82cb-677e41461210-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.424598 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.424578    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j5k6\" (UniqueName: \"kubernetes.io/projected/947b871d-eeae-49ec-82cb-677e41461210-kube-api-access-5j5k6\") pod \"istiod-openshift-gateway-7b7995d5cd-86xxx\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.490936 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.490898    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5wx6h" event={"ID":"b87b9f5a-74ab-4ac5-8960-4b38d16c9e66","Type":"ContainerStarted","Data":"7f7ef1100231e18f0e90af5d05678df261b6f6fa97773ac2c216ea503dd41fa4"}
Jul 31 20:36:30.492688 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.492622    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-96ls9" event={"ID":"009ff44f-1a56-48bb-b6e2-607feda4ad9f","Type":"ContainerStarted","Data":"65fdd5d0c41dce91700195cb8cd41d5873cfde030454ae8a8749b67aadb8b78a"}
Jul 31 20:36:30.494139 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.494109    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d469b876d-gtw46" event={"ID":"45faa39f-02fc-4802-9cfb-c3b1d2f22b4e","Type":"ContainerStarted","Data":"efc0feed51b2048853401262498730f19fdf67402b3e20e99fb53313f21ca362"}
Jul 31 20:36:30.506830 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.506801    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:30.665216 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:30.665119    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"]
Jul 31 20:36:31.501521 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:31.501478    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx" event={"ID":"947b871d-eeae-49ec-82cb-677e41461210","Type":"ContainerStarted","Data":"e22016e5e29b55ea56da961d2f21717e6f451f3e900d40656364c1175964b429"}
Jul 31 20:36:35.006740 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:35.006699    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 20:36:35.007015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:35.006780    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 20:36:35.522769 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:35.522727    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx" event={"ID":"947b871d-eeae-49ec-82cb-677e41461210","Type":"ContainerStarted","Data":"74349629aea90732be8025da9f00649a358b809875f26966b36550316acb801a"}
Jul 31 20:36:35.522950 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:35.522896    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:35.524271 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:35.524242    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d469b876d-gtw46" event={"ID":"45faa39f-02fc-4802-9cfb-c3b1d2f22b4e","Type":"ContainerStarted","Data":"c857ed9b28a1d55c9a6a7deaa6a997c7dc96aa324488b49334c2bbc79acf8568"}
Jul 31 20:36:35.525785 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:35.525758    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-96ls9" event={"ID":"009ff44f-1a56-48bb-b6e2-607feda4ad9f","Type":"ContainerStarted","Data":"28c6a603e7520f4f29bb47c265dd91bbf6abfa2fcf12228e94fc7853a924c59a"}
Jul 31 20:36:35.525915 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:35.525842    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-96ls9"
Jul 31 20:36:35.527204 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:35.527183    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5wx6h" event={"ID":"b87b9f5a-74ab-4ac5-8960-4b38d16c9e66","Type":"ContainerStarted","Data":"d15853292034fc0fd0333ffc65600e5f2b4e44c3fe1033200a0de72e9d856ca6"}
Jul 31 20:36:35.527324 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:35.527310    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-5wx6h"
Jul 31 20:36:35.542351 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:35.542291    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx" podStartSLOduration=1.210480248 podStartE2EDuration="5.542272504s" totalImagesPullingTime="4.331792256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:36:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:36:35.54194942 +0000 UTC m=+400.147341896" watchObservedRunningTime="2026-07-31 20:36:35.542272504 +0000 UTC m=+400.147664983"
Jul 31 20:36:35.559810 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:35.559743    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-96ls9" podStartSLOduration=1.9928560910000002 podStartE2EDuration="6.559722084s" totalImagesPullingTime="4.566865993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:36:35.558432963 +0000 UTC m=+400.163825441" watchObservedRunningTime="2026-07-31 20:36:35.559722084 +0000 UTC m=+400.165114561"
Jul 31 20:36:35.572520 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:35.572450    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-5wx6h" podStartSLOduration=1.217674382 podStartE2EDuration="6.572431366s" totalImagesPullingTime="5.354756984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:36:35.572255097 +0000 UTC m=+400.177647600" watchObservedRunningTime="2026-07-31 20:36:35.572431366 +0000 UTC m=+400.177824035"
Jul 31 20:36:35.588821 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:35.588769    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d469b876d-gtw46" podStartSLOduration=2.623218425 podStartE2EDuration="7.588752414s" totalImagesPullingTime="4.965533989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:36:35.587140353 +0000 UTC m=+400.192532831" watchObservedRunningTime="2026-07-31 20:36:35.588752414 +0000 UTC m=+400.194144891"
Jul 31 20:36:36.534001 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:36.533923    2566 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-86xxx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 20:36:36.534001 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:36.533983    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx" podUID="947b871d-eeae-49ec-82cb-677e41461210" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 20:36:39.533890 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:39.533854    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:40.351799 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.351760    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8kwrp"]
Jul 31 20:36:40.354729 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.354704    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8kwrp"
Jul 31 20:36:40.358254 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.358229    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 31 20:36:40.358844 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.358830    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-s6fnq\""
Jul 31 20:36:40.359462 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.359443    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l2g8t"]
Jul 31 20:36:40.362397 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.362379    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l2g8t"
Jul 31 20:36:40.364664 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.364647    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 31 20:36:40.364860 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.364840    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-9w87x\""
Jul 31 20:36:40.370076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.370057    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8kwrp"]
Jul 31 20:36:40.374270 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.374207    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l2g8t"]
Jul 31 20:36:40.404350 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.404320    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0f94072-d0bc-43bb-bea8-a8fdb1aab366-cert\") pod \"kserve-controller-manager-d6f4b65b8-8kwrp\" (UID: \"b0f94072-d0bc-43bb-bea8-a8fdb1aab366\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8kwrp"
Jul 31 20:36:40.404557 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.404359    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a4e2b6b-8fcb-420a-b9cb-fb95975900b3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l2g8t\" (UID: \"0a4e2b6b-8fcb-420a-b9cb-fb95975900b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l2g8t"
Jul 31 20:36:40.404557 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.404399    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nhfc\" (UniqueName: \"kubernetes.io/projected/0a4e2b6b-8fcb-420a-b9cb-fb95975900b3-kube-api-access-4nhfc\") pod \"llmisvc-controller-manager-777c6bd7d5-l2g8t\" (UID: \"0a4e2b6b-8fcb-420a-b9cb-fb95975900b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l2g8t"
Jul 31 20:36:40.404557 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.404417    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n6rf\" (UniqueName: \"kubernetes.io/projected/b0f94072-d0bc-43bb-bea8-a8fdb1aab366-kube-api-access-2n6rf\") pod \"kserve-controller-manager-d6f4b65b8-8kwrp\" (UID: \"b0f94072-d0bc-43bb-bea8-a8fdb1aab366\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8kwrp"
Jul 31 20:36:40.505134 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.505092    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nhfc\" (UniqueName: \"kubernetes.io/projected/0a4e2b6b-8fcb-420a-b9cb-fb95975900b3-kube-api-access-4nhfc\") pod \"llmisvc-controller-manager-777c6bd7d5-l2g8t\" (UID: \"0a4e2b6b-8fcb-420a-b9cb-fb95975900b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l2g8t"
Jul 31 20:36:40.505354 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.505174    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n6rf\" (UniqueName: \"kubernetes.io/projected/b0f94072-d0bc-43bb-bea8-a8fdb1aab366-kube-api-access-2n6rf\") pod \"kserve-controller-manager-d6f4b65b8-8kwrp\" (UID: \"b0f94072-d0bc-43bb-bea8-a8fdb1aab366\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8kwrp"
Jul 31 20:36:40.505354 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.505230    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0f94072-d0bc-43bb-bea8-a8fdb1aab366-cert\") pod \"kserve-controller-manager-d6f4b65b8-8kwrp\" (UID: \"b0f94072-d0bc-43bb-bea8-a8fdb1aab366\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8kwrp"
Jul 31 20:36:40.505354 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.505282    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a4e2b6b-8fcb-420a-b9cb-fb95975900b3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l2g8t\" (UID: \"0a4e2b6b-8fcb-420a-b9cb-fb95975900b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l2g8t"
Jul 31 20:36:40.505502 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:36:40.505387    2566 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 31 20:36:40.505502 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:36:40.505453    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a4e2b6b-8fcb-420a-b9cb-fb95975900b3-cert podName:0a4e2b6b-8fcb-420a-b9cb-fb95975900b3 nodeName:}" failed. No retries permitted until 2026-07-31 20:36:41.005430374 +0000 UTC m=+405.610822841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0a4e2b6b-8fcb-420a-b9cb-fb95975900b3-cert") pod "llmisvc-controller-manager-777c6bd7d5-l2g8t" (UID: "0a4e2b6b-8fcb-420a-b9cb-fb95975900b3") : secret "llmisvc-webhook-server-cert" not found
Jul 31 20:36:40.508004 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.507983    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0f94072-d0bc-43bb-bea8-a8fdb1aab366-cert\") pod \"kserve-controller-manager-d6f4b65b8-8kwrp\" (UID: \"b0f94072-d0bc-43bb-bea8-a8fdb1aab366\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8kwrp"
Jul 31 20:36:40.517975 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.517948    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nhfc\" (UniqueName: \"kubernetes.io/projected/0a4e2b6b-8fcb-420a-b9cb-fb95975900b3-kube-api-access-4nhfc\") pod \"llmisvc-controller-manager-777c6bd7d5-l2g8t\" (UID: \"0a4e2b6b-8fcb-420a-b9cb-fb95975900b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l2g8t"
Jul 31 20:36:40.518587 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.518570    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n6rf\" (UniqueName: \"kubernetes.io/projected/b0f94072-d0bc-43bb-bea8-a8fdb1aab366-kube-api-access-2n6rf\") pod \"kserve-controller-manager-d6f4b65b8-8kwrp\" (UID: \"b0f94072-d0bc-43bb-bea8-a8fdb1aab366\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8kwrp"
Jul 31 20:36:40.665385 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.665294    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8kwrp"
Jul 31 20:36:40.817817 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:40.817786    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8kwrp"]
Jul 31 20:36:40.821435 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:36:40.821409    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f94072_d0bc_43bb_bea8_a8fdb1aab366.slice/crio-d7c0f956aad5ea02057f27309be88d2425197f47e4ee84bdf7aed6055bdf80c3 WatchSource:0}: Error finding container d7c0f956aad5ea02057f27309be88d2425197f47e4ee84bdf7aed6055bdf80c3: Status 404 returned error can't find the container with id d7c0f956aad5ea02057f27309be88d2425197f47e4ee84bdf7aed6055bdf80c3
Jul 31 20:36:41.007909 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:41.007826    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a4e2b6b-8fcb-420a-b9cb-fb95975900b3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l2g8t\" (UID: \"0a4e2b6b-8fcb-420a-b9cb-fb95975900b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l2g8t"
Jul 31 20:36:41.010507 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:41.010482    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a4e2b6b-8fcb-420a-b9cb-fb95975900b3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-l2g8t\" (UID: \"0a4e2b6b-8fcb-420a-b9cb-fb95975900b3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l2g8t"
Jul 31 20:36:41.277715 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:41.277613    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l2g8t"
Jul 31 20:36:41.416207 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:41.416182    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-l2g8t"]
Jul 31 20:36:41.418496 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:36:41.418471    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0a4e2b6b_8fcb_420a_b9cb_fb95975900b3.slice/crio-be23245605bbb49cb5377a408fb1704f39d8e2a7e660aeca6fd4349e97766482 WatchSource:0}: Error finding container be23245605bbb49cb5377a408fb1704f39d8e2a7e660aeca6fd4349e97766482: Status 404 returned error can't find the container with id be23245605bbb49cb5377a408fb1704f39d8e2a7e660aeca6fd4349e97766482
Jul 31 20:36:41.553684 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:41.553650    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8kwrp" event={"ID":"b0f94072-d0bc-43bb-bea8-a8fdb1aab366","Type":"ContainerStarted","Data":"d7c0f956aad5ea02057f27309be88d2425197f47e4ee84bdf7aed6055bdf80c3"}
Jul 31 20:36:41.555163 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:41.555113    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l2g8t" event={"ID":"0a4e2b6b-8fcb-420a-b9cb-fb95975900b3","Type":"ContainerStarted","Data":"be23245605bbb49cb5377a408fb1704f39d8e2a7e660aeca6fd4349e97766482"}
Jul 31 20:36:44.569442 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:44.569405    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8kwrp" event={"ID":"b0f94072-d0bc-43bb-bea8-a8fdb1aab366","Type":"ContainerStarted","Data":"265b5b36847e617cac045c824676b1d9f6a6a373f5cfc3ffb236b8b8f3bfa9d0"}
Jul 31 20:36:44.569830 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:44.569487    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8kwrp"
Jul 31 20:36:44.570948 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:44.570920    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l2g8t" event={"ID":"0a4e2b6b-8fcb-420a-b9cb-fb95975900b3","Type":"ContainerStarted","Data":"23f80397549bd7a8f66b39551eb7f293a343ab6c46d3518c00fc5c90ea189a1a"}
Jul 31 20:36:44.571089 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:44.571056    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l2g8t"
Jul 31 20:36:44.586096 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:44.586043    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8kwrp" podStartSLOduration=1.888065959 podStartE2EDuration="4.586022215s" totalImagesPullingTime="2.697956256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:36:44.585438498 +0000 UTC m=+409.190830974" watchObservedRunningTime="2026-07-31 20:36:44.586022215 +0000 UTC m=+409.191414692"
Jul 31 20:36:44.600860 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:44.600810    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l2g8t" podStartSLOduration=1.5778327170000002 podStartE2EDuration="4.600794627s" totalImagesPullingTime="3.02296191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:36:44.599842171 +0000 UTC m=+409.205234661" watchObservedRunningTime="2026-07-31 20:36:44.600794627 +0000 UTC m=+409.206187137"
Jul 31 20:36:44.797569 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:44.797534    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"]
Jul 31 20:36:44.797749 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:44.797729    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx" podUID="947b871d-eeae-49ec-82cb-677e41461210" containerName="discovery" containerID="cri-o://74349629aea90732be8025da9f00649a358b809875f26966b36550316acb801a" gracePeriod=30
Jul 31 20:36:45.035689 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.035665    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:45.140332 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.140250    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/947b871d-eeae-49ec-82cb-677e41461210-istio-token\") pod \"947b871d-eeae-49ec-82cb-677e41461210\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") "
Jul 31 20:36:45.140332 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.140290    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-cacerts\") pod \"947b871d-eeae-49ec-82cb-677e41461210\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") "
Jul 31 20:36:45.140332 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.140316    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/947b871d-eeae-49ec-82cb-677e41461210-local-certs\") pod \"947b871d-eeae-49ec-82cb-677e41461210\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") "
Jul 31 20:36:45.140573 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.140348    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-istio-csr-dns-cert\") pod \"947b871d-eeae-49ec-82cb-677e41461210\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") "
Jul 31 20:36:45.140573 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.140381    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/947b871d-eeae-49ec-82cb-677e41461210-istio-csr-ca-configmap\") pod \"947b871d-eeae-49ec-82cb-677e41461210\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") "
Jul 31 20:36:45.140573 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.140412    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j5k6\" (UniqueName: \"kubernetes.io/projected/947b871d-eeae-49ec-82cb-677e41461210-kube-api-access-5j5k6\") pod \"947b871d-eeae-49ec-82cb-677e41461210\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") "
Jul 31 20:36:45.140573 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.140486    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-istio-kubeconfig\") pod \"947b871d-eeae-49ec-82cb-677e41461210\" (UID: \"947b871d-eeae-49ec-82cb-677e41461210\") "
Jul 31 20:36:45.140904 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.140870    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/947b871d-eeae-49ec-82cb-677e41461210-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "947b871d-eeae-49ec-82cb-677e41461210" (UID: "947b871d-eeae-49ec-82cb-677e41461210"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:36:45.142924 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.142866    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/947b871d-eeae-49ec-82cb-677e41461210-local-certs" (OuterVolumeSpecName: "local-certs") pod "947b871d-eeae-49ec-82cb-677e41461210" (UID: "947b871d-eeae-49ec-82cb-677e41461210"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:36:45.142924 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.142892    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/947b871d-eeae-49ec-82cb-677e41461210-kube-api-access-5j5k6" (OuterVolumeSpecName: "kube-api-access-5j5k6") pod "947b871d-eeae-49ec-82cb-677e41461210" (UID: "947b871d-eeae-49ec-82cb-677e41461210"). InnerVolumeSpecName "kube-api-access-5j5k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:36:45.143174 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.143133    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/947b871d-eeae-49ec-82cb-677e41461210-istio-token" (OuterVolumeSpecName: "istio-token") pod "947b871d-eeae-49ec-82cb-677e41461210" (UID: "947b871d-eeae-49ec-82cb-677e41461210"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:36:45.143330 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.143308    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-cacerts" (OuterVolumeSpecName: "cacerts") pod "947b871d-eeae-49ec-82cb-677e41461210" (UID: "947b871d-eeae-49ec-82cb-677e41461210"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:36:45.143330 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.143319    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "947b871d-eeae-49ec-82cb-677e41461210" (UID: "947b871d-eeae-49ec-82cb-677e41461210"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:36:45.143447 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.143343    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "947b871d-eeae-49ec-82cb-677e41461210" (UID: "947b871d-eeae-49ec-82cb-677e41461210"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:36:45.241661 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.241623    2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-istio-csr-dns-cert\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:36:45.241661 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.241660    2566 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/947b871d-eeae-49ec-82cb-677e41461210-istio-csr-ca-configmap\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:36:45.241844 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.241675    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j5k6\" (UniqueName: \"kubernetes.io/projected/947b871d-eeae-49ec-82cb-677e41461210-kube-api-access-5j5k6\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:36:45.241844 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.241688    2566 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-istio-kubeconfig\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:36:45.241844 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.241702    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/947b871d-eeae-49ec-82cb-677e41461210-istio-token\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:36:45.241844 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.241714    2566 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/947b871d-eeae-49ec-82cb-677e41461210-cacerts\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:36:45.241844 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.241726    2566 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/947b871d-eeae-49ec-82cb-677e41461210-local-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:36:45.576744 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.576706    2566 generic.go:356] "Generic (PLEG): container finished" podID="947b871d-eeae-49ec-82cb-677e41461210" containerID="74349629aea90732be8025da9f00649a358b809875f26966b36550316acb801a" exitCode=0
Jul 31 20:36:45.577139 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.576757    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"
Jul 31 20:36:45.577139 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.576801    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx" event={"ID":"947b871d-eeae-49ec-82cb-677e41461210","Type":"ContainerDied","Data":"74349629aea90732be8025da9f00649a358b809875f26966b36550316acb801a"}
Jul 31 20:36:45.577139 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.576860    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx" event={"ID":"947b871d-eeae-49ec-82cb-677e41461210","Type":"ContainerDied","Data":"e22016e5e29b55ea56da961d2f21717e6f451f3e900d40656364c1175964b429"}
Jul 31 20:36:45.577139 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.576889    2566 scope.go:117] "RemoveContainer" containerID="74349629aea90732be8025da9f00649a358b809875f26966b36550316acb801a"
Jul 31 20:36:45.585288 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.585265    2566 scope.go:117] "RemoveContainer" containerID="74349629aea90732be8025da9f00649a358b809875f26966b36550316acb801a"
Jul 31 20:36:45.585550 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:36:45.585534    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74349629aea90732be8025da9f00649a358b809875f26966b36550316acb801a\": container with ID starting with 74349629aea90732be8025da9f00649a358b809875f26966b36550316acb801a not found: ID does not exist" containerID="74349629aea90732be8025da9f00649a358b809875f26966b36550316acb801a"
Jul 31 20:36:45.585620 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.585560    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74349629aea90732be8025da9f00649a358b809875f26966b36550316acb801a"} err="failed to get container status \"74349629aea90732be8025da9f00649a358b809875f26966b36550316acb801a\": rpc error: code = NotFound desc = could not find container \"74349629aea90732be8025da9f00649a358b809875f26966b36550316acb801a\": container with ID starting with 74349629aea90732be8025da9f00649a358b809875f26966b36550316acb801a not found: ID does not exist"
Jul 31 20:36:45.597314 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.597290    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"]
Jul 31 20:36:45.600763 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.600742    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-86xxx"]
Jul 31 20:36:45.936793 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:45.936703    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="947b871d-eeae-49ec-82cb-677e41461210" path="/var/lib/kubelet/pods/947b871d-eeae-49ec-82cb-677e41461210/volumes"
Jul 31 20:36:46.534630 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:46.534602    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-5wx6h"
Jul 31 20:36:46.536628 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:36:46.536607    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-96ls9"
Jul 31 20:37:15.579408 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:15.579374    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-l2g8t"
Jul 31 20:37:15.582541 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:15.582521    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8kwrp"
Jul 31 20:37:43.965173 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:43.965119    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"]
Jul 31 20:37:43.965654 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:43.965422    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947b871d-eeae-49ec-82cb-677e41461210" containerName="discovery"
Jul 31 20:37:43.965654 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:43.965433    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="947b871d-eeae-49ec-82cb-677e41461210" containerName="discovery"
Jul 31 20:37:43.965654 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:43.965482    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="947b871d-eeae-49ec-82cb-677e41461210" containerName="discovery"
Jul 31 20:37:43.968312 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:43.968291    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"
Jul 31 20:37:43.973082 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:43.973056    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 31 20:37:43.974059 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:43.974041    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rzgjg\""
Jul 31 20:37:43.974168 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:43.974072    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 31 20:37:43.980610 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:43.980585    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"]
Jul 31 20:37:44.119574 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:44.119544    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvpfg\" (UniqueName: \"kubernetes.io/projected/0ab15425-05ea-4a0b-aea5-553c8f4a7d65-kube-api-access-nvpfg\") pod \"limitador-operator-controller-manager-6c549b6d85-f4m8d\" (UID: \"0ab15425-05ea-4a0b-aea5-553c8f4a7d65\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"
Jul 31 20:37:44.220100 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:44.220031    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvpfg\" (UniqueName: \"kubernetes.io/projected/0ab15425-05ea-4a0b-aea5-553c8f4a7d65-kube-api-access-nvpfg\") pod \"limitador-operator-controller-manager-6c549b6d85-f4m8d\" (UID: \"0ab15425-05ea-4a0b-aea5-553c8f4a7d65\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"
Jul 31 20:37:44.229336 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:44.229314    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvpfg\" (UniqueName: \"kubernetes.io/projected/0ab15425-05ea-4a0b-aea5-553c8f4a7d65-kube-api-access-nvpfg\") pod \"limitador-operator-controller-manager-6c549b6d85-f4m8d\" (UID: \"0ab15425-05ea-4a0b-aea5-553c8f4a7d65\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"
Jul 31 20:37:44.278435 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:44.278393    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"
Jul 31 20:37:44.413427 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:44.413392    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"]
Jul 31 20:37:44.416485 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:37:44.416458    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab15425_05ea_4a0b_aea5_553c8f4a7d65.slice/crio-ff751fc47d4275e4ab56334ad7643bb2322b852683a117c1537de907cef0b6cb WatchSource:0}: Error finding container ff751fc47d4275e4ab56334ad7643bb2322b852683a117c1537de907cef0b6cb: Status 404 returned error can't find the container with id ff751fc47d4275e4ab56334ad7643bb2322b852683a117c1537de907cef0b6cb
Jul 31 20:37:44.812448 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:44.812416    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d" event={"ID":"0ab15425-05ea-4a0b-aea5-553c8f4a7d65","Type":"ContainerStarted","Data":"ff751fc47d4275e4ab56334ad7643bb2322b852683a117c1537de907cef0b6cb"}
Jul 31 20:37:45.974841 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:45.974805    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-6qssh"]
Jul 31 20:37:45.979077 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:45.979057    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-6qssh"
Jul 31 20:37:45.981825 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:45.981799    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9nh49\""
Jul 31 20:37:45.981947 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:45.981837    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 31 20:37:45.986623 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:45.986284    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-6qssh"]
Jul 31 20:37:46.032701 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:46.032662    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4tff\" (UniqueName: \"kubernetes.io/projected/be3e0f1f-0660-4a8c-a165-31ded80c882b-kube-api-access-r4tff\") pod \"dns-operator-controller-manager-5985564776-6qssh\" (UID: \"be3e0f1f-0660-4a8c-a165-31ded80c882b\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-6qssh"
Jul 31 20:37:46.133598 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:46.133562    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4tff\" (UniqueName: \"kubernetes.io/projected/be3e0f1f-0660-4a8c-a165-31ded80c882b-kube-api-access-r4tff\") pod \"dns-operator-controller-manager-5985564776-6qssh\" (UID: \"be3e0f1f-0660-4a8c-a165-31ded80c882b\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-6qssh"
Jul 31 20:37:46.151907 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:46.151868    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4tff\" (UniqueName: \"kubernetes.io/projected/be3e0f1f-0660-4a8c-a165-31ded80c882b-kube-api-access-r4tff\") pod \"dns-operator-controller-manager-5985564776-6qssh\" (UID: \"be3e0f1f-0660-4a8c-a165-31ded80c882b\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-6qssh"
Jul 31 20:37:46.289635 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:46.289611    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-6qssh"
Jul 31 20:37:46.428974 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:46.428943    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-6qssh"]
Jul 31 20:37:46.431900 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:37:46.431868    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe3e0f1f_0660_4a8c_a165_31ded80c882b.slice/crio-fb2aea4f1c516774b331f9203082a8b24bc26a87bc681dea0e40a6b08813b3df WatchSource:0}: Error finding container fb2aea4f1c516774b331f9203082a8b24bc26a87bc681dea0e40a6b08813b3df: Status 404 returned error can't find the container with id fb2aea4f1c516774b331f9203082a8b24bc26a87bc681dea0e40a6b08813b3df
Jul 31 20:37:46.823119 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:46.823068    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-6qssh" event={"ID":"be3e0f1f-0660-4a8c-a165-31ded80c882b","Type":"ContainerStarted","Data":"fb2aea4f1c516774b331f9203082a8b24bc26a87bc681dea0e40a6b08813b3df"}
Jul 31 20:37:48.834444 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:48.834406    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d" event={"ID":"0ab15425-05ea-4a0b-aea5-553c8f4a7d65","Type":"ContainerStarted","Data":"b040412c231d1756e475a030d3e86e6f88fa87718000b215864963775398737f"}
Jul 31 20:37:48.834888 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:48.834522    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"
Jul 31 20:37:48.855411 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:48.855350    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d" podStartSLOduration=1.824055765 podStartE2EDuration="5.855333109s" totalImagesPullingTime="4.031277344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:37:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:37:48.855273667 +0000 UTC m=+473.460666143" watchObservedRunningTime="2026-07-31 20:37:48.855333109 +0000 UTC m=+473.460725586"
Jul 31 20:37:49.840288 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:49.840250    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-6qssh" event={"ID":"be3e0f1f-0660-4a8c-a165-31ded80c882b","Type":"ContainerStarted","Data":"b5db0f969425db98943184b134640f87298609f183e54a7807bc872c930fbb6d"}
Jul 31 20:37:49.840729 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:49.840520    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-6qssh"
Jul 31 20:37:49.855902 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:49.855855    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-6qssh" podStartSLOduration=1.627837778 podStartE2EDuration="4.855837345s" totalImagesPullingTime="3.227999567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:37:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:37:49.855572988 +0000 UTC m=+474.460965460" watchObservedRunningTime="2026-07-31 20:37:49.855837345 +0000 UTC m=+474.461229820"
Jul 31 20:37:50.716926 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:50.716884    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"]
Jul 31 20:37:50.720240 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:50.720217    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:37:50.722867 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:50.722847    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x6hqm\""
Jul 31 20:37:50.735012 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:50.734989    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"]
Jul 31 20:37:50.765809 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:50.765772    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-n7kzr\" (UID: \"67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:37:50.765982 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:50.765831    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv65w\" (UniqueName: \"kubernetes.io/projected/67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2-kube-api-access-lv65w\") pod \"kuadrant-operator-controller-manager-58fc56757c-n7kzr\" (UID: \"67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:37:50.866632 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:50.866597    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-n7kzr\" (UID: \"67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:37:50.867167 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:50.866668    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv65w\" (UniqueName: \"kubernetes.io/projected/67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2-kube-api-access-lv65w\") pod \"kuadrant-operator-controller-manager-58fc56757c-n7kzr\" (UID: \"67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:37:50.867167 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:50.867003    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-n7kzr\" (UID: \"67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:37:50.882108 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:50.882076    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv65w\" (UniqueName: \"kubernetes.io/projected/67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2-kube-api-access-lv65w\") pod \"kuadrant-operator-controller-manager-58fc56757c-n7kzr\" (UID: \"67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:37:51.030635 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:51.030541    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:37:51.186106 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:51.186081    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"]
Jul 31 20:37:51.188813 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:37:51.188780    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67aa7a6e_fb5d_4bf6_9dc4_28e5afb3dec2.slice/crio-405994180ca7aa8b27a1d54ccceba0b888c98f447db58e67b8554d6da079063b WatchSource:0}: Error finding container 405994180ca7aa8b27a1d54ccceba0b888c98f447db58e67b8554d6da079063b: Status 404 returned error can't find the container with id 405994180ca7aa8b27a1d54ccceba0b888c98f447db58e67b8554d6da079063b
Jul 31 20:37:51.849744 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:51.849708    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr" event={"ID":"67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2","Type":"ContainerStarted","Data":"405994180ca7aa8b27a1d54ccceba0b888c98f447db58e67b8554d6da079063b"}
Jul 31 20:37:53.045836 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:53.045805    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-vw6pd"]
Jul 31 20:37:53.049427 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:53.049405    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-vw6pd"
Jul 31 20:37:53.052188 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:53.052166    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-g6lgw\""
Jul 31 20:37:53.058180 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:53.058123    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-vw6pd"]
Jul 31 20:37:53.086092 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:53.086057    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj9k2\" (UniqueName: \"kubernetes.io/projected/3edddb17-4da3-4c23-9d2e-19d3287b1b91-kube-api-access-nj9k2\") pod \"authorino-operator-68d88948d8-vw6pd\" (UID: \"3edddb17-4da3-4c23-9d2e-19d3287b1b91\") " pod="kuadrant-system/authorino-operator-68d88948d8-vw6pd"
Jul 31 20:37:53.186786 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:53.186737    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj9k2\" (UniqueName: \"kubernetes.io/projected/3edddb17-4da3-4c23-9d2e-19d3287b1b91-kube-api-access-nj9k2\") pod \"authorino-operator-68d88948d8-vw6pd\" (UID: \"3edddb17-4da3-4c23-9d2e-19d3287b1b91\") " pod="kuadrant-system/authorino-operator-68d88948d8-vw6pd"
Jul 31 20:37:53.202636 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:53.202594    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj9k2\" (UniqueName: \"kubernetes.io/projected/3edddb17-4da3-4c23-9d2e-19d3287b1b91-kube-api-access-nj9k2\") pod \"authorino-operator-68d88948d8-vw6pd\" (UID: \"3edddb17-4da3-4c23-9d2e-19d3287b1b91\") " pod="kuadrant-system/authorino-operator-68d88948d8-vw6pd"
Jul 31 20:37:53.361607 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:53.361521    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-vw6pd"
Jul 31 20:37:53.519575 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:53.519542    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-vw6pd"]
Jul 31 20:37:53.522283 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:37:53.522251    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3edddb17_4da3_4c23_9d2e_19d3287b1b91.slice/crio-3442ad41e5877eaa79a32a10316cea835b784ce2d4e4b0f36e4854e5f0975a01 WatchSource:0}: Error finding container 3442ad41e5877eaa79a32a10316cea835b784ce2d4e4b0f36e4854e5f0975a01: Status 404 returned error can't find the container with id 3442ad41e5877eaa79a32a10316cea835b784ce2d4e4b0f36e4854e5f0975a01
Jul 31 20:37:53.860216 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:53.860180    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-vw6pd" event={"ID":"3edddb17-4da3-4c23-9d2e-19d3287b1b91","Type":"ContainerStarted","Data":"3442ad41e5877eaa79a32a10316cea835b784ce2d4e4b0f36e4854e5f0975a01"}
Jul 31 20:37:55.872789 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:55.872729    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr" event={"ID":"67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2","Type":"ContainerStarted","Data":"5b83e3daad4bf5aba275f0d1c5a7ca8d9e032af3b837e2d69686ee50696d8add"}
Jul 31 20:37:55.873240 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:55.872939    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:37:55.894365 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:55.894302    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr" podStartSLOduration=1.7166617419999999 podStartE2EDuration="5.894279386s" totalImagesPullingTime="4.177617644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:37:55.891798888 +0000 UTC m=+480.497191366" watchObservedRunningTime="2026-07-31 20:37:55.894279386 +0000 UTC m=+480.499671865"
Jul 31 20:37:56.878000 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:56.877965    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-vw6pd" event={"ID":"3edddb17-4da3-4c23-9d2e-19d3287b1b91","Type":"ContainerStarted","Data":"10a33b1f03a71e712c7fcf9e8ee903e6690e736d1c86b4cb71762cc1c02d514e"}
Jul 31 20:37:56.878457 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:56.878041    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-vw6pd"
Jul 31 20:37:56.895318 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:56.895269    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-vw6pd" podStartSLOduration=1.351384035 podStartE2EDuration="3.895253288s" totalImagesPullingTime="2.543869253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:37:56.894707304 +0000 UTC m=+481.500099781" watchObservedRunningTime="2026-07-31 20:37:56.895253288 +0000 UTC m=+481.500645764"
Jul 31 20:37:59.842620 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:37:59.842587    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"
Jul 31 20:38:00.846314 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:00.846281    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-6qssh"
Jul 31 20:38:06.880859 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:06.880823    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:38:07.885306 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:07.885270    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-vw6pd"
Jul 31 20:38:08.011662 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.011624    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"]
Jul 31 20:38:08.015410 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.015390    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"
Jul 31 20:38:08.026965 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.026936    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"]
Jul 31 20:38:08.110981 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.110944    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8klh\" (UniqueName: \"kubernetes.io/projected/30182b77-9545-4ffb-a140-7e9098c4b24f-kube-api-access-q8klh\") pod \"kuadrant-operator-controller-manager-96db98c47-kdgr2\" (UID: \"30182b77-9545-4ffb-a140-7e9098c4b24f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"
Jul 31 20:38:08.110981 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.110982    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30182b77-9545-4ffb-a140-7e9098c4b24f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-kdgr2\" (UID: \"30182b77-9545-4ffb-a140-7e9098c4b24f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"
Jul 31 20:38:08.211569 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.211477    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8klh\" (UniqueName: \"kubernetes.io/projected/30182b77-9545-4ffb-a140-7e9098c4b24f-kube-api-access-q8klh\") pod \"kuadrant-operator-controller-manager-96db98c47-kdgr2\" (UID: \"30182b77-9545-4ffb-a140-7e9098c4b24f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"
Jul 31 20:38:08.211569 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.211529    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30182b77-9545-4ffb-a140-7e9098c4b24f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-kdgr2\" (UID: \"30182b77-9545-4ffb-a140-7e9098c4b24f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"
Jul 31 20:38:08.211896 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.211881    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30182b77-9545-4ffb-a140-7e9098c4b24f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-kdgr2\" (UID: \"30182b77-9545-4ffb-a140-7e9098c4b24f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"
Jul 31 20:38:08.238475 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.238451    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8klh\" (UniqueName: \"kubernetes.io/projected/30182b77-9545-4ffb-a140-7e9098c4b24f-kube-api-access-q8klh\") pod \"kuadrant-operator-controller-manager-96db98c47-kdgr2\" (UID: \"30182b77-9545-4ffb-a140-7e9098c4b24f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"
Jul 31 20:38:08.325295 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.325262    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"
Jul 31 20:38:08.468086 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.467994    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"]
Jul 31 20:38:08.471265 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:38:08.471236    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30182b77_9545_4ffb_a140_7e9098c4b24f.slice/crio-9a83f9090f59e1030d77f9d25dbd1880d36a9e41e1bdcca3d51fa04fe82c9b7f WatchSource:0}: Error finding container 9a83f9090f59e1030d77f9d25dbd1880d36a9e41e1bdcca3d51fa04fe82c9b7f: Status 404 returned error can't find the container with id 9a83f9090f59e1030d77f9d25dbd1880d36a9e41e1bdcca3d51fa04fe82c9b7f
Jul 31 20:38:08.695403 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.695364    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"]
Jul 31 20:38:08.695589 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.695565    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr" podUID="67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2" containerName="manager" containerID="cri-o://5b83e3daad4bf5aba275f0d1c5a7ca8d9e032af3b837e2d69686ee50696d8add" gracePeriod=2
Jul 31 20:38:08.700563 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.700538    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"]
Jul 31 20:38:08.719416 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.719349    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"]
Jul 31 20:38:08.724035 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.723958    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"]
Jul 31 20:38:08.724534 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.724511    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2" containerName="manager"
Jul 31 20:38:08.724647 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.724537    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2" containerName="manager"
Jul 31 20:38:08.724647 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.724640    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2" containerName="manager"
Jul 31 20:38:08.728586 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.728561    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"
Jul 31 20:38:08.732269 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.732245    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"]
Jul 31 20:38:08.743674 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.743634    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"]
Jul 31 20:38:08.753923 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.753893    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"]
Jul 31 20:38:08.754377 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.754356    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30182b77-9545-4ffb-a140-7e9098c4b24f" containerName="manager"
Jul 31 20:38:08.754548 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.754534    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="30182b77-9545-4ffb-a140-7e9098c4b24f" containerName="manager"
Jul 31 20:38:08.754756 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.754736    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="30182b77-9545-4ffb-a140-7e9098c4b24f" containerName="manager"
Jul 31 20:38:08.757811 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.757788    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"]
Jul 31 20:38:08.757921 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.757844    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"]
Jul 31 20:38:08.757963 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.757935    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"
Jul 31 20:38:08.758074 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.758029    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d" podUID="0ab15425-05ea-4a0b-aea5-553c8f4a7d65" containerName="manager" containerID="cri-o://b040412c231d1756e475a030d3e86e6f88fa87718000b215864963775398737f" gracePeriod=2
Jul 31 20:38:08.772696 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:08.772657    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-n7kzr\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:38:08.779252 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.779227    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"]
Jul 31 20:38:08.782782 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.782760    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xjhvm"]
Jul 31 20:38:08.783090 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.783074    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ab15425-05ea-4a0b-aea5-553c8f4a7d65" containerName="manager"
Jul 31 20:38:08.783090 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.783091    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ab15425-05ea-4a0b-aea5-553c8f4a7d65" containerName="manager"
Jul 31 20:38:08.783248 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.783176    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ab15425-05ea-4a0b-aea5-553c8f4a7d65" containerName="manager"
Jul 31 20:38:08.786007 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.785993    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xjhvm"
Jul 31 20:38:08.801615 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.801584    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xjhvm"]
Jul 31 20:38:08.811709 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:08.811676    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-f4m8d\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="0ab15425-05ea-4a0b-aea5-553c8f4a7d65" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"
Jul 31 20:38:08.813623 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:08.813597    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-n7kzr\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:38:08.817902 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.817881    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef975dad-d7fd-41e6-bad3-c818cb6236c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-24q58\" (UID: \"ef975dad-d7fd-41e6-bad3-c818cb6236c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"
Jul 31 20:38:08.818047 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.817918    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f9hx\" (UniqueName: \"kubernetes.io/projected/ef975dad-d7fd-41e6-bad3-c818cb6236c8-kube-api-access-8f9hx\") pod \"kuadrant-operator-controller-manager-58fc56757c-24q58\" (UID: \"ef975dad-d7fd-41e6-bad3-c818cb6236c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"
Jul 31 20:38:08.818047 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.817961    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfhwc\" (UniqueName: \"kubernetes.io/projected/45254334-9927-45f7-be4c-86c4d7ebbf05-kube-api-access-vfhwc\") pod \"kuadrant-operator-controller-manager-96db98c47-6cltd\" (UID: \"45254334-9927-45f7-be4c-86c4d7ebbf05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"
Jul 31 20:38:08.818294 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.818060    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45254334-9927-45f7-be4c-86c4d7ebbf05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-6cltd\" (UID: \"45254334-9927-45f7-be4c-86c4d7ebbf05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"
Jul 31 20:38:08.841620 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:08.841589    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-f4m8d\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="0ab15425-05ea-4a0b-aea5-553c8f4a7d65" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"
Jul 31 20:38:08.843494 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:08.843466    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-n7kzr\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:38:08.919100 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.919071    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef975dad-d7fd-41e6-bad3-c818cb6236c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-24q58\" (UID: \"ef975dad-d7fd-41e6-bad3-c818cb6236c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"
Jul 31 20:38:08.919548 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.919108    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f9hx\" (UniqueName: \"kubernetes.io/projected/ef975dad-d7fd-41e6-bad3-c818cb6236c8-kube-api-access-8f9hx\") pod \"kuadrant-operator-controller-manager-58fc56757c-24q58\" (UID: \"ef975dad-d7fd-41e6-bad3-c818cb6236c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"
Jul 31 20:38:08.919548 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.919139    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfhwc\" (UniqueName: \"kubernetes.io/projected/45254334-9927-45f7-be4c-86c4d7ebbf05-kube-api-access-vfhwc\") pod \"kuadrant-operator-controller-manager-96db98c47-6cltd\" (UID: \"45254334-9927-45f7-be4c-86c4d7ebbf05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"
Jul 31 20:38:08.919548 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.919197    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwbcm\" (UniqueName: \"kubernetes.io/projected/3b417bd1-2a9d-4460-adb7-8b36cf774510-kube-api-access-vwbcm\") pod \"limitador-operator-controller-manager-6c549b6d85-xjhvm\" (UID: \"3b417bd1-2a9d-4460-adb7-8b36cf774510\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xjhvm"
Jul 31 20:38:08.919548 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.919229    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45254334-9927-45f7-be4c-86c4d7ebbf05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-6cltd\" (UID: \"45254334-9927-45f7-be4c-86c4d7ebbf05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"
Jul 31 20:38:08.919725 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.919613    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef975dad-d7fd-41e6-bad3-c818cb6236c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-24q58\" (UID: \"ef975dad-d7fd-41e6-bad3-c818cb6236c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"
Jul 31 20:38:08.919725 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.919623    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45254334-9927-45f7-be4c-86c4d7ebbf05-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-96db98c47-6cltd\" (UID: \"45254334-9927-45f7-be4c-86c4d7ebbf05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"
Jul 31 20:38:08.934071 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.934037    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfhwc\" (UniqueName: \"kubernetes.io/projected/45254334-9927-45f7-be4c-86c4d7ebbf05-kube-api-access-vfhwc\") pod \"kuadrant-operator-controller-manager-96db98c47-6cltd\" (UID: \"45254334-9927-45f7-be4c-86c4d7ebbf05\") " pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"
Jul 31 20:38:08.934999 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.934974    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f9hx\" (UniqueName: \"kubernetes.io/projected/ef975dad-d7fd-41e6-bad3-c818cb6236c8-kube-api-access-8f9hx\") pod \"kuadrant-operator-controller-manager-58fc56757c-24q58\" (UID: \"ef975dad-d7fd-41e6-bad3-c818cb6236c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"
Jul 31 20:38:08.944391 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.944363    2566 generic.go:356] "Generic (PLEG): container finished" podID="67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2" containerID="5b83e3daad4bf5aba275f0d1c5a7ca8d9e032af3b837e2d69686ee50696d8add" exitCode=0
Jul 31 20:38:08.948207 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:08.948185    2566 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2" container="manager"
Jul 31 20:38:08.949949 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:08.949912    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-kdgr2\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="30182b77-9545-4ffb-a140-7e9098c4b24f" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"
Jul 31 20:38:08.950363 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.950344    2566 generic.go:356] "Generic (PLEG): container finished" podID="0ab15425-05ea-4a0b-aea5-553c8f4a7d65" containerID="b040412c231d1756e475a030d3e86e6f88fa87718000b215864963775398737f" exitCode=0
Jul 31 20:38:08.951721 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:08.951681    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-f4m8d\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="0ab15425-05ea-4a0b-aea5-553c8f4a7d65" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"
Jul 31 20:38:08.953521 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:08.953486    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-n7kzr\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:38:08.991879 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:08.991853    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:38:08.994282 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:08.994249    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-kdgr2\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="30182b77-9545-4ffb-a140-7e9098c4b24f" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"
Jul 31 20:38:08.996217 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:08.996186    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-f4m8d\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="0ab15425-05ea-4a0b-aea5-553c8f4a7d65" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"
Jul 31 20:38:08.998110 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:08.998086    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-n7kzr\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:38:09.001691 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.001672    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"
Jul 31 20:38:09.003698 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:09.003676    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-kdgr2\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="30182b77-9545-4ffb-a140-7e9098c4b24f" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"
Jul 31 20:38:09.005535 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:09.005513    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-f4m8d\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="0ab15425-05ea-4a0b-aea5-553c8f4a7d65" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"
Jul 31 20:38:09.007261 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:09.007237    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-n7kzr\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:38:09.020649 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.020623    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwbcm\" (UniqueName: \"kubernetes.io/projected/3b417bd1-2a9d-4460-adb7-8b36cf774510-kube-api-access-vwbcm\") pod \"limitador-operator-controller-manager-6c549b6d85-xjhvm\" (UID: \"3b417bd1-2a9d-4460-adb7-8b36cf774510\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xjhvm"
Jul 31 20:38:09.030760 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.030736    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwbcm\" (UniqueName: \"kubernetes.io/projected/3b417bd1-2a9d-4460-adb7-8b36cf774510-kube-api-access-vwbcm\") pod \"limitador-operator-controller-manager-6c549b6d85-xjhvm\" (UID: \"3b417bd1-2a9d-4460-adb7-8b36cf774510\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xjhvm"
Jul 31 20:38:09.121071 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.121037    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvpfg\" (UniqueName: \"kubernetes.io/projected/0ab15425-05ea-4a0b-aea5-553c8f4a7d65-kube-api-access-nvpfg\") pod \"0ab15425-05ea-4a0b-aea5-553c8f4a7d65\" (UID: \"0ab15425-05ea-4a0b-aea5-553c8f4a7d65\") "
Jul 31 20:38:09.121265 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.121085    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2-extensions-socket-volume\") pod \"67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2\" (UID: \"67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2\") "
Jul 31 20:38:09.121265 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.121139    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lv65w\" (UniqueName: \"kubernetes.io/projected/67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2-kube-api-access-lv65w\") pod \"67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2\" (UID: \"67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2\") "
Jul 31 20:38:09.121451 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.121421    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2" (UID: "67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:38:09.123422 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.123399    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2-kube-api-access-lv65w" (OuterVolumeSpecName: "kube-api-access-lv65w") pod "67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2" (UID: "67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2"). InnerVolumeSpecName "kube-api-access-lv65w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:38:09.123503 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.123439    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ab15425-05ea-4a0b-aea5-553c8f4a7d65-kube-api-access-nvpfg" (OuterVolumeSpecName: "kube-api-access-nvpfg") pod "0ab15425-05ea-4a0b-aea5-553c8f4a7d65" (UID: "0ab15425-05ea-4a0b-aea5-553c8f4a7d65"). InnerVolumeSpecName "kube-api-access-nvpfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:38:09.125605 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.125588    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"
Jul 31 20:38:09.135561 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.135537    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"
Jul 31 20:38:09.143736 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.143709    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xjhvm"
Jul 31 20:38:09.222330 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.222260    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv65w\" (UniqueName: \"kubernetes.io/projected/67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2-kube-api-access-lv65w\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:38:09.222330 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.222296    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvpfg\" (UniqueName: \"kubernetes.io/projected/0ab15425-05ea-4a0b-aea5-553c8f4a7d65-kube-api-access-nvpfg\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:38:09.222330 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.222311    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2-extensions-socket-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:38:09.301265 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.301233    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"]
Jul 31 20:38:09.305485 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:38:09.305454    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef975dad_d7fd_41e6_bad3_c818cb6236c8.slice/crio-7b334153bd597d60f1f5d183a2a6b6daf953a68089e3a04866e932ccaa04d8e7 WatchSource:0}: Error finding container 7b334153bd597d60f1f5d183a2a6b6daf953a68089e3a04866e932ccaa04d8e7: Status 404 returned error can't find the container with id 7b334153bd597d60f1f5d183a2a6b6daf953a68089e3a04866e932ccaa04d8e7
Jul 31 20:38:09.524580 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.524407    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xjhvm"]
Jul 31 20:38:09.525871 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.525851    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"]
Jul 31 20:38:09.527292 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:38:09.527258    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b417bd1_2a9d_4460_adb7_8b36cf774510.slice/crio-efb0eaa3af9a394f9d9d0f1e6c80ec7772bb728451a1705dbf4f38f12fff85ca WatchSource:0}: Error finding container efb0eaa3af9a394f9d9d0f1e6c80ec7772bb728451a1705dbf4f38f12fff85ca: Status 404 returned error can't find the container with id efb0eaa3af9a394f9d9d0f1e6c80ec7772bb728451a1705dbf4f38f12fff85ca
Jul 31 20:38:09.528189 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:38:09.528062    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45254334_9927_45f7_be4c_86c4d7ebbf05.slice/crio-a074cd4cd0b213beef543bb3920bdca24e7e9afd14d5b17d24b7a4914a9b3942 WatchSource:0}: Error finding container a074cd4cd0b213beef543bb3920bdca24e7e9afd14d5b17d24b7a4914a9b3942: Status 404 returned error can't find the container with id a074cd4cd0b213beef543bb3920bdca24e7e9afd14d5b17d24b7a4914a9b3942
Jul 31 20:38:09.936655 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.936625    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ab15425-05ea-4a0b-aea5-553c8f4a7d65" path="/var/lib/kubelet/pods/0ab15425-05ea-4a0b-aea5-553c8f4a7d65/volumes"
Jul 31 20:38:09.937034 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.936973    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2" path="/var/lib/kubelet/pods/67aa7a6e-fb5d-4bf6-9dc4-28e5afb3dec2/volumes"
Jul 31 20:38:09.956593 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.956564    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2" podUID="30182b77-9545-4ffb-a140-7e9098c4b24f" containerName="manager" containerID="cri-o://4ac98abe59867d42073d1e4e042227e8decb8d771a1d862bf642fdd0924d2612" gracePeriod=2
Jul 31 20:38:09.957862 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.957836    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-f4m8d"
Jul 31 20:38:09.957975 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.957845    2566 scope.go:117] "RemoveContainer" containerID="b040412c231d1756e475a030d3e86e6f88fa87718000b215864963775398737f"
Jul 31 20:38:09.959736 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.959710    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xjhvm" event={"ID":"3b417bd1-2a9d-4460-adb7-8b36cf774510","Type":"ContainerStarted","Data":"a941439ed80caceeba9eaf8d9ab117a8755c304025dbf3b141c568c5e9467685"}
Jul 31 20:38:09.959847 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.959770    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xjhvm" event={"ID":"3b417bd1-2a9d-4460-adb7-8b36cf774510","Type":"ContainerStarted","Data":"efb0eaa3af9a394f9d9d0f1e6c80ec7772bb728451a1705dbf4f38f12fff85ca"}
Jul 31 20:38:09.959947 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.959929    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xjhvm"
Jul 31 20:38:09.962638 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.962611    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd" event={"ID":"45254334-9927-45f7-be4c-86c4d7ebbf05","Type":"ContainerStarted","Data":"ff408638c75c9e33020070637165e48c07665844fc9b99f99102724e07c81d69"}
Jul 31 20:38:09.962761 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.962664    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd" event={"ID":"45254334-9927-45f7-be4c-86c4d7ebbf05","Type":"ContainerStarted","Data":"a074cd4cd0b213beef543bb3920bdca24e7e9afd14d5b17d24b7a4914a9b3942"}
Jul 31 20:38:09.962873 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.962856    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"
Jul 31 20:38:09.964785 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.964749    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58" event={"ID":"ef975dad-d7fd-41e6-bad3-c818cb6236c8","Type":"ContainerStarted","Data":"f4ff5bf1213001d6a89c19acb0c5584c0f70a07c144ff59c42c558c8ca3364b9"}
Jul 31 20:38:09.964892 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.964797    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"
Jul 31 20:38:09.964892 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.964819    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58" event={"ID":"ef975dad-d7fd-41e6-bad3-c818cb6236c8","Type":"ContainerStarted","Data":"7b334153bd597d60f1f5d183a2a6b6daf953a68089e3a04866e932ccaa04d8e7"}
Jul 31 20:38:09.966291 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.966275    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-n7kzr"
Jul 31 20:38:09.967712 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.967689    2566 scope.go:117] "RemoveContainer" containerID="5b83e3daad4bf5aba275f0d1c5a7ca8d9e032af3b837e2d69686ee50696d8add"
Jul 31 20:38:09.983516 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:09.983468    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xjhvm" podStartSLOduration=1.983450288 podStartE2EDuration="1.983450288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:38:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:38:09.982390814 +0000 UTC m=+494.587783483" watchObservedRunningTime="2026-07-31 20:38:09.983450288 +0000 UTC m=+494.588842764"
Jul 31 20:38:10.002091 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:10.001930    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd" podStartSLOduration=2.001909563 podStartE2EDuration="2.001909563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:38:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:38:10.001582374 +0000 UTC m=+494.606974849" watchObservedRunningTime="2026-07-31 20:38:10.001909563 +0000 UTC m=+494.607302040"
Jul 31 20:38:10.025784 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:10.025737    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58" podStartSLOduration=2.025721431 podStartE2EDuration="2.025721431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:38:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:38:10.025102812 +0000 UTC m=+494.630495289" watchObservedRunningTime="2026-07-31 20:38:10.025721431 +0000 UTC m=+494.631113908"
Jul 31 20:38:10.190008 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:10.189952    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"
Jul 31 20:38:10.192054 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:10.192029    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-kdgr2\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="30182b77-9545-4ffb-a140-7e9098c4b24f" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"
Jul 31 20:38:10.231788 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:10.231737    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8klh\" (UniqueName: \"kubernetes.io/projected/30182b77-9545-4ffb-a140-7e9098c4b24f-kube-api-access-q8klh\") pod \"30182b77-9545-4ffb-a140-7e9098c4b24f\" (UID: \"30182b77-9545-4ffb-a140-7e9098c4b24f\") "
Jul 31 20:38:10.231948 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:10.231812    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30182b77-9545-4ffb-a140-7e9098c4b24f-extensions-socket-volume\") pod \"30182b77-9545-4ffb-a140-7e9098c4b24f\" (UID: \"30182b77-9545-4ffb-a140-7e9098c4b24f\") "
Jul 31 20:38:10.232287 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:10.232253    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30182b77-9545-4ffb-a140-7e9098c4b24f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "30182b77-9545-4ffb-a140-7e9098c4b24f" (UID: "30182b77-9545-4ffb-a140-7e9098c4b24f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:38:10.234292 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:10.234260    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30182b77-9545-4ffb-a140-7e9098c4b24f-kube-api-access-q8klh" (OuterVolumeSpecName: "kube-api-access-q8klh") pod "30182b77-9545-4ffb-a140-7e9098c4b24f" (UID: "30182b77-9545-4ffb-a140-7e9098c4b24f"). InnerVolumeSpecName "kube-api-access-q8klh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:38:10.332910 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:10.332867    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8klh\" (UniqueName: \"kubernetes.io/projected/30182b77-9545-4ffb-a140-7e9098c4b24f-kube-api-access-q8klh\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:38:10.332910 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:10.332910    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30182b77-9545-4ffb-a140-7e9098c4b24f-extensions-socket-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:38:10.974129 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:10.974089    2566 generic.go:356] "Generic (PLEG): container finished" podID="30182b77-9545-4ffb-a140-7e9098c4b24f" containerID="4ac98abe59867d42073d1e4e042227e8decb8d771a1d862bf642fdd0924d2612" exitCode=0
Jul 31 20:38:10.974625 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:10.974141    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"
Jul 31 20:38:10.974625 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:10.974208    2566 scope.go:117] "RemoveContainer" containerID="4ac98abe59867d42073d1e4e042227e8decb8d771a1d862bf642fdd0924d2612"
Jul 31 20:38:10.976406 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:10.976372    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-kdgr2\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="30182b77-9545-4ffb-a140-7e9098c4b24f" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"
Jul 31 20:38:10.983280 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:10.983259    2566 scope.go:117] "RemoveContainer" containerID="4ac98abe59867d42073d1e4e042227e8decb8d771a1d862bf642fdd0924d2612"
Jul 31 20:38:10.983548 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:10.983530    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ac98abe59867d42073d1e4e042227e8decb8d771a1d862bf642fdd0924d2612\": container with ID starting with 4ac98abe59867d42073d1e4e042227e8decb8d771a1d862bf642fdd0924d2612 not found: ID does not exist" containerID="4ac98abe59867d42073d1e4e042227e8decb8d771a1d862bf642fdd0924d2612"
Jul 31 20:38:10.983593 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:10.983558    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ac98abe59867d42073d1e4e042227e8decb8d771a1d862bf642fdd0924d2612"} err="failed to get container status \"4ac98abe59867d42073d1e4e042227e8decb8d771a1d862bf642fdd0924d2612\": rpc error: code = NotFound desc = could not find container \"4ac98abe59867d42073d1e4e042227e8decb8d771a1d862bf642fdd0924d2612\": container with ID starting with 4ac98abe59867d42073d1e4e042227e8decb8d771a1d862bf642fdd0924d2612 not found: ID does not exist"
Jul 31 20:38:10.984887 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:10.984868    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-96db98c47-kdgr2\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="30182b77-9545-4ffb-a140-7e9098c4b24f" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-kdgr2"
Jul 31 20:38:11.940080 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:11.940046    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30182b77-9545-4ffb-a140-7e9098c4b24f" path="/var/lib/kubelet/pods/30182b77-9545-4ffb-a140-7e9098c4b24f/volumes"
Jul 31 20:38:20.976360 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:20.976328    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"
Jul 31 20:38:20.976902 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:20.976598    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"
Jul 31 20:38:20.976902 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:20.976675    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-xjhvm"
Jul 31 20:38:21.029365 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.029333    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"]
Jul 31 20:38:21.029560 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.029518    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58" podUID="ef975dad-d7fd-41e6-bad3-c818cb6236c8" containerName="manager" containerID="cri-o://f4ff5bf1213001d6a89c19acb0c5584c0f70a07c144ff59c42c558c8ca3364b9" gracePeriod=10
Jul 31 20:38:21.243977 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.243884    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"]
Jul 31 20:38:21.246093 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.246071    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"
Jul 31 20:38:21.267078 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.267051    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"]
Jul 31 20:38:21.289069 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.289045    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"
Jul 31 20:38:21.322161 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.322113    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26tnj\" (UniqueName: \"kubernetes.io/projected/8760024d-c568-49b0-b27e-9222bef63444-kube-api-access-26tnj\") pod \"kuadrant-operator-controller-manager-68cf589589-tl9lx\" (UID: \"8760024d-c568-49b0-b27e-9222bef63444\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"
Jul 31 20:38:21.322317 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.322165    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8760024d-c568-49b0-b27e-9222bef63444-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-tl9lx\" (UID: \"8760024d-c568-49b0-b27e-9222bef63444\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"
Jul 31 20:38:21.423256 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.423228    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f9hx\" (UniqueName: \"kubernetes.io/projected/ef975dad-d7fd-41e6-bad3-c818cb6236c8-kube-api-access-8f9hx\") pod \"ef975dad-d7fd-41e6-bad3-c818cb6236c8\" (UID: \"ef975dad-d7fd-41e6-bad3-c818cb6236c8\") "
Jul 31 20:38:21.423450 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.423274    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef975dad-d7fd-41e6-bad3-c818cb6236c8-extensions-socket-volume\") pod \"ef975dad-d7fd-41e6-bad3-c818cb6236c8\" (UID: \"ef975dad-d7fd-41e6-bad3-c818cb6236c8\") "
Jul 31 20:38:21.423450 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.423390    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26tnj\" (UniqueName: \"kubernetes.io/projected/8760024d-c568-49b0-b27e-9222bef63444-kube-api-access-26tnj\") pod \"kuadrant-operator-controller-manager-68cf589589-tl9lx\" (UID: \"8760024d-c568-49b0-b27e-9222bef63444\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"
Jul 31 20:38:21.423450 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.423428    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8760024d-c568-49b0-b27e-9222bef63444-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-tl9lx\" (UID: \"8760024d-c568-49b0-b27e-9222bef63444\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"
Jul 31 20:38:21.423751 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.423729    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef975dad-d7fd-41e6-bad3-c818cb6236c8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ef975dad-d7fd-41e6-bad3-c818cb6236c8" (UID: "ef975dad-d7fd-41e6-bad3-c818cb6236c8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:38:21.423880 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.423859    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8760024d-c568-49b0-b27e-9222bef63444-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-tl9lx\" (UID: \"8760024d-c568-49b0-b27e-9222bef63444\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"
Jul 31 20:38:21.425753 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.425734    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef975dad-d7fd-41e6-bad3-c818cb6236c8-kube-api-access-8f9hx" (OuterVolumeSpecName: "kube-api-access-8f9hx") pod "ef975dad-d7fd-41e6-bad3-c818cb6236c8" (UID: "ef975dad-d7fd-41e6-bad3-c818cb6236c8"). InnerVolumeSpecName "kube-api-access-8f9hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:38:21.434258 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.434235    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26tnj\" (UniqueName: \"kubernetes.io/projected/8760024d-c568-49b0-b27e-9222bef63444-kube-api-access-26tnj\") pod \"kuadrant-operator-controller-manager-68cf589589-tl9lx\" (UID: \"8760024d-c568-49b0-b27e-9222bef63444\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"
Jul 31 20:38:21.524654 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.524559    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef975dad-d7fd-41e6-bad3-c818cb6236c8-extensions-socket-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:38:21.524654 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.524592    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f9hx\" (UniqueName: \"kubernetes.io/projected/ef975dad-d7fd-41e6-bad3-c818cb6236c8-kube-api-access-8f9hx\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:38:21.557564 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.557529    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"
Jul 31 20:38:21.690659 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:21.690625    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"]
Jul 31 20:38:21.694015 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:38:21.693987    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8760024d_c568_49b0_b27e_9222bef63444.slice/crio-cd69682fbfc024515e8832e23da82a5272063ab6bbc58b9fbc5b5494e7bcb03f WatchSource:0}: Error finding container cd69682fbfc024515e8832e23da82a5272063ab6bbc58b9fbc5b5494e7bcb03f: Status 404 returned error can't find the container with id cd69682fbfc024515e8832e23da82a5272063ab6bbc58b9fbc5b5494e7bcb03f
Jul 31 20:38:22.025521 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:22.025487    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx" event={"ID":"8760024d-c568-49b0-b27e-9222bef63444","Type":"ContainerStarted","Data":"9247e8819fb39a185cdf9746e54c5480f5b1abbbcd18336b8d9d5c4144e8b6a3"}
Jul 31 20:38:22.025963 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:22.025543    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx" event={"ID":"8760024d-c568-49b0-b27e-9222bef63444","Type":"ContainerStarted","Data":"cd69682fbfc024515e8832e23da82a5272063ab6bbc58b9fbc5b5494e7bcb03f"}
Jul 31 20:38:22.025963 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:22.025590    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"
Jul 31 20:38:22.026833 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:22.026809    2566 generic.go:356] "Generic (PLEG): container finished" podID="ef975dad-d7fd-41e6-bad3-c818cb6236c8" containerID="f4ff5bf1213001d6a89c19acb0c5584c0f70a07c144ff59c42c558c8ca3364b9" exitCode=0
Jul 31 20:38:22.026956 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:22.026867    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"
Jul 31 20:38:22.026956 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:22.026893    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58" event={"ID":"ef975dad-d7fd-41e6-bad3-c818cb6236c8","Type":"ContainerDied","Data":"f4ff5bf1213001d6a89c19acb0c5584c0f70a07c144ff59c42c558c8ca3364b9"}
Jul 31 20:38:22.026956 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:22.026938    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58" event={"ID":"ef975dad-d7fd-41e6-bad3-c818cb6236c8","Type":"ContainerDied","Data":"7b334153bd597d60f1f5d183a2a6b6daf953a68089e3a04866e932ccaa04d8e7"}
Jul 31 20:38:22.027199 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:22.026959    2566 scope.go:117] "RemoveContainer" containerID="f4ff5bf1213001d6a89c19acb0c5584c0f70a07c144ff59c42c558c8ca3364b9"
Jul 31 20:38:22.035762 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:22.035670    2566 scope.go:117] "RemoveContainer" containerID="f4ff5bf1213001d6a89c19acb0c5584c0f70a07c144ff59c42c558c8ca3364b9"
Jul 31 20:38:22.036056 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:22.036033    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4ff5bf1213001d6a89c19acb0c5584c0f70a07c144ff59c42c558c8ca3364b9\": container with ID starting with f4ff5bf1213001d6a89c19acb0c5584c0f70a07c144ff59c42c558c8ca3364b9 not found: ID does not exist" containerID="f4ff5bf1213001d6a89c19acb0c5584c0f70a07c144ff59c42c558c8ca3364b9"
Jul 31 20:38:22.036107 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:22.036068    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4ff5bf1213001d6a89c19acb0c5584c0f70a07c144ff59c42c558c8ca3364b9"} err="failed to get container status \"f4ff5bf1213001d6a89c19acb0c5584c0f70a07c144ff59c42c558c8ca3364b9\": rpc error: code = NotFound desc = could not find container \"f4ff5bf1213001d6a89c19acb0c5584c0f70a07c144ff59c42c558c8ca3364b9\": container with ID starting with f4ff5bf1213001d6a89c19acb0c5584c0f70a07c144ff59c42c558c8ca3364b9 not found: ID does not exist"
Jul 31 20:38:22.050416 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:22.050363    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx" podStartSLOduration=1.050349153 podStartE2EDuration="1.050349153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:38:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:38:22.048706425 +0000 UTC m=+506.654098927" watchObservedRunningTime="2026-07-31 20:38:22.050349153 +0000 UTC m=+506.655741628"
Jul 31 20:38:22.077055 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:22.077016    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"]
Jul 31 20:38:22.081192 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:22.081167    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-24q58"]
Jul 31 20:38:23.935885 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:23.935853    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef975dad-d7fd-41e6-bad3-c818cb6236c8" path="/var/lib/kubelet/pods/ef975dad-d7fd-41e6-bad3-c818cb6236c8/volumes"
Jul 31 20:38:33.034995 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:33.034965    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"
Jul 31 20:38:33.094558 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:33.094522    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"]
Jul 31 20:38:33.094739 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:33.094715    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd" podUID="45254334-9927-45f7-be4c-86c4d7ebbf05" containerName="manager" containerID="cri-o://ff408638c75c9e33020070637165e48c07665844fc9b99f99102724e07c81d69" gracePeriod=10
Jul 31 20:38:33.346075 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:33.346047    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"
Jul 31 20:38:33.517828 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:33.517789    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45254334-9927-45f7-be4c-86c4d7ebbf05-extensions-socket-volume\") pod \"45254334-9927-45f7-be4c-86c4d7ebbf05\" (UID: \"45254334-9927-45f7-be4c-86c4d7ebbf05\") "
Jul 31 20:38:33.518019 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:33.517876    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfhwc\" (UniqueName: \"kubernetes.io/projected/45254334-9927-45f7-be4c-86c4d7ebbf05-kube-api-access-vfhwc\") pod \"45254334-9927-45f7-be4c-86c4d7ebbf05\" (UID: \"45254334-9927-45f7-be4c-86c4d7ebbf05\") "
Jul 31 20:38:33.518290 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:33.518261    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45254334-9927-45f7-be4c-86c4d7ebbf05-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "45254334-9927-45f7-be4c-86c4d7ebbf05" (UID: "45254334-9927-45f7-be4c-86c4d7ebbf05"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:38:33.520072 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:33.520051    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45254334-9927-45f7-be4c-86c4d7ebbf05-kube-api-access-vfhwc" (OuterVolumeSpecName: "kube-api-access-vfhwc") pod "45254334-9927-45f7-be4c-86c4d7ebbf05" (UID: "45254334-9927-45f7-be4c-86c4d7ebbf05"). InnerVolumeSpecName "kube-api-access-vfhwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:38:33.618736 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:33.618644    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/45254334-9927-45f7-be4c-86c4d7ebbf05-extensions-socket-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:38:33.618736 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:33.618675    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfhwc\" (UniqueName: \"kubernetes.io/projected/45254334-9927-45f7-be4c-86c4d7ebbf05-kube-api-access-vfhwc\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:38:34.087728 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:34.087694    2566 generic.go:356] "Generic (PLEG): container finished" podID="45254334-9927-45f7-be4c-86c4d7ebbf05" containerID="ff408638c75c9e33020070637165e48c07665844fc9b99f99102724e07c81d69" exitCode=0
Jul 31 20:38:34.088219 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:34.087736    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"
Jul 31 20:38:34.088219 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:34.087751    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd" event={"ID":"45254334-9927-45f7-be4c-86c4d7ebbf05","Type":"ContainerDied","Data":"ff408638c75c9e33020070637165e48c07665844fc9b99f99102724e07c81d69"}
Jul 31 20:38:34.088219 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:34.087806    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd" event={"ID":"45254334-9927-45f7-be4c-86c4d7ebbf05","Type":"ContainerDied","Data":"a074cd4cd0b213beef543bb3920bdca24e7e9afd14d5b17d24b7a4914a9b3942"}
Jul 31 20:38:34.088219 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:34.087837    2566 scope.go:117] "RemoveContainer" containerID="ff408638c75c9e33020070637165e48c07665844fc9b99f99102724e07c81d69"
Jul 31 20:38:34.098233 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:34.098207    2566 scope.go:117] "RemoveContainer" containerID="ff408638c75c9e33020070637165e48c07665844fc9b99f99102724e07c81d69"
Jul 31 20:38:34.098651 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:34.098620    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff408638c75c9e33020070637165e48c07665844fc9b99f99102724e07c81d69\": container with ID starting with ff408638c75c9e33020070637165e48c07665844fc9b99f99102724e07c81d69 not found: ID does not exist" containerID="ff408638c75c9e33020070637165e48c07665844fc9b99f99102724e07c81d69"
Jul 31 20:38:34.098736 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:34.098659    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff408638c75c9e33020070637165e48c07665844fc9b99f99102724e07c81d69"} err="failed to get container status \"ff408638c75c9e33020070637165e48c07665844fc9b99f99102724e07c81d69\": rpc error: code = NotFound desc = could not find container \"ff408638c75c9e33020070637165e48c07665844fc9b99f99102724e07c81d69\": container with ID starting with ff408638c75c9e33020070637165e48c07665844fc9b99f99102724e07c81d69 not found: ID does not exist"
Jul 31 20:38:34.108046 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:34.108019    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"]
Jul 31 20:38:34.111733 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:34.111707    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-96db98c47-6cltd"]
Jul 31 20:38:35.935055 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:35.935020    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45254334-9927-45f7-be4c-86c4d7ebbf05" path="/var/lib/kubelet/pods/45254334-9927-45f7-be4c-86c4d7ebbf05/volumes"
Jul 31 20:38:37.382758 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.382721    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"]
Jul 31 20:38:37.383218 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.383042    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45254334-9927-45f7-be4c-86c4d7ebbf05" containerName="manager"
Jul 31 20:38:37.383218 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.383052    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="45254334-9927-45f7-be4c-86c4d7ebbf05" containerName="manager"
Jul 31 20:38:37.383218 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.383066    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef975dad-d7fd-41e6-bad3-c818cb6236c8" containerName="manager"
Jul 31 20:38:37.383218 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.383072    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef975dad-d7fd-41e6-bad3-c818cb6236c8" containerName="manager"
Jul 31 20:38:37.383218 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.383131    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef975dad-d7fd-41e6-bad3-c818cb6236c8" containerName="manager"
Jul 31 20:38:37.383218 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.383139    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="45254334-9927-45f7-be4c-86c4d7ebbf05" containerName="manager"
Jul 31 20:38:37.387502 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.387480    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.390075 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.390051    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-whpxz\""
Jul 31 20:38:37.390075 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.390066    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 31 20:38:37.397202 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.397179    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"]
Jul 31 20:38:37.554500 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.554466    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/825834e1-0f23-4521-a361-2ee637ff65b6-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.554500 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.554503    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/825834e1-0f23-4521-a361-2ee637ff65b6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.554709 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.554528    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/825834e1-0f23-4521-a361-2ee637ff65b6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.554709 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.554616    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/825834e1-0f23-4521-a361-2ee637ff65b6-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.554709 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.554664    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzbcl\" (UniqueName: \"kubernetes.io/projected/825834e1-0f23-4521-a361-2ee637ff65b6-kube-api-access-vzbcl\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.554709 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.554705    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/825834e1-0f23-4521-a361-2ee637ff65b6-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.554838 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.554726    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/825834e1-0f23-4521-a361-2ee637ff65b6-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.554838 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.554763    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/825834e1-0f23-4521-a361-2ee637ff65b6-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.554838 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.554785    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/825834e1-0f23-4521-a361-2ee637ff65b6-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.655861 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.655783    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/825834e1-0f23-4521-a361-2ee637ff65b6-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.655861 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.655819    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/825834e1-0f23-4521-a361-2ee637ff65b6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.655861 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.655853    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/825834e1-0f23-4521-a361-2ee637ff65b6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.656090 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.655889    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/825834e1-0f23-4521-a361-2ee637ff65b6-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.656090 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.655930    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzbcl\" (UniqueName: \"kubernetes.io/projected/825834e1-0f23-4521-a361-2ee637ff65b6-kube-api-access-vzbcl\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.656090 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.655963    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/825834e1-0f23-4521-a361-2ee637ff65b6-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.656287 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.656121    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/825834e1-0f23-4521-a361-2ee637ff65b6-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.656346 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.656289    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/825834e1-0f23-4521-a361-2ee637ff65b6-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.656398 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.656356    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/825834e1-0f23-4521-a361-2ee637ff65b6-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.656451 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.656280    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/825834e1-0f23-4521-a361-2ee637ff65b6-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.656451 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.656310    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/825834e1-0f23-4521-a361-2ee637ff65b6-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.656546 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.656530    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/825834e1-0f23-4521-a361-2ee637ff65b6-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.656751 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.656708    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/825834e1-0f23-4521-a361-2ee637ff65b6-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.656900 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.656782    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/825834e1-0f23-4521-a361-2ee637ff65b6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.658397 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.658378    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/825834e1-0f23-4521-a361-2ee637ff65b6-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.658646 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.658629    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/825834e1-0f23-4521-a361-2ee637ff65b6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.664072 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.664046    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/825834e1-0f23-4521-a361-2ee637ff65b6-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.664193 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.664171    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzbcl\" (UniqueName: \"kubernetes.io/projected/825834e1-0f23-4521-a361-2ee637ff65b6-kube-api-access-vzbcl\") pod \"maas-default-gateway-openshift-default-5ccb968c66-9wfvl\" (UID: \"825834e1-0f23-4521-a361-2ee637ff65b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.698308 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.698262    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:37.836983 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:37.836956    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"]
Jul 31 20:38:37.839304 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:38:37.839277    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod825834e1_0f23_4521_a361_2ee637ff65b6.slice/crio-a89e3e20493e332c129f5ad4173df51af25d77fc14c57eaf99a4a05d8ba989e7 WatchSource:0}: Error finding container a89e3e20493e332c129f5ad4173df51af25d77fc14c57eaf99a4a05d8ba989e7: Status 404 returned error can't find the container with id a89e3e20493e332c129f5ad4173df51af25d77fc14c57eaf99a4a05d8ba989e7
Jul 31 20:38:38.108211 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:38.108176    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl" event={"ID":"825834e1-0f23-4521-a361-2ee637ff65b6","Type":"ContainerStarted","Data":"a89e3e20493e332c129f5ad4173df51af25d77fc14c57eaf99a4a05d8ba989e7"}
Jul 31 20:38:41.118318 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:41.118281    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 20:38:41.118620 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:41.118353    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 20:38:41.118620 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:41.118381    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 20:38:42.129244 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:42.129207    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl" event={"ID":"825834e1-0f23-4521-a361-2ee637ff65b6","Type":"ContainerStarted","Data":"38fddd4a8ad786062b6588515793b66338c550bad55bdbb69d1930e36cf43411"}
Jul 31 20:38:42.148158 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:42.148101    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl" podStartSLOduration=1.871596918 podStartE2EDuration="5.148083108s" totalImagesPullingTime="3.27648619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:38:42.147122291 +0000 UTC m=+526.752514785" watchObservedRunningTime="2026-07-31 20:38:42.148083108 +0000 UTC m=+526.753475584"
Jul 31 20:38:42.699467 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:42.699433    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:42.704566 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:42.704542    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:43.133915 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:43.133883    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:43.134961 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:43.134945    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:38:51.960958 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:51.960877    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-259x4"]
Jul 31 20:38:51.963922 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:51.963906    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4"
Jul 31 20:38:51.966261 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:51.966242    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fbg8w\""
Jul 31 20:38:51.966364 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:51.966247    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 31 20:38:51.971492 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:51.971078    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-259x4"]
Jul 31 20:38:52.057070 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:52.057034    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-259x4"]
Jul 31 20:38:52.062210 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:52.062177    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxpjm\" (UniqueName: \"kubernetes.io/projected/c9baed9e-4132-44dc-a714-318e2e128d73-kube-api-access-nxpjm\") pod \"limitador-limitador-859c4d96d6-259x4\" (UID: \"c9baed9e-4132-44dc-a714-318e2e128d73\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4"
Jul 31 20:38:52.062375 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:52.062236    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c9baed9e-4132-44dc-a714-318e2e128d73-config-file\") pod \"limitador-limitador-859c4d96d6-259x4\" (UID: \"c9baed9e-4132-44dc-a714-318e2e128d73\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4"
Jul 31 20:38:52.163544 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:52.163509    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxpjm\" (UniqueName: \"kubernetes.io/projected/c9baed9e-4132-44dc-a714-318e2e128d73-kube-api-access-nxpjm\") pod \"limitador-limitador-859c4d96d6-259x4\" (UID: \"c9baed9e-4132-44dc-a714-318e2e128d73\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4"
Jul 31 20:38:52.163746 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:52.163562    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c9baed9e-4132-44dc-a714-318e2e128d73-config-file\") pod \"limitador-limitador-859c4d96d6-259x4\" (UID: \"c9baed9e-4132-44dc-a714-318e2e128d73\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4"
Jul 31 20:38:52.164300 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:52.164281    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c9baed9e-4132-44dc-a714-318e2e128d73-config-file\") pod \"limitador-limitador-859c4d96d6-259x4\" (UID: \"c9baed9e-4132-44dc-a714-318e2e128d73\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4"
Jul 31 20:38:52.184650 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:52.184621    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxpjm\" (UniqueName: \"kubernetes.io/projected/c9baed9e-4132-44dc-a714-318e2e128d73-kube-api-access-nxpjm\") pod \"limitador-limitador-859c4d96d6-259x4\" (UID: \"c9baed9e-4132-44dc-a714-318e2e128d73\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4"
Jul 31 20:38:52.275684 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:52.275602    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4"
Jul 31 20:38:52.415699 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:52.415676    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-259x4"]
Jul 31 20:38:52.418298 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:38:52.418266    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9baed9e_4132_44dc_a714_318e2e128d73.slice/crio-904db96803d163177faee725cc3aa2be1ea3783bc8e28fa98c07594864dbc64f WatchSource:0}: Error finding container 904db96803d163177faee725cc3aa2be1ea3783bc8e28fa98c07594864dbc64f: Status 404 returned error can't find the container with id 904db96803d163177faee725cc3aa2be1ea3783bc8e28fa98c07594864dbc64f
Jul 31 20:38:52.757445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:52.757409    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-w6m5l"]
Jul 31 20:38:52.761762 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:52.761739    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-w6m5l"
Jul 31 20:38:52.763990 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:52.763970    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mhqb4\""
Jul 31 20:38:52.766848 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:52.766828    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-w6m5l"]
Jul 31 20:38:52.768053 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:52.768036    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlnmd\" (UniqueName: \"kubernetes.io/projected/bb026730-3067-45b3-a1c3-2c08b513c34b-kube-api-access-mlnmd\") pod \"authorino-b54df94b4-w6m5l\" (UID: \"bb026730-3067-45b3-a1c3-2c08b513c34b\") " pod="kuadrant-system/authorino-b54df94b4-w6m5l"
Jul 31 20:38:52.869281 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:52.869244    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlnmd\" (UniqueName: \"kubernetes.io/projected/bb026730-3067-45b3-a1c3-2c08b513c34b-kube-api-access-mlnmd\") pod \"authorino-b54df94b4-w6m5l\" (UID: \"bb026730-3067-45b3-a1c3-2c08b513c34b\") " pod="kuadrant-system/authorino-b54df94b4-w6m5l"
Jul 31 20:38:52.881445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:52.881409    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlnmd\" (UniqueName: \"kubernetes.io/projected/bb026730-3067-45b3-a1c3-2c08b513c34b-kube-api-access-mlnmd\") pod \"authorino-b54df94b4-w6m5l\" (UID: \"bb026730-3067-45b3-a1c3-2c08b513c34b\") " pod="kuadrant-system/authorino-b54df94b4-w6m5l"
Jul 31 20:38:53.073019 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:53.072979    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-w6m5l"
Jul 31 20:38:53.188220 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:53.188184    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4" event={"ID":"c9baed9e-4132-44dc-a714-318e2e128d73","Type":"ContainerStarted","Data":"904db96803d163177faee725cc3aa2be1ea3783bc8e28fa98c07594864dbc64f"}
Jul 31 20:38:53.203002 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:53.202863    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-w6m5l"]
Jul 31 20:38:53.205834 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:38:53.205809    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb026730_3067_45b3_a1c3_2c08b513c34b.slice/crio-216d22fcec67f52b02f8cd44b615a6be8c706ea8d3e4ce2dd71e70d837a4a4bd WatchSource:0}: Error finding container 216d22fcec67f52b02f8cd44b615a6be8c706ea8d3e4ce2dd71e70d837a4a4bd: Status 404 returned error can't find the container with id 216d22fcec67f52b02f8cd44b615a6be8c706ea8d3e4ce2dd71e70d837a4a4bd
Jul 31 20:38:54.198076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:54.197386    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4" event={"ID":"c9baed9e-4132-44dc-a714-318e2e128d73","Type":"ContainerStarted","Data":"2b615f6d05d622094c359a09a97fa50a35a243ff8ab0818217c0115ffa07b7b1"}
Jul 31 20:38:54.198076 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:54.197610    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4"
Jul 31 20:38:54.199450 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:54.199395    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-w6m5l" event={"ID":"bb026730-3067-45b3-a1c3-2c08b513c34b","Type":"ContainerStarted","Data":"216d22fcec67f52b02f8cd44b615a6be8c706ea8d3e4ce2dd71e70d837a4a4bd"}
Jul 31 20:38:54.220139 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:54.219617    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4" podStartSLOduration=1.774539747 podStartE2EDuration="3.219593968s" totalImagesPullingTime="1.445054221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:38:54.218495136 +0000 UTC m=+538.823887612" watchObservedRunningTime="2026-07-31 20:38:54.219593968 +0000 UTC m=+538.824986446"
Jul 31 20:38:56.209687 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:56.209596    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-w6m5l" event={"ID":"bb026730-3067-45b3-a1c3-2c08b513c34b","Type":"ContainerStarted","Data":"5f35ab398e1f160538c2313f24250c136a623dd8440d3be9083338c1c1abe005"}
Jul 31 20:38:56.223797 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:56.223750    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-w6m5l" podStartSLOduration=2.192221315 podStartE2EDuration="4.223734133s" totalImagesPullingTime="2.031512818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:38:56.223082026 +0000 UTC m=+540.828474505" watchObservedRunningTime="2026-07-31 20:38:56.223734133 +0000 UTC m=+540.829126609"
Jul 31 20:38:56.652430 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:56.652396    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-w6m5l"]
Jul 31 20:38:58.218375 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:58.218317    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-w6m5l" podUID="bb026730-3067-45b3-a1c3-2c08b513c34b" containerName="authorino" containerID="cri-o://5f35ab398e1f160538c2313f24250c136a623dd8440d3be9083338c1c1abe005" gracePeriod=30
Jul 31 20:38:58.469258 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:58.469196    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-w6m5l"
Jul 31 20:38:58.609865 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:58.609830    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlnmd\" (UniqueName: \"kubernetes.io/projected/bb026730-3067-45b3-a1c3-2c08b513c34b-kube-api-access-mlnmd\") pod \"bb026730-3067-45b3-a1c3-2c08b513c34b\" (UID: \"bb026730-3067-45b3-a1c3-2c08b513c34b\") "
Jul 31 20:38:58.612109 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:58.612080    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb026730-3067-45b3-a1c3-2c08b513c34b-kube-api-access-mlnmd" (OuterVolumeSpecName: "kube-api-access-mlnmd") pod "bb026730-3067-45b3-a1c3-2c08b513c34b" (UID: "bb026730-3067-45b3-a1c3-2c08b513c34b"). InnerVolumeSpecName "kube-api-access-mlnmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:38:58.710502 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:58.710462    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlnmd\" (UniqueName: \"kubernetes.io/projected/bb026730-3067-45b3-a1c3-2c08b513c34b-kube-api-access-mlnmd\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:38:59.223812 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:59.223776    2566 generic.go:356] "Generic (PLEG): container finished" podID="bb026730-3067-45b3-a1c3-2c08b513c34b" containerID="5f35ab398e1f160538c2313f24250c136a623dd8440d3be9083338c1c1abe005" exitCode=0
Jul 31 20:38:59.224318 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:59.223822    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-w6m5l"
Jul 31 20:38:59.224318 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:59.223826    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-w6m5l" event={"ID":"bb026730-3067-45b3-a1c3-2c08b513c34b","Type":"ContainerDied","Data":"5f35ab398e1f160538c2313f24250c136a623dd8440d3be9083338c1c1abe005"}
Jul 31 20:38:59.224318 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:59.223879    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-w6m5l" event={"ID":"bb026730-3067-45b3-a1c3-2c08b513c34b","Type":"ContainerDied","Data":"216d22fcec67f52b02f8cd44b615a6be8c706ea8d3e4ce2dd71e70d837a4a4bd"}
Jul 31 20:38:59.224318 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:59.223902    2566 scope.go:117] "RemoveContainer" containerID="5f35ab398e1f160538c2313f24250c136a623dd8440d3be9083338c1c1abe005"
Jul 31 20:38:59.233179 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:59.233160    2566 scope.go:117] "RemoveContainer" containerID="5f35ab398e1f160538c2313f24250c136a623dd8440d3be9083338c1c1abe005"
Jul 31 20:38:59.233470 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:38:59.233451    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f35ab398e1f160538c2313f24250c136a623dd8440d3be9083338c1c1abe005\": container with ID starting with 5f35ab398e1f160538c2313f24250c136a623dd8440d3be9083338c1c1abe005 not found: ID does not exist" containerID="5f35ab398e1f160538c2313f24250c136a623dd8440d3be9083338c1c1abe005"
Jul 31 20:38:59.233527 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:59.233479    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f35ab398e1f160538c2313f24250c136a623dd8440d3be9083338c1c1abe005"} err="failed to get container status \"5f35ab398e1f160538c2313f24250c136a623dd8440d3be9083338c1c1abe005\": rpc error: code = NotFound desc = could not find container \"5f35ab398e1f160538c2313f24250c136a623dd8440d3be9083338c1c1abe005\": container with ID starting with 5f35ab398e1f160538c2313f24250c136a623dd8440d3be9083338c1c1abe005 not found: ID does not exist"
Jul 31 20:38:59.244043 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:59.244017    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-w6m5l"]
Jul 31 20:38:59.247290 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:59.247268    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-w6m5l"]
Jul 31 20:38:59.935037 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:38:59.935005    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb026730-3067-45b3-a1c3-2c08b513c34b" path="/var/lib/kubelet/pods/bb026730-3067-45b3-a1c3-2c08b513c34b/volumes"
Jul 31 20:39:05.204408 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:05.204378    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4"
Jul 31 20:39:07.652726 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:07.652687    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-259x4"]
Jul 31 20:39:07.653250 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:07.652878    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4" podUID="c9baed9e-4132-44dc-a714-318e2e128d73" containerName="limitador" containerID="cri-o://2b615f6d05d622094c359a09a97fa50a35a243ff8ab0818217c0115ffa07b7b1" gracePeriod=30
Jul 31 20:39:08.271110 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:08.271026    2566 generic.go:356] "Generic (PLEG): container finished" podID="c9baed9e-4132-44dc-a714-318e2e128d73" containerID="2b615f6d05d622094c359a09a97fa50a35a243ff8ab0818217c0115ffa07b7b1" exitCode=0
Jul 31 20:39:08.271110 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:08.271066    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4" event={"ID":"c9baed9e-4132-44dc-a714-318e2e128d73","Type":"ContainerDied","Data":"2b615f6d05d622094c359a09a97fa50a35a243ff8ab0818217c0115ffa07b7b1"}
Jul 31 20:39:08.597505 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:08.597479    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4"
Jul 31 20:39:08.686226 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:08.686190    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c9baed9e-4132-44dc-a714-318e2e128d73-config-file\") pod \"c9baed9e-4132-44dc-a714-318e2e128d73\" (UID: \"c9baed9e-4132-44dc-a714-318e2e128d73\") "
Jul 31 20:39:08.686226 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:08.686240    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxpjm\" (UniqueName: \"kubernetes.io/projected/c9baed9e-4132-44dc-a714-318e2e128d73-kube-api-access-nxpjm\") pod \"c9baed9e-4132-44dc-a714-318e2e128d73\" (UID: \"c9baed9e-4132-44dc-a714-318e2e128d73\") "
Jul 31 20:39:08.686660 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:08.686556    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9baed9e-4132-44dc-a714-318e2e128d73-config-file" (OuterVolumeSpecName: "config-file") pod "c9baed9e-4132-44dc-a714-318e2e128d73" (UID: "c9baed9e-4132-44dc-a714-318e2e128d73"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 20:39:08.688467 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:08.688445    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9baed9e-4132-44dc-a714-318e2e128d73-kube-api-access-nxpjm" (OuterVolumeSpecName: "kube-api-access-nxpjm") pod "c9baed9e-4132-44dc-a714-318e2e128d73" (UID: "c9baed9e-4132-44dc-a714-318e2e128d73"). InnerVolumeSpecName "kube-api-access-nxpjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:39:08.787349 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:08.787307    2566 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c9baed9e-4132-44dc-a714-318e2e128d73-config-file\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:39:08.787349 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:08.787344    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxpjm\" (UniqueName: \"kubernetes.io/projected/c9baed9e-4132-44dc-a714-318e2e128d73-kube-api-access-nxpjm\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:39:09.277662 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:09.277625    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4"
Jul 31 20:39:09.277838 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:09.277662    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-259x4" event={"ID":"c9baed9e-4132-44dc-a714-318e2e128d73","Type":"ContainerDied","Data":"904db96803d163177faee725cc3aa2be1ea3783bc8e28fa98c07594864dbc64f"}
Jul 31 20:39:09.277838 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:09.277726    2566 scope.go:117] "RemoveContainer" containerID="2b615f6d05d622094c359a09a97fa50a35a243ff8ab0818217c0115ffa07b7b1"
Jul 31 20:39:09.298349 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:09.298321    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-259x4"]
Jul 31 20:39:09.302591 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:09.302564    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-259x4"]
Jul 31 20:39:09.935839 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:09.935794    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9baed9e-4132-44dc-a714-318e2e128d73" path="/var/lib/kubelet/pods/c9baed9e-4132-44dc-a714-318e2e128d73/volumes"
Jul 31 20:39:10.025252 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.025209    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hb86k"]
Jul 31 20:39:10.025550 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.025531    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9baed9e-4132-44dc-a714-318e2e128d73" containerName="limitador"
Jul 31 20:39:10.025550 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.025547    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9baed9e-4132-44dc-a714-318e2e128d73" containerName="limitador"
Jul 31 20:39:10.025739 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.025560    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb026730-3067-45b3-a1c3-2c08b513c34b" containerName="authorino"
Jul 31 20:39:10.025739 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.025569    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb026730-3067-45b3-a1c3-2c08b513c34b" containerName="authorino"
Jul 31 20:39:10.025739 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.025632    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9baed9e-4132-44dc-a714-318e2e128d73" containerName="limitador"
Jul 31 20:39:10.025739 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.025643    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb026730-3067-45b3-a1c3-2c08b513c34b" containerName="authorino"
Jul 31 20:39:10.029802 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.029780    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb86k"
Jul 31 20:39:10.032177 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.032138    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 31 20:39:10.032318 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.032298    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 31 20:39:10.032391 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.032336    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 31 20:39:10.033393 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.033367    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-5kczx\""
Jul 31 20:39:10.035976 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.035948    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hb86k"]
Jul 31 20:39:10.098040 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.097999    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kld9k\" (UniqueName: \"kubernetes.io/projected/c3c55bf9-ecfb-49f0-b1fc-6b6d7a499cd6-kube-api-access-kld9k\") pod \"postgres-69fb4594cf-hb86k\" (UID: \"c3c55bf9-ecfb-49f0-b1fc-6b6d7a499cd6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb86k"
Jul 31 20:39:10.098258 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.098089    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c3c55bf9-ecfb-49f0-b1fc-6b6d7a499cd6-data\") pod \"postgres-69fb4594cf-hb86k\" (UID: \"c3c55bf9-ecfb-49f0-b1fc-6b6d7a499cd6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb86k"
Jul 31 20:39:10.198587 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.198489    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kld9k\" (UniqueName: \"kubernetes.io/projected/c3c55bf9-ecfb-49f0-b1fc-6b6d7a499cd6-kube-api-access-kld9k\") pod \"postgres-69fb4594cf-hb86k\" (UID: \"c3c55bf9-ecfb-49f0-b1fc-6b6d7a499cd6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb86k"
Jul 31 20:39:10.198587 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.198585    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c3c55bf9-ecfb-49f0-b1fc-6b6d7a499cd6-data\") pod \"postgres-69fb4594cf-hb86k\" (UID: \"c3c55bf9-ecfb-49f0-b1fc-6b6d7a499cd6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb86k"
Jul 31 20:39:10.198986 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.198968    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c3c55bf9-ecfb-49f0-b1fc-6b6d7a499cd6-data\") pod \"postgres-69fb4594cf-hb86k\" (UID: \"c3c55bf9-ecfb-49f0-b1fc-6b6d7a499cd6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb86k"
Jul 31 20:39:10.206474 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.206446    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kld9k\" (UniqueName: \"kubernetes.io/projected/c3c55bf9-ecfb-49f0-b1fc-6b6d7a499cd6-kube-api-access-kld9k\") pod \"postgres-69fb4594cf-hb86k\" (UID: \"c3c55bf9-ecfb-49f0-b1fc-6b6d7a499cd6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb86k"
Jul 31 20:39:10.340779 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.340746    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb86k"
Jul 31 20:39:10.472212 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:10.472111    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hb86k"]
Jul 31 20:39:10.475036 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:39:10.475008    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c55bf9_ecfb_49f0_b1fc_6b6d7a499cd6.slice/crio-aa77326dcb6da2f59d53e1280f082e66337a4c6e8640fbdb0b446dcaff66158e WatchSource:0}: Error finding container aa77326dcb6da2f59d53e1280f082e66337a4c6e8640fbdb0b446dcaff66158e: Status 404 returned error can't find the container with id aa77326dcb6da2f59d53e1280f082e66337a4c6e8640fbdb0b446dcaff66158e
Jul 31 20:39:11.292629 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:11.292587    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb86k" event={"ID":"c3c55bf9-ecfb-49f0-b1fc-6b6d7a499cd6","Type":"ContainerStarted","Data":"aa77326dcb6da2f59d53e1280f082e66337a4c6e8640fbdb0b446dcaff66158e"}
Jul 31 20:39:16.322608 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:16.322575    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb86k" event={"ID":"c3c55bf9-ecfb-49f0-b1fc-6b6d7a499cd6","Type":"ContainerStarted","Data":"7cceee77fb984d77a12ac6e046a69e73f4f3c6437717dc48fd5235e27ed09473"}
Jul 31 20:39:16.323061 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:16.322656    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb86k"
Jul 31 20:39:16.338713 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:16.338656    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb86k" podStartSLOduration=1.465239902 podStartE2EDuration="6.338638409s" totalImagesPullingTime="4.873398507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:39:16.33719666 +0000 UTC m=+560.942589139" watchObservedRunningTime="2026-07-31 20:39:16.338638409 +0000 UTC m=+560.944030884"
Jul 31 20:39:22.355454 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:22.355420    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb86k"
Jul 31 20:39:22.896985 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:22.896950    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-nlx7g"]
Jul 31 20:39:22.900325 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:22.900305    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-nlx7g"
Jul 31 20:39:22.902427 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:22.902408    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mhqb4\""
Jul 31 20:39:22.906483 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:22.906457    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-nlx7g"]
Jul 31 20:39:23.001556 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.001523    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-nlx7g"]
Jul 31 20:39:23.001783 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:39:23.001764    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8jvkx], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-nlx7g" podUID="8ca77a47-d9bb-47d9-b8bd-e274ab590b18"
Jul 31 20:39:23.007164 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.007125    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jvkx\" (UniqueName: \"kubernetes.io/projected/8ca77a47-d9bb-47d9-b8bd-e274ab590b18-kube-api-access-8jvkx\") pod \"authorino-5dc7ccb5f-nlx7g\" (UID: \"8ca77a47-d9bb-47d9-b8bd-e274ab590b18\") " pod="kuadrant-system/authorino-5dc7ccb5f-nlx7g"
Jul 31 20:39:23.028548 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.028518    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-snwsq"]
Jul 31 20:39:23.032188 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.032162    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-snwsq"
Jul 31 20:39:23.034269 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.034250    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 31 20:39:23.037783 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.037761    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-snwsq"]
Jul 31 20:39:23.108667 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.108636    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2-tls-cert\") pod \"authorino-687bd45585-snwsq\" (UID: \"fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2\") " pod="kuadrant-system/authorino-687bd45585-snwsq"
Jul 31 20:39:23.108876 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.108685    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz2w7\" (UniqueName: \"kubernetes.io/projected/fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2-kube-api-access-xz2w7\") pod \"authorino-687bd45585-snwsq\" (UID: \"fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2\") " pod="kuadrant-system/authorino-687bd45585-snwsq"
Jul 31 20:39:23.108876 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.108732    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jvkx\" (UniqueName: \"kubernetes.io/projected/8ca77a47-d9bb-47d9-b8bd-e274ab590b18-kube-api-access-8jvkx\") pod \"authorino-5dc7ccb5f-nlx7g\" (UID: \"8ca77a47-d9bb-47d9-b8bd-e274ab590b18\") " pod="kuadrant-system/authorino-5dc7ccb5f-nlx7g"
Jul 31 20:39:23.116315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.116280    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jvkx\" (UniqueName: \"kubernetes.io/projected/8ca77a47-d9bb-47d9-b8bd-e274ab590b18-kube-api-access-8jvkx\") pod \"authorino-5dc7ccb5f-nlx7g\" (UID: \"8ca77a47-d9bb-47d9-b8bd-e274ab590b18\") " pod="kuadrant-system/authorino-5dc7ccb5f-nlx7g"
Jul 31 20:39:23.145755 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.145719    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-snwsq"]
Jul 31 20:39:23.145976 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:39:23.145956    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xz2w7 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-snwsq" podUID="fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2"
Jul 31 20:39:23.169788 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.169709    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-778477b568-hx5g9"]
Jul 31 20:39:23.173002 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.172984    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778477b568-hx5g9"
Jul 31 20:39:23.180174 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.180134    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-778477b568-hx5g9"]
Jul 31 20:39:23.210015 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.209982    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2-tls-cert\") pod \"authorino-687bd45585-snwsq\" (UID: \"fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2\") " pod="kuadrant-system/authorino-687bd45585-snwsq"
Jul 31 20:39:23.210215 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.210038    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz2w7\" (UniqueName: \"kubernetes.io/projected/fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2-kube-api-access-xz2w7\") pod \"authorino-687bd45585-snwsq\" (UID: \"fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2\") " pod="kuadrant-system/authorino-687bd45585-snwsq"
Jul 31 20:39:23.212572 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.212550    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2-tls-cert\") pod \"authorino-687bd45585-snwsq\" (UID: \"fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2\") " pod="kuadrant-system/authorino-687bd45585-snwsq"
Jul 31 20:39:23.218638 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.218617    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz2w7\" (UniqueName: \"kubernetes.io/projected/fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2-kube-api-access-xz2w7\") pod \"authorino-687bd45585-snwsq\" (UID: \"fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2\") " pod="kuadrant-system/authorino-687bd45585-snwsq"
Jul 31 20:39:23.310561 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.310530    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e58ac261-62d1-40e4-a42e-6581240a711c-tls-cert\") pod \"authorino-778477b568-hx5g9\" (UID: \"e58ac261-62d1-40e4-a42e-6581240a711c\") " pod="kuadrant-system/authorino-778477b568-hx5g9"
Jul 31 20:39:23.310561 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.310561    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67cs7\" (UniqueName: \"kubernetes.io/projected/e58ac261-62d1-40e4-a42e-6581240a711c-kube-api-access-67cs7\") pod \"authorino-778477b568-hx5g9\" (UID: \"e58ac261-62d1-40e4-a42e-6581240a711c\") " pod="kuadrant-system/authorino-778477b568-hx5g9"
Jul 31 20:39:23.352029 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.351998    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-snwsq"
Jul 31 20:39:23.352029 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.352015    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-nlx7g"
Jul 31 20:39:23.359110 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.359081    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-snwsq"
Jul 31 20:39:23.362188 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.362139    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-nlx7g"
Jul 31 20:39:23.411011 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.410973    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2-tls-cert\") pod \"fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2\" (UID: \"fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2\") "
Jul 31 20:39:23.411238 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.411034    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jvkx\" (UniqueName: \"kubernetes.io/projected/8ca77a47-d9bb-47d9-b8bd-e274ab590b18-kube-api-access-8jvkx\") pod \"8ca77a47-d9bb-47d9-b8bd-e274ab590b18\" (UID: \"8ca77a47-d9bb-47d9-b8bd-e274ab590b18\") "
Jul 31 20:39:23.411238 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.411125    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz2w7\" (UniqueName: \"kubernetes.io/projected/fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2-kube-api-access-xz2w7\") pod \"fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2\" (UID: \"fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2\") "
Jul 31 20:39:23.411363 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.411280    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e58ac261-62d1-40e4-a42e-6581240a711c-tls-cert\") pod \"authorino-778477b568-hx5g9\" (UID: \"e58ac261-62d1-40e4-a42e-6581240a711c\") " pod="kuadrant-system/authorino-778477b568-hx5g9"
Jul 31 20:39:23.411363 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.411310    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67cs7\" (UniqueName: \"kubernetes.io/projected/e58ac261-62d1-40e4-a42e-6581240a711c-kube-api-access-67cs7\") pod \"authorino-778477b568-hx5g9\" (UID: \"e58ac261-62d1-40e4-a42e-6581240a711c\") " pod="kuadrant-system/authorino-778477b568-hx5g9"
Jul 31 20:39:23.413469 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.413437    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ca77a47-d9bb-47d9-b8bd-e274ab590b18-kube-api-access-8jvkx" (OuterVolumeSpecName: "kube-api-access-8jvkx") pod "8ca77a47-d9bb-47d9-b8bd-e274ab590b18" (UID: "8ca77a47-d9bb-47d9-b8bd-e274ab590b18"). InnerVolumeSpecName "kube-api-access-8jvkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:39:23.413833 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.413811    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2" (UID: "fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:39:23.413833 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.413821    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2-kube-api-access-xz2w7" (OuterVolumeSpecName: "kube-api-access-xz2w7") pod "fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2" (UID: "fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2"). InnerVolumeSpecName "kube-api-access-xz2w7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:39:23.413996 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.413975    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e58ac261-62d1-40e4-a42e-6581240a711c-tls-cert\") pod \"authorino-778477b568-hx5g9\" (UID: \"e58ac261-62d1-40e4-a42e-6581240a711c\") " pod="kuadrant-system/authorino-778477b568-hx5g9"
Jul 31 20:39:23.420117 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.420073    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67cs7\" (UniqueName: \"kubernetes.io/projected/e58ac261-62d1-40e4-a42e-6581240a711c-kube-api-access-67cs7\") pod \"authorino-778477b568-hx5g9\" (UID: \"e58ac261-62d1-40e4-a42e-6581240a711c\") " pod="kuadrant-system/authorino-778477b568-hx5g9"
Jul 31 20:39:23.483023 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.482986    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778477b568-hx5g9"
Jul 31 20:39:23.512504 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.512465    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jvkx\" (UniqueName: \"kubernetes.io/projected/8ca77a47-d9bb-47d9-b8bd-e274ab590b18-kube-api-access-8jvkx\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:39:23.512504 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.512503    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz2w7\" (UniqueName: \"kubernetes.io/projected/fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2-kube-api-access-xz2w7\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:39:23.512504 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.512514    2566 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2-tls-cert\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:39:23.613436 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:23.613339    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-778477b568-hx5g9"]
Jul 31 20:39:23.615716 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:39:23.615690    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode58ac261_62d1_40e4_a42e_6581240a711c.slice/crio-212d2ded01164ed524f4702ba0df4b9c798d6bb03ffed290580ef89b7d661152 WatchSource:0}: Error finding container 212d2ded01164ed524f4702ba0df4b9c798d6bb03ffed290580ef89b7d661152: Status 404 returned error can't find the container with id 212d2ded01164ed524f4702ba0df4b9c798d6bb03ffed290580ef89b7d661152
Jul 31 20:39:24.359399 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:24.359366    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-nlx7g"
Jul 31 20:39:24.359903 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:24.359359    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-778477b568-hx5g9" event={"ID":"e58ac261-62d1-40e4-a42e-6581240a711c","Type":"ContainerStarted","Data":"76f5dea5c5bd332ca260a0e44013683de28323568637689433de7b9d5494ad2f"}
Jul 31 20:39:24.359903 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:24.359508    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-778477b568-hx5g9" event={"ID":"e58ac261-62d1-40e4-a42e-6581240a711c","Type":"ContainerStarted","Data":"212d2ded01164ed524f4702ba0df4b9c798d6bb03ffed290580ef89b7d661152"}
Jul 31 20:39:24.359903 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:24.359564    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-snwsq"
Jul 31 20:39:24.377054 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:24.376993    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-778477b568-hx5g9" podStartSLOduration=0.759803975 podStartE2EDuration="1.376970402s" totalImagesPullingTime="617.166427ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:39:24.375723701 +0000 UTC m=+568.981116187" watchObservedRunningTime="2026-07-31 20:39:24.376970402 +0000 UTC m=+568.982362886"
Jul 31 20:39:24.410448 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:24.410413    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-nlx7g"]
Jul 31 20:39:24.420424 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:24.420393    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-nlx7g"]
Jul 31 20:39:24.441585 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:24.441552    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-snwsq"]
Jul 31 20:39:24.445449 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:24.445423    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-snwsq"]
Jul 31 20:39:25.935223 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:25.935193    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ca77a47-d9bb-47d9-b8bd-e274ab590b18" path="/var/lib/kubelet/pods/8ca77a47-d9bb-47d9-b8bd-e274ab590b18/volumes"
Jul 31 20:39:25.935635 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:39:25.935450    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2" path="/var/lib/kubelet/pods/fd7b44da-76bb-4d92-9de1-0e6bfb7cf9a2/volumes"
Jul 31 20:40:04.742406 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:04.742373    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-4vj9m"]
Jul 31 20:40:04.747453 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:04.747425    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-4vj9m"
Jul 31 20:40:04.749876 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:04.749850    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 31 20:40:04.750019 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:04.749930    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-btjg7\""
Jul 31 20:40:04.756855 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:04.756830    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-4vj9m"]
Jul 31 20:40:04.867448 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:04.867415    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mlxg\" (UniqueName: \"kubernetes.io/projected/5436fd36-6c95-4225-8260-8d7ca57f80c3-kube-api-access-4mlxg\") pod \"payload-processing-5cc6cd444b-4vj9m\" (UID: \"5436fd36-6c95-4225-8260-8d7ca57f80c3\") " pod="openshift-ingress/payload-processing-5cc6cd444b-4vj9m"
Jul 31 20:40:04.867622 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:04.867479    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5436fd36-6c95-4225-8260-8d7ca57f80c3-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-4vj9m\" (UID: \"5436fd36-6c95-4225-8260-8d7ca57f80c3\") " pod="openshift-ingress/payload-processing-5cc6cd444b-4vj9m"
Jul 31 20:40:04.968259 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:04.968218    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mlxg\" (UniqueName: \"kubernetes.io/projected/5436fd36-6c95-4225-8260-8d7ca57f80c3-kube-api-access-4mlxg\") pod \"payload-processing-5cc6cd444b-4vj9m\" (UID: \"5436fd36-6c95-4225-8260-8d7ca57f80c3\") " pod="openshift-ingress/payload-processing-5cc6cd444b-4vj9m"
Jul 31 20:40:04.968424 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:04.968318    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5436fd36-6c95-4225-8260-8d7ca57f80c3-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-4vj9m\" (UID: \"5436fd36-6c95-4225-8260-8d7ca57f80c3\") " pod="openshift-ingress/payload-processing-5cc6cd444b-4vj9m"
Jul 31 20:40:04.969040 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:04.969019    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5436fd36-6c95-4225-8260-8d7ca57f80c3-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-4vj9m\" (UID: \"5436fd36-6c95-4225-8260-8d7ca57f80c3\") " pod="openshift-ingress/payload-processing-5cc6cd444b-4vj9m"
Jul 31 20:40:04.976967 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:04.976938    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mlxg\" (UniqueName: \"kubernetes.io/projected/5436fd36-6c95-4225-8260-8d7ca57f80c3-kube-api-access-4mlxg\") pod \"payload-processing-5cc6cd444b-4vj9m\" (UID: \"5436fd36-6c95-4225-8260-8d7ca57f80c3\") " pod="openshift-ingress/payload-processing-5cc6cd444b-4vj9m"
Jul 31 20:40:05.058912 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:05.058871    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-4vj9m"
Jul 31 20:40:05.224596 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:05.224557    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-4vj9m"]
Jul 31 20:40:05.227573 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:40:05.227541    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5436fd36_6c95_4225_8260_8d7ca57f80c3.slice/crio-1aac2524e32ff12d60957933d9c69c1994b76b746c015609340b369e283cf7d4 WatchSource:0}: Error finding container 1aac2524e32ff12d60957933d9c69c1994b76b746c015609340b369e283cf7d4: Status 404 returned error can't find the container with id 1aac2524e32ff12d60957933d9c69c1994b76b746c015609340b369e283cf7d4
Jul 31 20:40:05.545315 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:05.544737    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-4vj9m" event={"ID":"5436fd36-6c95-4225-8260-8d7ca57f80c3","Type":"ContainerStarted","Data":"1aac2524e32ff12d60957933d9c69c1994b76b746c015609340b369e283cf7d4"}
Jul 31 20:40:08.566839 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:08.566798    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-4vj9m" event={"ID":"5436fd36-6c95-4225-8260-8d7ca57f80c3","Type":"ContainerStarted","Data":"c59a446371193f26228d899f61697de6bd3e667165a03f98016764297280cfd2"}
Jul 31 20:40:08.567301 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:08.566997    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-4vj9m"
Jul 31 20:40:08.582737 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:08.582691    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-4vj9m" podStartSLOduration=1.76050856 podStartE2EDuration="4.582676714s" totalImagesPullingTime="2.822168154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:40:08.581613589 +0000 UTC m=+613.187006066" watchObservedRunningTime="2026-07-31 20:40:08.582676714 +0000 UTC m=+613.188069190"
Jul 31 20:40:13.638615 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:13.638566    2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-9wfvl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": read tcp 10.133.0.2:39932->10.133.0.32:15021: read: connection reset by peer" start-of-body=
Jul 31 20:40:13.639039 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:13.638633    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl" podUID="825834e1-0f23-4521-a361-2ee637ff65b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": read tcp 10.133.0.2:39932->10.133.0.32:15021: read: connection reset by peer"
Jul 31 20:40:14.597362 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:14.597327    2566 generic.go:356] "Generic (PLEG): container finished" podID="825834e1-0f23-4521-a361-2ee637ff65b6" containerID="38fddd4a8ad786062b6588515793b66338c550bad55bdbb69d1930e36cf43411" exitCode=0
Jul 31 20:40:14.597536 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:14.597405    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl" event={"ID":"825834e1-0f23-4521-a361-2ee637ff65b6","Type":"ContainerDied","Data":"38fddd4a8ad786062b6588515793b66338c550bad55bdbb69d1930e36cf43411"}
Jul 31 20:40:14.597758 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:14.597745    2566 scope.go:117] "RemoveContainer" containerID="38fddd4a8ad786062b6588515793b66338c550bad55bdbb69d1930e36cf43411"
Jul 31 20:40:14.598735 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:14.598700    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 20:40:14.598804 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:14.598767    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 20:40:14.598804 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:14.598796    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 20:40:15.604302 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:15.604265    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl" event={"ID":"825834e1-0f23-4521-a361-2ee637ff65b6","Type":"ContainerStarted","Data":"b432135eb16d0ba4c8aedd081dab92c10878cdd5a8d5a5219904245d36b82f26"}
Jul 31 20:40:15.699101 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:15.699065    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:40:15.699388 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:15.699363    2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-9wfvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 31 20:40:15.699442 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:15.699418    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl" podUID="825834e1-0f23-4521-a361-2ee637ff65b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 31 20:40:16.698671 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:16.698631    2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-9wfvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 31 20:40:16.699061 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:16.698710    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl" podUID="825834e1-0f23-4521-a361-2ee637ff65b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 31 20:40:17.699459 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:17.699423    2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-9wfvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 31 20:40:17.699859 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:17.699482    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl" podUID="825834e1-0f23-4521-a361-2ee637ff65b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 31 20:40:18.699373 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:18.699332    2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-9wfvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 31 20:40:18.699561 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:18.699391    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl" podUID="825834e1-0f23-4521-a361-2ee637ff65b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 31 20:40:19.575340 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:19.575309    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-4vj9m"
Jul 31 20:40:19.698885 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:19.698853    2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-9wfvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 31 20:40:19.699057 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:19.698912    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl" podUID="825834e1-0f23-4521-a361-2ee637ff65b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 31 20:40:20.699049 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:20.699011    2566 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-9wfvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 31 20:40:20.699494 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:20.699072    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl" podUID="825834e1-0f23-4521-a361-2ee637ff65b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 31 20:40:21.702096 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:21.702066    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:40:21.702598 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:21.702474    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:40:21.703113 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:40:21.703095    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-9wfvl"
Jul 31 20:41:17.789418 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.789385    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"]
Jul 31 20:41:17.793202 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.793180    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.796023 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.795999    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 31 20:41:17.797209 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.797188    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-h6pmz\""
Jul 31 20:41:17.797377 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.797361    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 31 20:41:17.797540 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.797515    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 31 20:41:17.805209 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.805176    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"]
Jul 31 20:41:17.887459 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.887420    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.887645 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.887487    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5tsn\" (UniqueName: \"kubernetes.io/projected/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-kube-api-access-l5tsn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.887645 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.887540    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.887645 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.887561    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.887645 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.887606    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.887645 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.887640    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.988592 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.988551    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.988592 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.988589    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.988854 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.988610    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.988854 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.988632    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.988854 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.988757    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.988854 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.988842    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5tsn\" (UniqueName: \"kubernetes.io/projected/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-kube-api-access-l5tsn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.989040 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.988977    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.989103 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.989074    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.989208 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.989110    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.991322 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.991297    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.991509 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.991493    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:17.998735 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:17.998712    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5tsn\" (UniqueName: \"kubernetes.io/projected/9d82e3b4-3c7d-4906-a780-228f83c2ffc1-kube-api-access-l5tsn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq59d\" (UID: \"9d82e3b4-3c7d-4906-a780-228f83c2ffc1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:18.104914 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:18.104864    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:18.241896 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:18.241837    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"]
Jul 31 20:41:18.244626 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:41:18.244599    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d82e3b4_3c7d_4906_a780_228f83c2ffc1.slice/crio-b040429c74de8b0eed4797ca67a5af20b3f1f30b0e7f10727cb1a43bc1c86ecb WatchSource:0}: Error finding container b040429c74de8b0eed4797ca67a5af20b3f1f30b0e7f10727cb1a43bc1c86ecb: Status 404 returned error can't find the container with id b040429c74de8b0eed4797ca67a5af20b3f1f30b0e7f10727cb1a43bc1c86ecb
Jul 31 20:41:18.246001 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:18.245982    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 20:41:18.900613 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:18.900569    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d" event={"ID":"9d82e3b4-3c7d-4906-a780-228f83c2ffc1","Type":"ContainerStarted","Data":"b040429c74de8b0eed4797ca67a5af20b3f1f30b0e7f10727cb1a43bc1c86ecb"}
Jul 31 20:41:19.906927 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:19.906888    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d" event={"ID":"9d82e3b4-3c7d-4906-a780-228f83c2ffc1","Type":"ContainerStarted","Data":"999b1916b80bde104aea451bb1971f1470ed71f58639735b42742a8cd4d321d7"}
Jul 31 20:41:19.924370 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:19.924314    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d" podStartSLOduration=1.846274913 podStartE2EDuration="2.924295847s" totalImagesPullingTime="1.078020934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:41:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:41:19.923984151 +0000 UTC m=+684.529376629" watchObservedRunningTime="2026-07-31 20:41:19.924295847 +0000 UTC m=+684.529688323"
Jul 31 20:41:28.105644 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:28.105601    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:28.106045 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:28.105667    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:28.118546 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:28.118519    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:28.959594 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:28.959565    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq59d"
Jul 31 20:41:48.679865 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.679787    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"]
Jul 31 20:41:48.683503 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.683485    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.685861 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.685839    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 31 20:41:48.692780 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.692751    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"]
Jul 31 20:41:48.863891 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.863850    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3005d54f-07e5-4f71-83d2-9ea764dd22b6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.864057 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.863899    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kk9n\" (UniqueName: \"kubernetes.io/projected/3005d54f-07e5-4f71-83d2-9ea764dd22b6-kube-api-access-2kk9n\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.864057 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.863978    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3005d54f-07e5-4f71-83d2-9ea764dd22b6-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.864057 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.864039    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3005d54f-07e5-4f71-83d2-9ea764dd22b6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.864187 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.864103    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3005d54f-07e5-4f71-83d2-9ea764dd22b6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.864187 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.864133    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3005d54f-07e5-4f71-83d2-9ea764dd22b6-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.965319 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.965234    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3005d54f-07e5-4f71-83d2-9ea764dd22b6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.965319 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.965299    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3005d54f-07e5-4f71-83d2-9ea764dd22b6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.965551 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.965322    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3005d54f-07e5-4f71-83d2-9ea764dd22b6-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.965551 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.965356    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3005d54f-07e5-4f71-83d2-9ea764dd22b6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.965551 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.965434    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kk9n\" (UniqueName: \"kubernetes.io/projected/3005d54f-07e5-4f71-83d2-9ea764dd22b6-kube-api-access-2kk9n\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.965551 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.965483    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3005d54f-07e5-4f71-83d2-9ea764dd22b6-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.965755 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.965708    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3005d54f-07e5-4f71-83d2-9ea764dd22b6-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.965826 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.965803    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3005d54f-07e5-4f71-83d2-9ea764dd22b6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.965881 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.965808    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3005d54f-07e5-4f71-83d2-9ea764dd22b6-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.967840 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.967816    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3005d54f-07e5-4f71-83d2-9ea764dd22b6-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.968072 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.968050    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3005d54f-07e5-4f71-83d2-9ea764dd22b6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.972923 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.972904    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kk9n\" (UniqueName: \"kubernetes.io/projected/3005d54f-07e5-4f71-83d2-9ea764dd22b6-kube-api-access-2kk9n\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-vkh42\" (UID: \"3005d54f-07e5-4f71-83d2-9ea764dd22b6\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:48.992876 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:48.992835    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:49.132778 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:49.132689    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"]
Jul 31 20:41:49.134800 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:41:49.134757    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3005d54f_07e5_4f71_83d2_9ea764dd22b6.slice/crio-1b43c142409c71707a6e844da58344af91900e060695d5bc306624819c5d75a0 WatchSource:0}: Error finding container 1b43c142409c71707a6e844da58344af91900e060695d5bc306624819c5d75a0: Status 404 returned error can't find the container with id 1b43c142409c71707a6e844da58344af91900e060695d5bc306624819c5d75a0
Jul 31 20:41:50.060707 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:50.060672    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42" event={"ID":"3005d54f-07e5-4f71-83d2-9ea764dd22b6","Type":"ContainerStarted","Data":"ee9edeac490289d0c76c8a4c8b32b066a6d15bda68c44d448aa1e255a77904a1"}
Jul 31 20:41:50.060707 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:50.060723    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42" event={"ID":"3005d54f-07e5-4f71-83d2-9ea764dd22b6","Type":"ContainerStarted","Data":"1b43c142409c71707a6e844da58344af91900e060695d5bc306624819c5d75a0"}
Jul 31 20:41:50.078818 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:50.078760    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42" podStartSLOduration=1.899664741 podStartE2EDuration="2.078742924s" totalImagesPullingTime="179.078183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:41:50.077541881 +0000 UTC m=+714.682934357" watchObservedRunningTime="2026-07-31 20:41:50.078742924 +0000 UTC m=+714.684135399"
Jul 31 20:41:58.993809 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:58.993758    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:58.993809 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:58.993815    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:59.006883 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:59.006853    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:41:59.114319 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:41:59.114286    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-vkh42"
Jul 31 20:42:48.779009 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:48.778972    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-778477b568-hx5g9"]
Jul 31 20:42:48.779484 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:48.779222    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-778477b568-hx5g9" podUID="e58ac261-62d1-40e4-a42e-6581240a711c" containerName="authorino" containerID="cri-o://76f5dea5c5bd332ca260a0e44013683de28323568637689433de7b9d5494ad2f" gracePeriod=30
Jul 31 20:42:49.037253 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:49.037174    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778477b568-hx5g9"
Jul 31 20:42:49.098883 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:49.098842    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67cs7\" (UniqueName: \"kubernetes.io/projected/e58ac261-62d1-40e4-a42e-6581240a711c-kube-api-access-67cs7\") pod \"e58ac261-62d1-40e4-a42e-6581240a711c\" (UID: \"e58ac261-62d1-40e4-a42e-6581240a711c\") "
Jul 31 20:42:49.099078 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:49.098895    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e58ac261-62d1-40e4-a42e-6581240a711c-tls-cert\") pod \"e58ac261-62d1-40e4-a42e-6581240a711c\" (UID: \"e58ac261-62d1-40e4-a42e-6581240a711c\") "
Jul 31 20:42:49.101158 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:49.101119    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e58ac261-62d1-40e4-a42e-6581240a711c-kube-api-access-67cs7" (OuterVolumeSpecName: "kube-api-access-67cs7") pod "e58ac261-62d1-40e4-a42e-6581240a711c" (UID: "e58ac261-62d1-40e4-a42e-6581240a711c"). InnerVolumeSpecName "kube-api-access-67cs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:42:49.109490 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:49.109461    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e58ac261-62d1-40e4-a42e-6581240a711c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e58ac261-62d1-40e4-a42e-6581240a711c" (UID: "e58ac261-62d1-40e4-a42e-6581240a711c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:42:49.200369 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:49.200324    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67cs7\" (UniqueName: \"kubernetes.io/projected/e58ac261-62d1-40e4-a42e-6581240a711c-kube-api-access-67cs7\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:42:49.200369 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:49.200362    2566 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e58ac261-62d1-40e4-a42e-6581240a711c-tls-cert\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:42:49.326909 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:49.326873    2566 generic.go:356] "Generic (PLEG): container finished" podID="e58ac261-62d1-40e4-a42e-6581240a711c" containerID="76f5dea5c5bd332ca260a0e44013683de28323568637689433de7b9d5494ad2f" exitCode=0
Jul 31 20:42:49.327073 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:49.326977    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-778477b568-hx5g9"
Jul 31 20:42:49.327073 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:49.327014    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-778477b568-hx5g9" event={"ID":"e58ac261-62d1-40e4-a42e-6581240a711c","Type":"ContainerDied","Data":"76f5dea5c5bd332ca260a0e44013683de28323568637689433de7b9d5494ad2f"}
Jul 31 20:42:49.327073 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:49.327052    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-778477b568-hx5g9" event={"ID":"e58ac261-62d1-40e4-a42e-6581240a711c","Type":"ContainerDied","Data":"212d2ded01164ed524f4702ba0df4b9c798d6bb03ffed290580ef89b7d661152"}
Jul 31 20:42:49.327266 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:49.327073    2566 scope.go:117] "RemoveContainer" containerID="76f5dea5c5bd332ca260a0e44013683de28323568637689433de7b9d5494ad2f"
Jul 31 20:42:49.336377 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:49.336357    2566 scope.go:117] "RemoveContainer" containerID="76f5dea5c5bd332ca260a0e44013683de28323568637689433de7b9d5494ad2f"
Jul 31 20:42:49.336651 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:42:49.336631    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76f5dea5c5bd332ca260a0e44013683de28323568637689433de7b9d5494ad2f\": container with ID starting with 76f5dea5c5bd332ca260a0e44013683de28323568637689433de7b9d5494ad2f not found: ID does not exist" containerID="76f5dea5c5bd332ca260a0e44013683de28323568637689433de7b9d5494ad2f"
Jul 31 20:42:49.336693 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:49.336662    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f5dea5c5bd332ca260a0e44013683de28323568637689433de7b9d5494ad2f"} err="failed to get container status \"76f5dea5c5bd332ca260a0e44013683de28323568637689433de7b9d5494ad2f\": rpc error: code = NotFound desc = could not find container \"76f5dea5c5bd332ca260a0e44013683de28323568637689433de7b9d5494ad2f\": container with ID starting with 76f5dea5c5bd332ca260a0e44013683de28323568637689433de7b9d5494ad2f not found: ID does not exist"
Jul 31 20:42:49.349465 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:49.349438    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-778477b568-hx5g9"]
Jul 31 20:42:49.356689 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:49.356663    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-778477b568-hx5g9"]
Jul 31 20:42:49.935577 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:42:49.935537    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e58ac261-62d1-40e4-a42e-6581240a711c" path="/var/lib/kubelet/pods/e58ac261-62d1-40e4-a42e-6581240a711c/volumes"
Jul 31 20:45:00.144161 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:45:00.144112    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758845-mcm7j"]
Jul 31 20:45:00.144618 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:45:00.144481    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e58ac261-62d1-40e4-a42e-6581240a711c" containerName="authorino"
Jul 31 20:45:00.144618 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:45:00.144492    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e58ac261-62d1-40e4-a42e-6581240a711c" containerName="authorino"
Jul 31 20:45:00.144618 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:45:00.144548    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e58ac261-62d1-40e4-a42e-6581240a711c" containerName="authorino"
Jul 31 20:45:00.147387 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:45:00.147367    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758845-mcm7j"
Jul 31 20:45:00.149893 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:45:00.149869    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 20:45:00.154363 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:45:00.154337    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758845-mcm7j"]
Jul 31 20:45:00.159747 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:45:00.159723    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758845-mcm7j"
Jul 31 20:45:00.299122 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:45:00.299095    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758845-mcm7j"]
Jul 31 20:45:00.301839 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:45:00.301814    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bbf7038_555a_4aaf_8ac6_14128d9f3b4b.slice/crio-6b39de436b47db985f8dfb7586b5cb1fad8aadb6b28b7d626e5fe66b30762cbe WatchSource:0}: Error finding container 6b39de436b47db985f8dfb7586b5cb1fad8aadb6b28b7d626e5fe66b30762cbe: Status 404 returned error can't find the container with id 6b39de436b47db985f8dfb7586b5cb1fad8aadb6b28b7d626e5fe66b30762cbe
Jul 31 20:45:00.942188 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:45:00.942135    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758845-mcm7j" event={"ID":"2bbf7038-555a-4aaf-8ac6-14128d9f3b4b","Type":"ContainerStarted","Data":"6b39de436b47db985f8dfb7586b5cb1fad8aadb6b28b7d626e5fe66b30762cbe"}
Jul 31 20:45:04.967699 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:45:04.967594    2566 generic.go:356] "Generic (PLEG): container finished" podID="2bbf7038-555a-4aaf-8ac6-14128d9f3b4b" containerID="9853304f160dc2584d98971f0d259296d2787a75e4fc7079828524006111da47" exitCode=0
Jul 31 20:45:04.968055 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:45:04.967690    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758845-mcm7j" event={"ID":"2bbf7038-555a-4aaf-8ac6-14128d9f3b4b","Type":"ContainerDied","Data":"9853304f160dc2584d98971f0d259296d2787a75e4fc7079828524006111da47"}
Jul 31 20:45:06.115517 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:45:06.115489    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758845-mcm7j"
Jul 31 20:45:06.978562 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:45:06.978530    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758845-mcm7j"
Jul 31 20:45:06.978767 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:45:06.978583    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758845-mcm7j" event={"ID":"2bbf7038-555a-4aaf-8ac6-14128d9f3b4b","Type":"ContainerDied","Data":"6b39de436b47db985f8dfb7586b5cb1fad8aadb6b28b7d626e5fe66b30762cbe"}
Jul 31 20:45:06.978767 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:45:06.978633    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b39de436b47db985f8dfb7586b5cb1fad8aadb6b28b7d626e5fe66b30762cbe"
Jul 31 20:51:29.629087 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:51:29.629051    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"]
Jul 31 20:51:29.631862 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:51:29.629394    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx" podUID="8760024d-c568-49b0-b27e-9222bef63444" containerName="manager" containerID="cri-o://9247e8819fb39a185cdf9746e54c5480f5b1abbbcd18336b8d9d5c4144e8b6a3" gracePeriod=10
Jul 31 20:51:29.775568 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:51:29.775534    2566 generic.go:356] "Generic (PLEG): container finished" podID="8760024d-c568-49b0-b27e-9222bef63444" containerID="9247e8819fb39a185cdf9746e54c5480f5b1abbbcd18336b8d9d5c4144e8b6a3" exitCode=0
Jul 31 20:51:29.775737 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:51:29.775611    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx" event={"ID":"8760024d-c568-49b0-b27e-9222bef63444","Type":"ContainerDied","Data":"9247e8819fb39a185cdf9746e54c5480f5b1abbbcd18336b8d9d5c4144e8b6a3"}
Jul 31 20:51:29.883213 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:51:29.883128    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"
Jul 31 20:51:29.918501 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:51:29.918471    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8760024d-c568-49b0-b27e-9222bef63444-extensions-socket-volume\") pod \"8760024d-c568-49b0-b27e-9222bef63444\" (UID: \"8760024d-c568-49b0-b27e-9222bef63444\") "
Jul 31 20:51:29.918659 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:51:29.918524    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26tnj\" (UniqueName: \"kubernetes.io/projected/8760024d-c568-49b0-b27e-9222bef63444-kube-api-access-26tnj\") pod \"8760024d-c568-49b0-b27e-9222bef63444\" (UID: \"8760024d-c568-49b0-b27e-9222bef63444\") "
Jul 31 20:51:29.918889 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:51:29.918870    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8760024d-c568-49b0-b27e-9222bef63444-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8760024d-c568-49b0-b27e-9222bef63444" (UID: "8760024d-c568-49b0-b27e-9222bef63444"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:51:29.920964 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:51:29.920932    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8760024d-c568-49b0-b27e-9222bef63444-kube-api-access-26tnj" (OuterVolumeSpecName: "kube-api-access-26tnj") pod "8760024d-c568-49b0-b27e-9222bef63444" (UID: "8760024d-c568-49b0-b27e-9222bef63444"). InnerVolumeSpecName "kube-api-access-26tnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:51:30.019494 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:51:30.019456    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8760024d-c568-49b0-b27e-9222bef63444-extensions-socket-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:51:30.019494 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:51:30.019489    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26tnj\" (UniqueName: \"kubernetes.io/projected/8760024d-c568-49b0-b27e-9222bef63444-kube-api-access-26tnj\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:51:30.781878 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:51:30.781841    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx" event={"ID":"8760024d-c568-49b0-b27e-9222bef63444","Type":"ContainerDied","Data":"cd69682fbfc024515e8832e23da82a5272063ab6bbc58b9fbc5b5494e7bcb03f"}
Jul 31 20:51:30.781878 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:51:30.781877    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"
Jul 31 20:51:30.782387 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:51:30.781929    2566 scope.go:117] "RemoveContainer" containerID="9247e8819fb39a185cdf9746e54c5480f5b1abbbcd18336b8d9d5c4144e8b6a3"
Jul 31 20:51:30.801544 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:51:30.801516    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"]
Jul 31 20:51:30.804703 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:51:30.804674    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-tl9lx"]
Jul 31 20:51:31.935237 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:51:31.935186    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8760024d-c568-49b0-b27e-9222bef63444" path="/var/lib/kubelet/pods/8760024d-c568-49b0-b27e-9222bef63444/volumes"
Jul 31 20:52:30.354451 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.354369    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"]
Jul 31 20:52:30.354911 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.354721    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbf7038-555a-4aaf-8ac6-14128d9f3b4b" containerName="cleanup"
Jul 31 20:52:30.354911 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.354733    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbf7038-555a-4aaf-8ac6-14128d9f3b4b" containerName="cleanup"
Jul 31 20:52:30.354911 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.354743    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8760024d-c568-49b0-b27e-9222bef63444" containerName="manager"
Jul 31 20:52:30.354911 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.354753    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8760024d-c568-49b0-b27e-9222bef63444" containerName="manager"
Jul 31 20:52:30.354911 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.354852    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bbf7038-555a-4aaf-8ac6-14128d9f3b4b" containerName="cleanup"
Jul 31 20:52:30.354911 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.354862    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8760024d-c568-49b0-b27e-9222bef63444" containerName="manager"
Jul 31 20:52:30.357699 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.357682    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"
Jul 31 20:52:30.360348 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.360331    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x6hqm\""
Jul 31 20:52:30.367748 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.367726    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"]
Jul 31 20:52:30.441658 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.441619    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c9379ac-9c05-4445-9f14-6318a014aa34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-whdc4\" (UID: \"7c9379ac-9c05-4445-9f14-6318a014aa34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"
Jul 31 20:52:30.441658 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.441659    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz8nh\" (UniqueName: \"kubernetes.io/projected/7c9379ac-9c05-4445-9f14-6318a014aa34-kube-api-access-tz8nh\") pod \"kuadrant-operator-controller-manager-68cf589589-whdc4\" (UID: \"7c9379ac-9c05-4445-9f14-6318a014aa34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"
Jul 31 20:52:30.542964 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.542920    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c9379ac-9c05-4445-9f14-6318a014aa34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-whdc4\" (UID: \"7c9379ac-9c05-4445-9f14-6318a014aa34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"
Jul 31 20:52:30.542964 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.542965    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz8nh\" (UniqueName: \"kubernetes.io/projected/7c9379ac-9c05-4445-9f14-6318a014aa34-kube-api-access-tz8nh\") pod \"kuadrant-operator-controller-manager-68cf589589-whdc4\" (UID: \"7c9379ac-9c05-4445-9f14-6318a014aa34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"
Jul 31 20:52:30.543369 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.543351    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c9379ac-9c05-4445-9f14-6318a014aa34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-whdc4\" (UID: \"7c9379ac-9c05-4445-9f14-6318a014aa34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"
Jul 31 20:52:30.553736 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.553709    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz8nh\" (UniqueName: \"kubernetes.io/projected/7c9379ac-9c05-4445-9f14-6318a014aa34-kube-api-access-tz8nh\") pod \"kuadrant-operator-controller-manager-68cf589589-whdc4\" (UID: \"7c9379ac-9c05-4445-9f14-6318a014aa34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"
Jul 31 20:52:30.668324 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.668232    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"
Jul 31 20:52:30.809129 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:30.809103    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"]
Jul 31 20:52:30.811340 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:52:30.811313    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c9379ac_9c05_4445_9f14_6318a014aa34.slice/crio-d01e713e358f2311ca4cb24283199f4fc3359c06a00d2834b66707203c5a08c9 WatchSource:0}: Error finding container d01e713e358f2311ca4cb24283199f4fc3359c06a00d2834b66707203c5a08c9: Status 404 returned error can't find the container with id d01e713e358f2311ca4cb24283199f4fc3359c06a00d2834b66707203c5a08c9
Jul 31 20:52:31.057233 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:31.057195    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4" event={"ID":"7c9379ac-9c05-4445-9f14-6318a014aa34","Type":"ContainerStarted","Data":"42bd8bd5501735a68d0633b74af31d251a458f32cebefd590e17f514b6bbf7a5"}
Jul 31 20:52:31.057437 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:31.057248    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4" event={"ID":"7c9379ac-9c05-4445-9f14-6318a014aa34","Type":"ContainerStarted","Data":"d01e713e358f2311ca4cb24283199f4fc3359c06a00d2834b66707203c5a08c9"}
Jul 31 20:52:31.057437 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:31.057290    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"
Jul 31 20:52:31.079544 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:31.079487    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4" podStartSLOduration=1.079469682 podStartE2EDuration="1.079469682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:52:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:52:31.078076242 +0000 UTC m=+1355.683468717" watchObservedRunningTime="2026-07-31 20:52:31.079469682 +0000 UTC m=+1355.684862158"
Jul 31 20:52:42.063738 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:52:42.063705    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"
Jul 31 20:55:23.583377 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.583293    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"]
Jul 31 20:55:23.586923 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.586904    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.589586 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.589567    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-9b26ca44-kserve-self-signed-certs\""
Jul 31 20:55:23.600477 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.600454    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"]
Jul 31 20:55:23.630100 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.630063    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-dshm\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.630100 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.630100    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/923ac793-25d7-4cc2-9252-e3e53f9f87d1-tls-certs\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.630344 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.630135    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-tmp-dir\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.630344 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.630214    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-model-cache\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.630344 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.630304    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvvkm\" (UniqueName: \"kubernetes.io/projected/923ac793-25d7-4cc2-9252-e3e53f9f87d1-kube-api-access-gvvkm\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.630344 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.630342    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-home\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.731752 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.731705    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-home\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.731962 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.731778    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-dshm\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.731962 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.731800    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/923ac793-25d7-4cc2-9252-e3e53f9f87d1-tls-certs\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.731962 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.731853    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-tmp-dir\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.731962 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.731879    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-model-cache\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.731962 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.731928    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvvkm\" (UniqueName: \"kubernetes.io/projected/923ac793-25d7-4cc2-9252-e3e53f9f87d1-kube-api-access-gvvkm\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.732311 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.732283    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-home\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.732404 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.732378    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-tmp-dir\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.732505 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.732479    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-model-cache\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.734568 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.734543    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-dshm\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.734699 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.734683    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/923ac793-25d7-4cc2-9252-e3e53f9f87d1-tls-certs\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.739770 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.739746    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvvkm\" (UniqueName: \"kubernetes.io/projected/923ac793-25d7-4cc2-9252-e3e53f9f87d1-kube-api-access-gvvkm\") pod \"e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") " pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:23.896392 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:23.896305    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:24.042828 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:24.042793    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"]
Jul 31 20:55:24.045827 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:55:24.045797    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod923ac793_25d7_4cc2_9252_e3e53f9f87d1.slice/crio-6ee048ec75433a8866d97809e65db0777c20d5e7899b1446ee87a72ba0244f26 WatchSource:0}: Error finding container 6ee048ec75433a8866d97809e65db0777c20d5e7899b1446ee87a72ba0244f26: Status 404 returned error can't find the container with id 6ee048ec75433a8866d97809e65db0777c20d5e7899b1446ee87a72ba0244f26
Jul 31 20:55:24.865285 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:24.865243    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv" event={"ID":"923ac793-25d7-4cc2-9252-e3e53f9f87d1","Type":"ContainerStarted","Data":"3630fcfb5af7b3010e4d56da681e54a6493c706a587c8438c10dbe8583b8fb16"}
Jul 31 20:55:24.865678 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:24.865292    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv" event={"ID":"923ac793-25d7-4cc2-9252-e3e53f9f87d1","Type":"ContainerStarted","Data":"6ee048ec75433a8866d97809e65db0777c20d5e7899b1446ee87a72ba0244f26"}
Jul 31 20:55:24.881822 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:24.881768    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv" podStartSLOduration=1.881751612 podStartE2EDuration="1.881751612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:55:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:55:24.880881517 +0000 UTC m=+1529.486274000" watchObservedRunningTime="2026-07-31 20:55:24.881751612 +0000 UTC m=+1529.487144117"
Jul 31 20:55:33.897078 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:33.896976    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:33.897078 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:33.897032    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:33.909471 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:33.909442    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:33.920842 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:33.920817    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:55:41.385564 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.385533    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"]
Jul 31 20:55:41.389274 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.389255    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.392323 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.392297    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-9b26ca44-kserve-self-signed-certs\""
Jul 31 20:55:41.400203 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.400178    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"]
Jul 31 20:55:41.489046 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.489013    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-model-cache\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.489248 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.489079    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a61361c1-95f5-4a71-b3ee-3920861299d2-tls-certs\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.489248 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.489108    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-home\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.489248 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.489130    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-tmp-dir\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.489248 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.489221    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-dshm\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.489389 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.489279    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r826w\" (UniqueName: \"kubernetes.io/projected/a61361c1-95f5-4a71-b3ee-3920861299d2-kube-api-access-r826w\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.590558 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.590521    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-model-cache\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.590774 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.590586    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a61361c1-95f5-4a71-b3ee-3920861299d2-tls-certs\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.590774 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.590606    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-home\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.590774 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.590628    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-tmp-dir\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.590774 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.590660    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-dshm\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.590774 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.590684    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r826w\" (UniqueName: \"kubernetes.io/projected/a61361c1-95f5-4a71-b3ee-3920861299d2-kube-api-access-r826w\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.591043 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.591018    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-model-cache\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.591088 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.591064    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-tmp-dir\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.591129 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.591064    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-home\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.593217 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.593195    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-dshm\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.593395 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.593380    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a61361c1-95f5-4a71-b3ee-3920861299d2-tls-certs\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.599250 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.599226    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r826w\" (UniqueName: \"kubernetes.io/projected/a61361c1-95f5-4a71-b3ee-3920861299d2-kube-api-access-r826w\") pod \"e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") " pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.700605 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.700506    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:41.839495 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.839459    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"]
Jul 31 20:55:41.843086 ip-10-0-132-89 kubenswrapper[2566]: W0731 20:55:41.843035    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda61361c1_95f5_4a71_b3ee_3920861299d2.slice/crio-e7bf108cd6b8d5738bb9fe3db7b4cb5226b478b9d2e99f33a1b445215f7fb176 WatchSource:0}: Error finding container e7bf108cd6b8d5738bb9fe3db7b4cb5226b478b9d2e99f33a1b445215f7fb176: Status 404 returned error can't find the container with id e7bf108cd6b8d5738bb9fe3db7b4cb5226b478b9d2e99f33a1b445215f7fb176
Jul 31 20:55:41.946030 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.945989    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5" event={"ID":"a61361c1-95f5-4a71-b3ee-3920861299d2","Type":"ContainerStarted","Data":"7546289ca728dc65e07ca850ffd028d5e1bd7418c32f87d3add1b15adc429692"}
Jul 31 20:55:41.946198 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.946040    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5" event={"ID":"a61361c1-95f5-4a71-b3ee-3920861299d2","Type":"ContainerStarted","Data":"e7bf108cd6b8d5738bb9fe3db7b4cb5226b478b9d2e99f33a1b445215f7fb176"}
Jul 31 20:55:41.962884 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:41.962783    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5" podStartSLOduration=0.962764655 podStartE2EDuration="962.764655ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 20:55:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 20:55:41.961787069 +0000 UTC m=+1546.567179545" watchObservedRunningTime="2026-07-31 20:55:41.962764655 +0000 UTC m=+1546.568157130"
Jul 31 20:55:51.701479 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:51.701434    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:51.701479 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:51.701491    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:51.714303 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:51.714276    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:55:52.005620 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:55:52.005538    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:56:00.366176 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:00.366124    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"]
Jul 31 20:56:01.990605 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:01.990564    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"]
Jul 31 20:56:15.388059 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.387995    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv" podUID="923ac793-25d7-4cc2-9252-e3e53f9f87d1" containerName="main" containerID="cri-o://3630fcfb5af7b3010e4d56da681e54a6493c706a587c8438c10dbe8583b8fb16" gracePeriod=45
Jul 31 20:56:15.651891 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.651820    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:56:15.702223 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.702184    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-dshm\") pod \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") "
Jul 31 20:56:15.702223 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.702225    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/923ac793-25d7-4cc2-9252-e3e53f9f87d1-tls-certs\") pod \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") "
Jul 31 20:56:15.702476 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.702289    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvvkm\" (UniqueName: \"kubernetes.io/projected/923ac793-25d7-4cc2-9252-e3e53f9f87d1-kube-api-access-gvvkm\") pod \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") "
Jul 31 20:56:15.702476 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.702318    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-tmp-dir\") pod \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") "
Jul 31 20:56:15.702476 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.702338    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-home\") pod \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") "
Jul 31 20:56:15.702476 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.702390    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-model-cache\") pod \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\" (UID: \"923ac793-25d7-4cc2-9252-e3e53f9f87d1\") "
Jul 31 20:56:15.702672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.702621    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "923ac793-25d7-4cc2-9252-e3e53f9f87d1" (UID: "923ac793-25d7-4cc2-9252-e3e53f9f87d1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:56:15.702672 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.702656    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-home" (OuterVolumeSpecName: "home") pod "923ac793-25d7-4cc2-9252-e3e53f9f87d1" (UID: "923ac793-25d7-4cc2-9252-e3e53f9f87d1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:56:15.702786 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.702756    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-model-cache" (OuterVolumeSpecName: "model-cache") pod "923ac793-25d7-4cc2-9252-e3e53f9f87d1" (UID: "923ac793-25d7-4cc2-9252-e3e53f9f87d1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:56:15.704642 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.704616    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-dshm" (OuterVolumeSpecName: "dshm") pod "923ac793-25d7-4cc2-9252-e3e53f9f87d1" (UID: "923ac793-25d7-4cc2-9252-e3e53f9f87d1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:56:15.704761 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.704619    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/923ac793-25d7-4cc2-9252-e3e53f9f87d1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "923ac793-25d7-4cc2-9252-e3e53f9f87d1" (UID: "923ac793-25d7-4cc2-9252-e3e53f9f87d1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:56:15.704761 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.704651    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/923ac793-25d7-4cc2-9252-e3e53f9f87d1-kube-api-access-gvvkm" (OuterVolumeSpecName: "kube-api-access-gvvkm") pod "923ac793-25d7-4cc2-9252-e3e53f9f87d1" (UID: "923ac793-25d7-4cc2-9252-e3e53f9f87d1"). InnerVolumeSpecName "kube-api-access-gvvkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:56:15.803557 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.803516    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-model-cache\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:56:15.803557 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.803553    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-dshm\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:56:15.803557 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.803569    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/923ac793-25d7-4cc2-9252-e3e53f9f87d1-tls-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:56:15.803792 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.803582    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvvkm\" (UniqueName: \"kubernetes.io/projected/923ac793-25d7-4cc2-9252-e3e53f9f87d1-kube-api-access-gvvkm\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:56:15.803792 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.803595    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-tmp-dir\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:56:15.803792 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:15.803607    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/923ac793-25d7-4cc2-9252-e3e53f9f87d1-home\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:56:16.106184 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:16.106126    2566 generic.go:356] "Generic (PLEG): container finished" podID="923ac793-25d7-4cc2-9252-e3e53f9f87d1" containerID="3630fcfb5af7b3010e4d56da681e54a6493c706a587c8438c10dbe8583b8fb16" exitCode=0
Jul 31 20:56:16.106184 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:16.106187    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"
Jul 31 20:56:16.106184 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:16.106193    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv" event={"ID":"923ac793-25d7-4cc2-9252-e3e53f9f87d1","Type":"ContainerDied","Data":"3630fcfb5af7b3010e4d56da681e54a6493c706a587c8438c10dbe8583b8fb16"}
Jul 31 20:56:16.106445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:16.106227    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv" event={"ID":"923ac793-25d7-4cc2-9252-e3e53f9f87d1","Type":"ContainerDied","Data":"6ee048ec75433a8866d97809e65db0777c20d5e7899b1446ee87a72ba0244f26"}
Jul 31 20:56:16.106445 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:16.106245    2566 scope.go:117] "RemoveContainer" containerID="3630fcfb5af7b3010e4d56da681e54a6493c706a587c8438c10dbe8583b8fb16"
Jul 31 20:56:16.114955 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:16.114933    2566 scope.go:117] "RemoveContainer" containerID="3630fcfb5af7b3010e4d56da681e54a6493c706a587c8438c10dbe8583b8fb16"
Jul 31 20:56:16.115245 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:56:16.115226    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3630fcfb5af7b3010e4d56da681e54a6493c706a587c8438c10dbe8583b8fb16\": container with ID starting with 3630fcfb5af7b3010e4d56da681e54a6493c706a587c8438c10dbe8583b8fb16 not found: ID does not exist" containerID="3630fcfb5af7b3010e4d56da681e54a6493c706a587c8438c10dbe8583b8fb16"
Jul 31 20:56:16.115305 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:16.115254    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3630fcfb5af7b3010e4d56da681e54a6493c706a587c8438c10dbe8583b8fb16"} err="failed to get container status \"3630fcfb5af7b3010e4d56da681e54a6493c706a587c8438c10dbe8583b8fb16\": rpc error: code = NotFound desc = could not find container \"3630fcfb5af7b3010e4d56da681e54a6493c706a587c8438c10dbe8583b8fb16\": container with ID starting with 3630fcfb5af7b3010e4d56da681e54a6493c706a587c8438c10dbe8583b8fb16 not found: ID does not exist"
Jul 31 20:56:16.122042 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:16.122016    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"]
Jul 31 20:56:16.125808 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:16.125784    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-9b26ca44-kserve-565c8855f5-ptmpv"]
Jul 31 20:56:17.010342 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.010291    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5" podUID="a61361c1-95f5-4a71-b3ee-3920861299d2" containerName="main" containerID="cri-o://7546289ca728dc65e07ca850ffd028d5e1bd7418c32f87d3add1b15adc429692" gracePeriod=45
Jul 31 20:56:17.292906 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.292879    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:56:17.416673 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.416628    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r826w\" (UniqueName: \"kubernetes.io/projected/a61361c1-95f5-4a71-b3ee-3920861299d2-kube-api-access-r826w\") pod \"a61361c1-95f5-4a71-b3ee-3920861299d2\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") "
Jul 31 20:56:17.416673 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.416679    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-model-cache\") pod \"a61361c1-95f5-4a71-b3ee-3920861299d2\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") "
Jul 31 20:56:17.416886 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.416757    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-tmp-dir\") pod \"a61361c1-95f5-4a71-b3ee-3920861299d2\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") "
Jul 31 20:56:17.416886 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.416798    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-home\") pod \"a61361c1-95f5-4a71-b3ee-3920861299d2\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") "
Jul 31 20:56:17.416886 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.416848    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a61361c1-95f5-4a71-b3ee-3920861299d2-tls-certs\") pod \"a61361c1-95f5-4a71-b3ee-3920861299d2\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") "
Jul 31 20:56:17.416886 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.416876    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-dshm\") pod \"a61361c1-95f5-4a71-b3ee-3920861299d2\" (UID: \"a61361c1-95f5-4a71-b3ee-3920861299d2\") "
Jul 31 20:56:17.417088 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.416968    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-model-cache" (OuterVolumeSpecName: "model-cache") pod "a61361c1-95f5-4a71-b3ee-3920861299d2" (UID: "a61361c1-95f5-4a71-b3ee-3920861299d2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:56:17.417088 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.417051    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a61361c1-95f5-4a71-b3ee-3920861299d2" (UID: "a61361c1-95f5-4a71-b3ee-3920861299d2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:56:17.417237 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.417115    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-home" (OuterVolumeSpecName: "home") pod "a61361c1-95f5-4a71-b3ee-3920861299d2" (UID: "a61361c1-95f5-4a71-b3ee-3920861299d2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:56:17.417237 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.417213    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-model-cache\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:56:17.417237 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.417227    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-tmp-dir\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:56:17.417237 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.417235    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-home\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:56:17.419045 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.419016    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a61361c1-95f5-4a71-b3ee-3920861299d2-kube-api-access-r826w" (OuterVolumeSpecName: "kube-api-access-r826w") pod "a61361c1-95f5-4a71-b3ee-3920861299d2" (UID: "a61361c1-95f5-4a71-b3ee-3920861299d2"). InnerVolumeSpecName "kube-api-access-r826w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 20:56:17.419177 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.419141    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-dshm" (OuterVolumeSpecName: "dshm") pod "a61361c1-95f5-4a71-b3ee-3920861299d2" (UID: "a61361c1-95f5-4a71-b3ee-3920861299d2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 20:56:17.419246 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.419208    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a61361c1-95f5-4a71-b3ee-3920861299d2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a61361c1-95f5-4a71-b3ee-3920861299d2" (UID: "a61361c1-95f5-4a71-b3ee-3920861299d2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 20:56:17.518293 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.518248    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a61361c1-95f5-4a71-b3ee-3920861299d2-tls-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:56:17.518293 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.518280    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a61361c1-95f5-4a71-b3ee-3920861299d2-dshm\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:56:17.518293 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.518290    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r826w\" (UniqueName: \"kubernetes.io/projected/a61361c1-95f5-4a71-b3ee-3920861299d2-kube-api-access-r826w\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 20:56:17.935139 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:17.935097    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="923ac793-25d7-4cc2-9252-e3e53f9f87d1" path="/var/lib/kubelet/pods/923ac793-25d7-4cc2-9252-e3e53f9f87d1/volumes"
Jul 31 20:56:18.116982 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:18.116950    2566 generic.go:356] "Generic (PLEG): container finished" podID="a61361c1-95f5-4a71-b3ee-3920861299d2" containerID="7546289ca728dc65e07ca850ffd028d5e1bd7418c32f87d3add1b15adc429692" exitCode=0
Jul 31 20:56:18.116982 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:18.116996    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"
Jul 31 20:56:18.117515 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:18.117045    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5" event={"ID":"a61361c1-95f5-4a71-b3ee-3920861299d2","Type":"ContainerDied","Data":"7546289ca728dc65e07ca850ffd028d5e1bd7418c32f87d3add1b15adc429692"}
Jul 31 20:56:18.117515 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:18.117095    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5" event={"ID":"a61361c1-95f5-4a71-b3ee-3920861299d2","Type":"ContainerDied","Data":"e7bf108cd6b8d5738bb9fe3db7b4cb5226b478b9d2e99f33a1b445215f7fb176"}
Jul 31 20:56:18.117515 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:18.117118    2566 scope.go:117] "RemoveContainer" containerID="7546289ca728dc65e07ca850ffd028d5e1bd7418c32f87d3add1b15adc429692"
Jul 31 20:56:18.125577 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:18.125556    2566 scope.go:117] "RemoveContainer" containerID="7546289ca728dc65e07ca850ffd028d5e1bd7418c32f87d3add1b15adc429692"
Jul 31 20:56:18.125832 ip-10-0-132-89 kubenswrapper[2566]: E0731 20:56:18.125814    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7546289ca728dc65e07ca850ffd028d5e1bd7418c32f87d3add1b15adc429692\": container with ID starting with 7546289ca728dc65e07ca850ffd028d5e1bd7418c32f87d3add1b15adc429692 not found: ID does not exist" containerID="7546289ca728dc65e07ca850ffd028d5e1bd7418c32f87d3add1b15adc429692"
Jul 31 20:56:18.125888 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:18.125844    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7546289ca728dc65e07ca850ffd028d5e1bd7418c32f87d3add1b15adc429692"} err="failed to get container status \"7546289ca728dc65e07ca850ffd028d5e1bd7418c32f87d3add1b15adc429692\": rpc error: code = NotFound desc = could not find container \"7546289ca728dc65e07ca850ffd028d5e1bd7418c32f87d3add1b15adc429692\": container with ID starting with 7546289ca728dc65e07ca850ffd028d5e1bd7418c32f87d3add1b15adc429692 not found: ID does not exist"
Jul 31 20:56:18.133551 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:18.133523    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"]
Jul 31 20:56:18.139267 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:18.139240    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-9b26ca44-kserve-f48d9779-42jl5"]
Jul 31 20:56:19.934917 ip-10-0-132-89 kubenswrapper[2566]: I0731 20:56:19.934876    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a61361c1-95f5-4a71-b3ee-3920861299d2" path="/var/lib/kubelet/pods/a61361c1-95f5-4a71-b3ee-3920861299d2/volumes"
Jul 31 21:00:00.132521 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:00.132482    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758860-wrrz9"]
Jul 31 21:00:00.133074 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:00.132857    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="923ac793-25d7-4cc2-9252-e3e53f9f87d1" containerName="main"
Jul 31 21:00:00.133074 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:00.132869    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="923ac793-25d7-4cc2-9252-e3e53f9f87d1" containerName="main"
Jul 31 21:00:00.133074 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:00.132886    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a61361c1-95f5-4a71-b3ee-3920861299d2" containerName="main"
Jul 31 21:00:00.133074 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:00.132891    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a61361c1-95f5-4a71-b3ee-3920861299d2" containerName="main"
Jul 31 21:00:00.133074 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:00.132949    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="923ac793-25d7-4cc2-9252-e3e53f9f87d1" containerName="main"
Jul 31 21:00:00.133074 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:00.132957    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a61361c1-95f5-4a71-b3ee-3920861299d2" containerName="main"
Jul 31 21:00:00.135923 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:00.135897    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758860-wrrz9"
Jul 31 21:00:00.138334 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:00.138311    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:00:00.145653 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:00.145630    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758860-wrrz9"
Jul 31 21:00:00.152196 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:00.152119    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758860-wrrz9"]
Jul 31 21:00:00.287801 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:00.287758    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758860-wrrz9"]
Jul 31 21:00:01.177752 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:01.177696    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758860-wrrz9" event={"ID":"a533afe9-86c0-4e7c-ad37-706cfd563254","Type":"ContainerStarted","Data":"1a2be21a6b595fd1930401749da094f18a80720eb08676721ff1e88b85521af4"}
Jul 31 21:00:01.178207 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:01.177790    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758860-wrrz9" event={"ID":"a533afe9-86c0-4e7c-ad37-706cfd563254","Type":"ContainerStarted","Data":"f6bd83a36d4011edb0f382f4a8aeb4240e6d6f228f555ef248c468007b65b151"}
Jul 31 21:00:01.194475 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:01.194405    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758860-wrrz9" podStartSLOduration=1.194377065 podStartE2EDuration="1.194377065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:00:01.192652938 +0000 UTC m=+1805.798045440" watchObservedRunningTime="2026-07-31 21:00:01.194377065 +0000 UTC m=+1805.799769559"
Jul 31 21:00:02.183980 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:02.183928    2566 generic.go:356] "Generic (PLEG): container finished" podID="a533afe9-86c0-4e7c-ad37-706cfd563254" containerID="1a2be21a6b595fd1930401749da094f18a80720eb08676721ff1e88b85521af4" exitCode=0
Jul 31 21:00:02.184434 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:02.184013    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758860-wrrz9" event={"ID":"a533afe9-86c0-4e7c-ad37-706cfd563254","Type":"ContainerDied","Data":"1a2be21a6b595fd1930401749da094f18a80720eb08676721ff1e88b85521af4"}
Jul 31 21:00:03.326965 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.326933    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758860-wrrz9"
Jul 31 21:00:03.595100 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.595057    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"]
Jul 31 21:00:03.595442 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.595429    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a533afe9-86c0-4e7c-ad37-706cfd563254" containerName="cleanup"
Jul 31 21:00:03.595486 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.595444    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a533afe9-86c0-4e7c-ad37-706cfd563254" containerName="cleanup"
Jul 31 21:00:03.595520 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.595505    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a533afe9-86c0-4e7c-ad37-706cfd563254" containerName="cleanup"
Jul 31 21:00:03.598481 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.598461    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.601345 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.601323    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c5bdfd41-openshift-default-dockercfg-tlx7l\""
Jul 31 21:00:03.631901 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.631862    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"]
Jul 31 21:00:03.670377 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.670338    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/623958b5-00b3-43a8-a265-149811d9e946-istio-podinfo\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.670543 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.670385    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-istio-data\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.670543 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.670427    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvt7r\" (UniqueName: \"kubernetes.io/projected/623958b5-00b3-43a8-a265-149811d9e946-kube-api-access-bvt7r\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.670543 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.670461    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/623958b5-00b3-43a8-a265-149811d9e946-istiod-ca-cert\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.670543 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.670507    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/623958b5-00b3-43a8-a265-149811d9e946-istio-token\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.670734 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.670543    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-credential-socket\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.670734 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.670574    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-istio-envoy\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.670734 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.670595    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-workload-socket\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.670734 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.670612    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-workload-certs\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.771364 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.771325    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvt7r\" (UniqueName: \"kubernetes.io/projected/623958b5-00b3-43a8-a265-149811d9e946-kube-api-access-bvt7r\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.771364 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.771371    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/623958b5-00b3-43a8-a265-149811d9e946-istiod-ca-cert\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.771634 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.771391    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/623958b5-00b3-43a8-a265-149811d9e946-istio-token\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.771634 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.771478    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-credential-socket\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.771634 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.771529    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-istio-envoy\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.771634 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.771551    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-workload-socket\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.771634 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.771571    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-workload-certs\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.771870 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.771644    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/623958b5-00b3-43a8-a265-149811d9e946-istio-podinfo\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.771870 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.771688    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-istio-data\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.771870 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.771822    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-credential-socket\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.772009 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.771994    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-istio-data\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.772116 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.772091    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-workload-certs\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.772207 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.772100    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-workload-socket\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.772207 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.772141    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/623958b5-00b3-43a8-a265-149811d9e946-istiod-ca-cert\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.774018 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.773991    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-istio-envoy\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.774250 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.774232    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/623958b5-00b3-43a8-a265-149811d9e946-istio-podinfo\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.780803 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.780778    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/623958b5-00b3-43a8-a265-149811d9e946-istio-token\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.781033 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.780988    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvt7r\" (UniqueName: \"kubernetes.io/projected/623958b5-00b3-43a8-a265-149811d9e946-kube-api-access-bvt7r\") pod \"e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") " pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:03.909363 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:03.909268    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:04.055469 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:04.055436    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"]
Jul 31 21:00:04.058566 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:00:04.058538    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623958b5_00b3_43a8_a265_149811d9e946.slice/crio-6df01a97349aa492509af5c02c78565151e33b7491186b26451783950977f8fc WatchSource:0}: Error finding container 6df01a97349aa492509af5c02c78565151e33b7491186b26451783950977f8fc: Status 404 returned error can't find the container with id 6df01a97349aa492509af5c02c78565151e33b7491186b26451783950977f8fc
Jul 31 21:00:04.060782 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:04.060751    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:00:04.060891 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:04.060835    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:00:04.060891 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:04.060878    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:00:04.195776 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:04.195676    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x" event={"ID":"623958b5-00b3-43a8-a265-149811d9e946","Type":"ContainerStarted","Data":"9123071cf99941cc2901568b3cdef83054c7f804a00a00c054d02ed8842ec441"}
Jul 31 21:00:04.195776 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:04.195753    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x" event={"ID":"623958b5-00b3-43a8-a265-149811d9e946","Type":"ContainerStarted","Data":"6df01a97349aa492509af5c02c78565151e33b7491186b26451783950977f8fc"}
Jul 31 21:00:04.197193 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:04.197167    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758860-wrrz9" event={"ID":"a533afe9-86c0-4e7c-ad37-706cfd563254","Type":"ContainerDied","Data":"f6bd83a36d4011edb0f382f4a8aeb4240e6d6f228f555ef248c468007b65b151"}
Jul 31 21:00:04.197354 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:04.197218    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6bd83a36d4011edb0f382f4a8aeb4240e6d6f228f555ef248c468007b65b151"
Jul 31 21:00:04.197354 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:04.197173    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758860-wrrz9"
Jul 31 21:00:04.213686 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:04.213436    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x" podStartSLOduration=1.213415494 podStartE2EDuration="1.213415494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:00:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:00:04.213101101 +0000 UTC m=+1808.818493578" watchObservedRunningTime="2026-07-31 21:00:04.213415494 +0000 UTC m=+1808.818807972"
Jul 31 21:00:04.909523 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:04.909481    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:05.914639 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:05.914611    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:06.209229 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:06.209116    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:06.210233 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:06.210205    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:07.245075 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:07.245034    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"]
Jul 31 21:00:07.248949 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:07.248923    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"
Jul 31 21:00:07.251531 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:07.251510    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c5bdfd41-dockercfg-t4mlx\""
Jul 31 21:00:07.251638 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:07.251518    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c5bdfd41\""
Jul 31 21:00:07.260628 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:07.260603    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"]
Jul 31 21:00:07.302358 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:07.302327    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnmnf\" (UniqueName: \"kubernetes.io/projected/6adb04cd-5127-4e19-bd0f-93e88e176c42-kube-api-access-xnmnf\") pod \"payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w\" (UID: \"6adb04cd-5127-4e19-bd0f-93e88e176c42\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"
Jul 31 21:00:07.302503 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:07.302378    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6adb04cd-5127-4e19-bd0f-93e88e176c42-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w\" (UID: \"6adb04cd-5127-4e19-bd0f-93e88e176c42\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"
Jul 31 21:00:07.403951 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:07.403914    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnmnf\" (UniqueName: \"kubernetes.io/projected/6adb04cd-5127-4e19-bd0f-93e88e176c42-kube-api-access-xnmnf\") pod \"payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w\" (UID: \"6adb04cd-5127-4e19-bd0f-93e88e176c42\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"
Jul 31 21:00:07.404174 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:07.403969    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6adb04cd-5127-4e19-bd0f-93e88e176c42-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w\" (UID: \"6adb04cd-5127-4e19-bd0f-93e88e176c42\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"
Jul 31 21:00:07.404668 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:07.404650    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6adb04cd-5127-4e19-bd0f-93e88e176c42-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w\" (UID: \"6adb04cd-5127-4e19-bd0f-93e88e176c42\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"
Jul 31 21:00:07.411746 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:07.411707    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnmnf\" (UniqueName: \"kubernetes.io/projected/6adb04cd-5127-4e19-bd0f-93e88e176c42-kube-api-access-xnmnf\") pod \"payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w\" (UID: \"6adb04cd-5127-4e19-bd0f-93e88e176c42\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"
Jul 31 21:00:07.560326 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:07.560278    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"
Jul 31 21:00:07.697755 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:07.697725    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"]
Jul 31 21:00:07.699770 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:00:07.699740    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6adb04cd_5127_4e19_bd0f_93e88e176c42.slice/crio-cab4c63ea1aef1e0391a71dc180980b574d272b7caedf7d92506eed7d7365fd4 WatchSource:0}: Error finding container cab4c63ea1aef1e0391a71dc180980b574d272b7caedf7d92506eed7d7365fd4: Status 404 returned error can't find the container with id cab4c63ea1aef1e0391a71dc180980b574d272b7caedf7d92506eed7d7365fd4
Jul 31 21:00:08.219705 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:08.219663    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w" event={"ID":"6adb04cd-5127-4e19-bd0f-93e88e176c42","Type":"ContainerStarted","Data":"10dccabbe22f9b4eea29fc4dffd6c0491c93a651e958c70caea2f16993ef9c68"}
Jul 31 21:00:08.219881 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:08.219720    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w" event={"ID":"6adb04cd-5127-4e19-bd0f-93e88e176c42","Type":"ContainerStarted","Data":"cab4c63ea1aef1e0391a71dc180980b574d272b7caedf7d92506eed7d7365fd4"}
Jul 31 21:00:08.219984 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:08.219966    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"
Jul 31 21:00:08.236774 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:08.236702    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w" podStartSLOduration=1.236680943 podStartE2EDuration="1.236680943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:00:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:00:08.233985379 +0000 UTC m=+1812.839377856" watchObservedRunningTime="2026-07-31 21:00:08.236680943 +0000 UTC m=+1812.842073419"
Jul 31 21:00:19.227921 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:19.227886    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"
Jul 31 21:00:20.288462 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:20.288365    2566 generic.go:356] "Generic (PLEG): container finished" podID="623958b5-00b3-43a8-a265-149811d9e946" containerID="9123071cf99941cc2901568b3cdef83054c7f804a00a00c054d02ed8842ec441" exitCode=0
Jul 31 21:00:20.288462 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:20.288443    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x" event={"ID":"623958b5-00b3-43a8-a265-149811d9e946","Type":"ContainerDied","Data":"9123071cf99941cc2901568b3cdef83054c7f804a00a00c054d02ed8842ec441"}
Jul 31 21:00:20.288961 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:20.288840    2566 scope.go:117] "RemoveContainer" containerID="9123071cf99941cc2901568b3cdef83054c7f804a00a00c054d02ed8842ec441"
Jul 31 21:00:20.289922 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:20.289895    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:00:20.289980 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:20.289966    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:00:20.290019 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:20.289995    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:00:21.210070 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:21.210013    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:21.295831 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:21.295798    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x" event={"ID":"623958b5-00b3-43a8-a265-149811d9e946","Type":"ContainerStarted","Data":"b70bb73b84d7724c164eb085e11d7178ede5c4d63f0c0a62b92eac4909ab7f87"}
Jul 31 21:00:21.909875 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:21.909838    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:21.910834 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:21.910806    2566 patch_prober.go:28] interesting pod/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 31 21:00:21.910954 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:21.910856    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x" podUID="623958b5-00b3-43a8-a265-149811d9e946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 31 21:00:22.910420 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:22.910376    2566 patch_prober.go:28] interesting pod/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 31 21:00:22.910835 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:22.910442    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x" podUID="623958b5-00b3-43a8-a265-149811d9e946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 31 21:00:23.909697 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:23.909660    2566 patch_prober.go:28] interesting pod/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 31 21:00:23.909910 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:23.909728    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x" podUID="623958b5-00b3-43a8-a265-149811d9e946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 31 21:00:24.910279 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:24.910243    2566 patch_prober.go:28] interesting pod/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 31 21:00:24.910761 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:24.910296    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x" podUID="623958b5-00b3-43a8-a265-149811d9e946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 31 21:00:25.910497 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:25.910453    2566 patch_prober.go:28] interesting pod/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 31 21:00:25.910987 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:25.910532    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x" podUID="623958b5-00b3-43a8-a265-149811d9e946" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 31 21:00:26.913750 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:26.913716    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:26.914138 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:26.914098    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:26.914696 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:26.914678    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:31.120508 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:31.120476    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp"]
Jul 31 21:00:31.123759 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:31.123739    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp"
Jul 31 21:00:31.126003 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:31.125981    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:00:31.130279 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:31.130255    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp"]
Jul 31 21:00:31.225253 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:31.225204    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72671456-f7a9-4518-9840-b06a74bd791b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp\" (UID: \"72671456-f7a9-4518-9840-b06a74bd791b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp"
Jul 31 21:00:31.326580 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:31.326537    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72671456-f7a9-4518-9840-b06a74bd791b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp\" (UID: \"72671456-f7a9-4518-9840-b06a74bd791b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp"
Jul 31 21:00:31.327244 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:31.327223    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72671456-f7a9-4518-9840-b06a74bd791b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp\" (UID: \"72671456-f7a9-4518-9840-b06a74bd791b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp"
Jul 31 21:00:31.437037 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:31.436947    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp"
Jul 31 21:00:31.575022 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:31.574994    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp"]
Jul 31 21:00:31.576950 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:00:31.576913    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72671456_f7a9_4518_9840_b06a74bd791b.slice/crio-d00a6a9198e9c54ecfb77330cc41ef9d881f9bd928cc72c4d9b398f995d0fd27 WatchSource:0}: Error finding container d00a6a9198e9c54ecfb77330cc41ef9d881f9bd928cc72c4d9b398f995d0fd27: Status 404 returned error can't find the container with id d00a6a9198e9c54ecfb77330cc41ef9d881f9bd928cc72c4d9b398f995d0fd27
Jul 31 21:00:32.350937 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:32.350895    2566 generic.go:356] "Generic (PLEG): container finished" podID="72671456-f7a9-4518-9840-b06a74bd791b" containerID="b8b1b04f87a97fa9cc629144488b3adcaf3bc9724f1a70ec95ae9bcd6853b3a5" exitCode=0
Jul 31 21:00:32.351326 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:32.351031    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp" event={"ID":"72671456-f7a9-4518-9840-b06a74bd791b","Type":"ContainerDied","Data":"b8b1b04f87a97fa9cc629144488b3adcaf3bc9724f1a70ec95ae9bcd6853b3a5"}
Jul 31 21:00:32.351326 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:32.351084    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp" event={"ID":"72671456-f7a9-4518-9840-b06a74bd791b","Type":"ContainerStarted","Data":"d00a6a9198e9c54ecfb77330cc41ef9d881f9bd928cc72c4d9b398f995d0fd27"}
Jul 31 21:00:33.497559 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:33.497530    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp"
Jul 31 21:00:33.650536 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:33.650444    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72671456-f7a9-4518-9840-b06a74bd791b-maas-api-service-ca\") pod \"72671456-f7a9-4518-9840-b06a74bd791b\" (UID: \"72671456-f7a9-4518-9840-b06a74bd791b\") "
Jul 31 21:00:33.650853 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:33.650832    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72671456-f7a9-4518-9840-b06a74bd791b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "72671456-f7a9-4518-9840-b06a74bd791b" (UID: "72671456-f7a9-4518-9840-b06a74bd791b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:00:33.751984 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:33.751945    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72671456-f7a9-4518-9840-b06a74bd791b-maas-api-service-ca\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:00:34.361790 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:34.361760    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp"
Jul 31 21:00:34.361790 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:34.361775    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp" event={"ID":"72671456-f7a9-4518-9840-b06a74bd791b","Type":"ContainerDied","Data":"d00a6a9198e9c54ecfb77330cc41ef9d881f9bd928cc72c4d9b398f995d0fd27"}
Jul 31 21:00:34.362006 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:34.361819    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d00a6a9198e9c54ecfb77330cc41ef9d881f9bd928cc72c4d9b398f995d0fd27"
Jul 31 21:00:37.211671 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:37.211635    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"]
Jul 31 21:00:37.212206 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:37.211896    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w" podUID="6adb04cd-5127-4e19-bd0f-93e88e176c42" containerName="payload-pre-processing" containerID="cri-o://10dccabbe22f9b4eea29fc4dffd6c0491c93a651e958c70caea2f16993ef9c68" gracePeriod=30
Jul 31 21:00:37.348869 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:37.348828    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp"]
Jul 31 21:00:37.353311 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:37.353275    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5bdfd41-zbvbp"]
Jul 31 21:00:37.379597 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:37.379559    2566 generic.go:356] "Generic (PLEG): container finished" podID="6adb04cd-5127-4e19-bd0f-93e88e176c42" containerID="10dccabbe22f9b4eea29fc4dffd6c0491c93a651e958c70caea2f16993ef9c68" exitCode=0
Jul 31 21:00:37.379763 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:37.379646    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w" event={"ID":"6adb04cd-5127-4e19-bd0f-93e88e176c42","Type":"ContainerDied","Data":"10dccabbe22f9b4eea29fc4dffd6c0491c93a651e958c70caea2f16993ef9c68"}
Jul 31 21:00:37.477674 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:37.476995    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"]
Jul 31 21:00:37.477674 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:37.477265    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x" podUID="623958b5-00b3-43a8-a265-149811d9e946" containerName="istio-proxy" containerID="cri-o://b70bb73b84d7724c164eb085e11d7178ede5c4d63f0c0a62b92eac4909ab7f87" gracePeriod=30
Jul 31 21:00:37.491364 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:37.491333    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"
Jul 31 21:00:37.587454 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:37.587423    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnmnf\" (UniqueName: \"kubernetes.io/projected/6adb04cd-5127-4e19-bd0f-93e88e176c42-kube-api-access-xnmnf\") pod \"6adb04cd-5127-4e19-bd0f-93e88e176c42\" (UID: \"6adb04cd-5127-4e19-bd0f-93e88e176c42\") "
Jul 31 21:00:37.587667 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:37.587509    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6adb04cd-5127-4e19-bd0f-93e88e176c42-plugins-config-volume\") pod \"6adb04cd-5127-4e19-bd0f-93e88e176c42\" (UID: \"6adb04cd-5127-4e19-bd0f-93e88e176c42\") "
Jul 31 21:00:37.587883 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:37.587855    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6adb04cd-5127-4e19-bd0f-93e88e176c42-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6adb04cd-5127-4e19-bd0f-93e88e176c42" (UID: "6adb04cd-5127-4e19-bd0f-93e88e176c42"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:00:37.589816 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:37.589796    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6adb04cd-5127-4e19-bd0f-93e88e176c42-kube-api-access-xnmnf" (OuterVolumeSpecName: "kube-api-access-xnmnf") pod "6adb04cd-5127-4e19-bd0f-93e88e176c42" (UID: "6adb04cd-5127-4e19-bd0f-93e88e176c42"). InnerVolumeSpecName "kube-api-access-xnmnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:00:37.688901 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:37.688862    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6adb04cd-5127-4e19-bd0f-93e88e176c42-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:00:37.688901 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:37.688895    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnmnf\" (UniqueName: \"kubernetes.io/projected/6adb04cd-5127-4e19-bd0f-93e88e176c42-kube-api-access-xnmnf\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:00:37.935505 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:37.935470    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72671456-f7a9-4518-9840-b06a74bd791b" path="/var/lib/kubelet/pods/72671456-f7a9-4518-9840-b06a74bd791b/volumes"
Jul 31 21:00:38.385504 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:38.385464    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w" event={"ID":"6adb04cd-5127-4e19-bd0f-93e88e176c42","Type":"ContainerDied","Data":"cab4c63ea1aef1e0391a71dc180980b574d272b7caedf7d92506eed7d7365fd4"}
Jul 31 21:00:38.385504 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:38.385483    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"
Jul 31 21:00:38.386035 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:38.385550    2566 scope.go:117] "RemoveContainer" containerID="10dccabbe22f9b4eea29fc4dffd6c0491c93a651e958c70caea2f16993ef9c68"
Jul 31 21:00:38.403252 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:38.403216    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"]
Jul 31 21:00:38.404876 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:38.404853    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c5bdfd41-677dc6d9f6-vgr9w"]
Jul 31 21:00:39.937083 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:39.937042    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6adb04cd-5127-4e19-bd0f-93e88e176c42" path="/var/lib/kubelet/pods/6adb04cd-5127-4e19-bd0f-93e88e176c42/volumes"
Jul 31 21:00:41.370768 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.370727    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"]
Jul 31 21:00:41.371230 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.371079    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72671456-f7a9-4518-9840-b06a74bd791b" containerName="revoke-keys"
Jul 31 21:00:41.371230 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.371089    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="72671456-f7a9-4518-9840-b06a74bd791b" containerName="revoke-keys"
Jul 31 21:00:41.371230 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.371098    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6adb04cd-5127-4e19-bd0f-93e88e176c42" containerName="payload-pre-processing"
Jul 31 21:00:41.371230 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.371103    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6adb04cd-5127-4e19-bd0f-93e88e176c42" containerName="payload-pre-processing"
Jul 31 21:00:41.371388 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.371253    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6adb04cd-5127-4e19-bd0f-93e88e176c42" containerName="payload-pre-processing"
Jul 31 21:00:41.371388 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.371265    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="72671456-f7a9-4518-9840-b06a74bd791b" containerName="revoke-keys"
Jul 31 21:00:41.375590 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.375569    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"
Jul 31 21:00:41.378108 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.378070    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-337fe245\""
Jul 31 21:00:41.378249 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.378081    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-337fe245-dockercfg-khjn9\""
Jul 31 21:00:41.381901 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.381872    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"]
Jul 31 21:00:41.405483 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.405447    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"]
Jul 31 21:00:41.408809 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.408784    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"
Jul 31 21:00:41.420520 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.420490    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"]
Jul 31 21:00:41.524753 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.524701    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqbxc\" (UniqueName: \"kubernetes.io/projected/b2d8999d-c644-4658-bb69-415a49b2a69e-kube-api-access-gqbxc\") pod \"payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd\" (UID: \"b2d8999d-c644-4658-bb69-415a49b2a69e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"
Jul 31 21:00:41.524912 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.524793    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw59h\" (UniqueName: \"kubernetes.io/projected/7346af3a-c73d-4d11-9f56-35f8b050d439-kube-api-access-mw59h\") pod \"payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc\" (UID: \"7346af3a-c73d-4d11-9f56-35f8b050d439\") " pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"
Jul 31 21:00:41.524912 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.524813    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d8999d-c644-4658-bb69-415a49b2a69e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd\" (UID: \"b2d8999d-c644-4658-bb69-415a49b2a69e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"
Jul 31 21:00:41.524912 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.524851    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7346af3a-c73d-4d11-9f56-35f8b050d439-plugins-config-volume\") pod \"payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc\" (UID: \"7346af3a-c73d-4d11-9f56-35f8b050d439\") " pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"
Jul 31 21:00:41.626385 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.626290    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7346af3a-c73d-4d11-9f56-35f8b050d439-plugins-config-volume\") pod \"payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc\" (UID: \"7346af3a-c73d-4d11-9f56-35f8b050d439\") " pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"
Jul 31 21:00:41.626385 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.626342    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqbxc\" (UniqueName: \"kubernetes.io/projected/b2d8999d-c644-4658-bb69-415a49b2a69e-kube-api-access-gqbxc\") pod \"payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd\" (UID: \"b2d8999d-c644-4658-bb69-415a49b2a69e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"
Jul 31 21:00:41.626580 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.626399    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw59h\" (UniqueName: \"kubernetes.io/projected/7346af3a-c73d-4d11-9f56-35f8b050d439-kube-api-access-mw59h\") pod \"payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc\" (UID: \"7346af3a-c73d-4d11-9f56-35f8b050d439\") " pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"
Jul 31 21:00:41.626580 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.626419    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d8999d-c644-4658-bb69-415a49b2a69e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd\" (UID: \"b2d8999d-c644-4658-bb69-415a49b2a69e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"
Jul 31 21:00:41.627104 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.627077    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d8999d-c644-4658-bb69-415a49b2a69e-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd\" (UID: \"b2d8999d-c644-4658-bb69-415a49b2a69e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"
Jul 31 21:00:41.627140 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.627090    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7346af3a-c73d-4d11-9f56-35f8b050d439-plugins-config-volume\") pod \"payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc\" (UID: \"7346af3a-c73d-4d11-9f56-35f8b050d439\") " pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"
Jul 31 21:00:41.634606 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.634571    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw59h\" (UniqueName: \"kubernetes.io/projected/7346af3a-c73d-4d11-9f56-35f8b050d439-kube-api-access-mw59h\") pod \"payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc\" (UID: \"7346af3a-c73d-4d11-9f56-35f8b050d439\") " pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"
Jul 31 21:00:41.634756 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.634670    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqbxc\" (UniqueName: \"kubernetes.io/projected/b2d8999d-c644-4658-bb69-415a49b2a69e-kube-api-access-gqbxc\") pod \"payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd\" (UID: \"b2d8999d-c644-4658-bb69-415a49b2a69e\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"
Jul 31 21:00:41.689003 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.688964    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"
Jul 31 21:00:41.719047 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.719016    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"
Jul 31 21:00:41.852844 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.852811    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"]
Jul 31 21:00:41.854469 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:00:41.854434    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d8999d_c644_4658_bb69_415a49b2a69e.slice/crio-c5e5db32a8d26d02c8a2bfb03c33ab22389cb4d17950e297e244d61a60c00e95 WatchSource:0}: Error finding container c5e5db32a8d26d02c8a2bfb03c33ab22389cb4d17950e297e244d61a60c00e95: Status 404 returned error can't find the container with id c5e5db32a8d26d02c8a2bfb03c33ab22389cb4d17950e297e244d61a60c00e95
Jul 31 21:00:41.887713 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.887684    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"]
Jul 31 21:00:41.890122 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:00:41.890095    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7346af3a_c73d_4d11_9f56_35f8b050d439.slice/crio-049b9424d01ed40d31cbb7b45e79bf62fd5ef909af15618a97b749eea8e01ad9 WatchSource:0}: Error finding container 049b9424d01ed40d31cbb7b45e79bf62fd5ef909af15618a97b749eea8e01ad9: Status 404 returned error can't find the container with id 049b9424d01ed40d31cbb7b45e79bf62fd5ef909af15618a97b749eea8e01ad9
Jul 31 21:00:41.917105 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.917072    2566 patch_prober.go:28] interesting pod/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 31 21:00:41.917314 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:41.917130    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x" podUID="623958b5-00b3-43a8-a265-149811d9e946" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 21:00:42.413127 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.413084    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd" event={"ID":"b2d8999d-c644-4658-bb69-415a49b2a69e","Type":"ContainerStarted","Data":"7438c1b90871f2e3b9e327ea9df2b0071a1f26bc5a4930447d2b38ae86e0676c"}
Jul 31 21:00:42.413631 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.413215    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd" event={"ID":"b2d8999d-c644-4658-bb69-415a49b2a69e","Type":"ContainerStarted","Data":"c5e5db32a8d26d02c8a2bfb03c33ab22389cb4d17950e297e244d61a60c00e95"}
Jul 31 21:00:42.413631 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.413246    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"
Jul 31 21:00:42.414676 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.414650    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc" event={"ID":"7346af3a-c73d-4d11-9f56-35f8b050d439","Type":"ContainerStarted","Data":"ff1090e1dbbed539db8191432bf77cb27a48885589d7af3f651b1824491d7ff6"}
Jul 31 21:00:42.414803 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.414691    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc" event={"ID":"7346af3a-c73d-4d11-9f56-35f8b050d439","Type":"ContainerStarted","Data":"049b9424d01ed40d31cbb7b45e79bf62fd5ef909af15618a97b749eea8e01ad9"}
Jul 31 21:00:42.414803 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.414744    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"
Jul 31 21:00:42.429830 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.429762    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd" podStartSLOduration=1.429737558 podStartE2EDuration="1.429737558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:00:42.42754023 +0000 UTC m=+1847.032932695" watchObservedRunningTime="2026-07-31 21:00:42.429737558 +0000 UTC m=+1847.035130034"
Jul 31 21:00:42.442917 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.442860    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc" podStartSLOduration=1.442845003 podStartE2EDuration="1.442845003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:00:42.441268232 +0000 UTC m=+1847.046660708" watchObservedRunningTime="2026-07-31 21:00:42.442845003 +0000 UTC m=+1847.048237513"
Jul 31 21:00:42.740111 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.740081    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:42.836781 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.836744    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/623958b5-00b3-43a8-a265-149811d9e946-istiod-ca-cert\") pod \"623958b5-00b3-43a8-a265-149811d9e946\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") "
Jul 31 21:00:42.837252 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.836804    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvt7r\" (UniqueName: \"kubernetes.io/projected/623958b5-00b3-43a8-a265-149811d9e946-kube-api-access-bvt7r\") pod \"623958b5-00b3-43a8-a265-149811d9e946\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") "
Jul 31 21:00:42.837252 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.836829    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-workload-certs\") pod \"623958b5-00b3-43a8-a265-149811d9e946\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") "
Jul 31 21:00:42.837252 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.836855    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-istio-envoy\") pod \"623958b5-00b3-43a8-a265-149811d9e946\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") "
Jul 31 21:00:42.837252 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.836879    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-workload-socket\") pod \"623958b5-00b3-43a8-a265-149811d9e946\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") "
Jul 31 21:00:42.837252 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.836904    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/623958b5-00b3-43a8-a265-149811d9e946-istio-podinfo\") pod \"623958b5-00b3-43a8-a265-149811d9e946\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") "
Jul 31 21:00:42.837252 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.836952    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-istio-data\") pod \"623958b5-00b3-43a8-a265-149811d9e946\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") "
Jul 31 21:00:42.837252 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.836975    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/623958b5-00b3-43a8-a265-149811d9e946-istio-token\") pod \"623958b5-00b3-43a8-a265-149811d9e946\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") "
Jul 31 21:00:42.837252 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.837017    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-credential-socket\") pod \"623958b5-00b3-43a8-a265-149811d9e946\" (UID: \"623958b5-00b3-43a8-a265-149811d9e946\") "
Jul 31 21:00:42.837252 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.837104    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "623958b5-00b3-43a8-a265-149811d9e946" (UID: "623958b5-00b3-43a8-a265-149811d9e946"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:00:42.837812 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.837349    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-workload-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:00:42.837812 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.837348    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "623958b5-00b3-43a8-a265-149811d9e946" (UID: "623958b5-00b3-43a8-a265-149811d9e946"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:00:42.837812 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.837548    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "623958b5-00b3-43a8-a265-149811d9e946" (UID: "623958b5-00b3-43a8-a265-149811d9e946"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:00:42.837812 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.837594    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/623958b5-00b3-43a8-a265-149811d9e946-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "623958b5-00b3-43a8-a265-149811d9e946" (UID: "623958b5-00b3-43a8-a265-149811d9e946"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:00:42.837812 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.837804    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-istio-data" (OuterVolumeSpecName: "istio-data") pod "623958b5-00b3-43a8-a265-149811d9e946" (UID: "623958b5-00b3-43a8-a265-149811d9e946"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:00:42.839808 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.839772    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "623958b5-00b3-43a8-a265-149811d9e946" (UID: "623958b5-00b3-43a8-a265-149811d9e946"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:00:42.840068 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.840044    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/623958b5-00b3-43a8-a265-149811d9e946-kube-api-access-bvt7r" (OuterVolumeSpecName: "kube-api-access-bvt7r") pod "623958b5-00b3-43a8-a265-149811d9e946" (UID: "623958b5-00b3-43a8-a265-149811d9e946"). InnerVolumeSpecName "kube-api-access-bvt7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:00:42.840068 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.840055    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/623958b5-00b3-43a8-a265-149811d9e946-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "623958b5-00b3-43a8-a265-149811d9e946" (UID: "623958b5-00b3-43a8-a265-149811d9e946"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 21:00:42.840326 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.840308    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/623958b5-00b3-43a8-a265-149811d9e946-istio-token" (OuterVolumeSpecName: "istio-token") pod "623958b5-00b3-43a8-a265-149811d9e946" (UID: "623958b5-00b3-43a8-a265-149811d9e946"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:00:42.938607 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.938570    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvt7r\" (UniqueName: \"kubernetes.io/projected/623958b5-00b3-43a8-a265-149811d9e946-kube-api-access-bvt7r\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:00:42.938607 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.938598    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-istio-envoy\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:00:42.938607 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.938608    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-workload-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:00:42.938607 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.938615    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/623958b5-00b3-43a8-a265-149811d9e946-istio-podinfo\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:00:42.938927 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.938624    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-istio-data\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:00:42.938927 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.938635    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/623958b5-00b3-43a8-a265-149811d9e946-istio-token\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:00:42.938927 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.938646    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/623958b5-00b3-43a8-a265-149811d9e946-credential-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:00:42.938927 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:42.938658    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/623958b5-00b3-43a8-a265-149811d9e946-istiod-ca-cert\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:00:43.422233 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:43.422198    2566 generic.go:356] "Generic (PLEG): container finished" podID="623958b5-00b3-43a8-a265-149811d9e946" containerID="b70bb73b84d7724c164eb085e11d7178ede5c4d63f0c0a62b92eac4909ab7f87" exitCode=0
Jul 31 21:00:43.422687 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:43.422253    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"
Jul 31 21:00:43.422687 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:43.422288    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x" event={"ID":"623958b5-00b3-43a8-a265-149811d9e946","Type":"ContainerDied","Data":"b70bb73b84d7724c164eb085e11d7178ede5c4d63f0c0a62b92eac4909ab7f87"}
Jul 31 21:00:43.422687 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:43.422345    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x" event={"ID":"623958b5-00b3-43a8-a265-149811d9e946","Type":"ContainerDied","Data":"6df01a97349aa492509af5c02c78565151e33b7491186b26451783950977f8fc"}
Jul 31 21:00:43.422687 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:43.422376    2566 scope.go:117] "RemoveContainer" containerID="b70bb73b84d7724c164eb085e11d7178ede5c4d63f0c0a62b92eac4909ab7f87"
Jul 31 21:00:43.431787 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:43.431764    2566 scope.go:117] "RemoveContainer" containerID="9123071cf99941cc2901568b3cdef83054c7f804a00a00c054d02ed8842ec441"
Jul 31 21:00:43.441231 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:43.441208    2566 scope.go:117] "RemoveContainer" containerID="b70bb73b84d7724c164eb085e11d7178ede5c4d63f0c0a62b92eac4909ab7f87"
Jul 31 21:00:43.441655 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:00:43.441617    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b70bb73b84d7724c164eb085e11d7178ede5c4d63f0c0a62b92eac4909ab7f87\": container with ID starting with b70bb73b84d7724c164eb085e11d7178ede5c4d63f0c0a62b92eac4909ab7f87 not found: ID does not exist" containerID="b70bb73b84d7724c164eb085e11d7178ede5c4d63f0c0a62b92eac4909ab7f87"
Jul 31 21:00:43.441776 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:43.441657    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b70bb73b84d7724c164eb085e11d7178ede5c4d63f0c0a62b92eac4909ab7f87"} err="failed to get container status \"b70bb73b84d7724c164eb085e11d7178ede5c4d63f0c0a62b92eac4909ab7f87\": rpc error: code = NotFound desc = could not find container \"b70bb73b84d7724c164eb085e11d7178ede5c4d63f0c0a62b92eac4909ab7f87\": container with ID starting with b70bb73b84d7724c164eb085e11d7178ede5c4d63f0c0a62b92eac4909ab7f87 not found: ID does not exist"
Jul 31 21:00:43.441776 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:43.441686    2566 scope.go:117] "RemoveContainer" containerID="9123071cf99941cc2901568b3cdef83054c7f804a00a00c054d02ed8842ec441"
Jul 31 21:00:43.442099 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:00:43.442004    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9123071cf99941cc2901568b3cdef83054c7f804a00a00c054d02ed8842ec441\": container with ID starting with 9123071cf99941cc2901568b3cdef83054c7f804a00a00c054d02ed8842ec441 not found: ID does not exist" containerID="9123071cf99941cc2901568b3cdef83054c7f804a00a00c054d02ed8842ec441"
Jul 31 21:00:43.442281 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:43.442126    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9123071cf99941cc2901568b3cdef83054c7f804a00a00c054d02ed8842ec441"} err="failed to get container status \"9123071cf99941cc2901568b3cdef83054c7f804a00a00c054d02ed8842ec441\": rpc error: code = NotFound desc = could not find container \"9123071cf99941cc2901568b3cdef83054c7f804a00a00c054d02ed8842ec441\": container with ID starting with 9123071cf99941cc2901568b3cdef83054c7f804a00a00c054d02ed8842ec441 not found: ID does not exist"
Jul 31 21:00:43.444847 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:43.444826    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"]
Jul 31 21:00:43.448060 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:43.448034    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c5bdfd41-openshift-default-7d4f8c7bf4-9t48x"]
Jul 31 21:00:43.934954 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:43.934908    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="623958b5-00b3-43a8-a265-149811d9e946" path="/var/lib/kubelet/pods/623958b5-00b3-43a8-a265-149811d9e946/volumes"
Jul 31 21:00:53.424562 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:53.424531    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"
Jul 31 21:00:53.424994 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:00:53.424606    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"
Jul 31 21:01:05.681131 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:05.681092    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-337fe245-bltz7"]
Jul 31 21:01:05.681620 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:05.681467    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="623958b5-00b3-43a8-a265-149811d9e946" containerName="istio-proxy"
Jul 31 21:01:05.681620 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:05.681478    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="623958b5-00b3-43a8-a265-149811d9e946" containerName="istio-proxy"
Jul 31 21:01:05.681620 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:05.681489    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="623958b5-00b3-43a8-a265-149811d9e946" containerName="istio-proxy"
Jul 31 21:01:05.681620 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:05.681496    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="623958b5-00b3-43a8-a265-149811d9e946" containerName="istio-proxy"
Jul 31 21:01:05.681620 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:05.681562    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="623958b5-00b3-43a8-a265-149811d9e946" containerName="istio-proxy"
Jul 31 21:01:05.684383 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:05.684367    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-337fe245-bltz7"
Jul 31 21:01:05.686855 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:05.686828    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:01:05.691333 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:05.691309    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-337fe245-bltz7"]
Jul 31 21:01:05.748202 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:05.748127    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/141530d5-3933-4124-b3df-012cb90777ef-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-337fe245-bltz7\" (UID: \"141530d5-3933-4124-b3df-012cb90777ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-337fe245-bltz7"
Jul 31 21:01:05.849405 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:05.849365    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/141530d5-3933-4124-b3df-012cb90777ef-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-337fe245-bltz7\" (UID: \"141530d5-3933-4124-b3df-012cb90777ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-337fe245-bltz7"
Jul 31 21:01:05.850003 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:05.849980    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/141530d5-3933-4124-b3df-012cb90777ef-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-337fe245-bltz7\" (UID: \"141530d5-3933-4124-b3df-012cb90777ef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-337fe245-bltz7"
Jul 31 21:01:05.996561 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:05.996473    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-337fe245-bltz7"
Jul 31 21:01:06.128565 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:06.128537    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-337fe245-bltz7"]
Jul 31 21:01:06.131237 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:01:06.131192    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141530d5_3933_4124_b3df_012cb90777ef.slice/crio-173bd93c6ab4361328efce4b9c98b13006e0ed3a7972067bcd79e4a656a702f4 WatchSource:0}: Error finding container 173bd93c6ab4361328efce4b9c98b13006e0ed3a7972067bcd79e4a656a702f4: Status 404 returned error can't find the container with id 173bd93c6ab4361328efce4b9c98b13006e0ed3a7972067bcd79e4a656a702f4
Jul 31 21:01:06.536685 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:06.536647    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-337fe245-bltz7" event={"ID":"141530d5-3933-4124-b3df-012cb90777ef","Type":"ContainerStarted","Data":"bbafbe232cc6ceb900b876b8b4b81f28bc8e9e17f52e4c0fdd746f447843a012"}
Jul 31 21:01:06.536871 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:06.536708    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-337fe245-bltz7" event={"ID":"141530d5-3933-4124-b3df-012cb90777ef","Type":"ContainerStarted","Data":"173bd93c6ab4361328efce4b9c98b13006e0ed3a7972067bcd79e4a656a702f4"}
Jul 31 21:01:06.552540 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:06.552487    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-337fe245-bltz7" podStartSLOduration=1.552469659 podStartE2EDuration="1.552469659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:01:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:01:06.550365353 +0000 UTC m=+1871.155757832" watchObservedRunningTime="2026-07-31 21:01:06.552469659 +0000 UTC m=+1871.157862135"
Jul 31 21:01:07.543457 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:07.543420    2566 generic.go:356] "Generic (PLEG): container finished" podID="141530d5-3933-4124-b3df-012cb90777ef" containerID="bbafbe232cc6ceb900b876b8b4b81f28bc8e9e17f52e4c0fdd746f447843a012" exitCode=0
Jul 31 21:01:07.543951 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:07.543489    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-337fe245-bltz7" event={"ID":"141530d5-3933-4124-b3df-012cb90777ef","Type":"ContainerDied","Data":"bbafbe232cc6ceb900b876b8b4b81f28bc8e9e17f52e4c0fdd746f447843a012"}
Jul 31 21:01:08.681359 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:08.681327    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-337fe245-bltz7"
Jul 31 21:01:08.775679 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:08.775644    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/141530d5-3933-4124-b3df-012cb90777ef-maas-api-service-ca\") pod \"141530d5-3933-4124-b3df-012cb90777ef\" (UID: \"141530d5-3933-4124-b3df-012cb90777ef\") "
Jul 31 21:01:08.776018 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:08.775995    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/141530d5-3933-4124-b3df-012cb90777ef-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "141530d5-3933-4124-b3df-012cb90777ef" (UID: "141530d5-3933-4124-b3df-012cb90777ef"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:01:08.876346 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:08.876252    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/141530d5-3933-4124-b3df-012cb90777ef-maas-api-service-ca\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:01:09.554730 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:09.554698    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-337fe245-bltz7"
Jul 31 21:01:09.554904 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:09.554699    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-337fe245-bltz7" event={"ID":"141530d5-3933-4124-b3df-012cb90777ef","Type":"ContainerDied","Data":"173bd93c6ab4361328efce4b9c98b13006e0ed3a7972067bcd79e4a656a702f4"}
Jul 31 21:01:09.554904 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:09.554836    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="173bd93c6ab4361328efce4b9c98b13006e0ed3a7972067bcd79e4a656a702f4"
Jul 31 21:01:12.127039 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.127007    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"]
Jul 31 21:01:12.127526 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.127229    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc" podUID="7346af3a-c73d-4d11-9f56-35f8b050d439" containerName="payload-processing" containerID="cri-o://ff1090e1dbbed539db8191432bf77cb27a48885589d7af3f651b1824491d7ff6" gracePeriod=30
Jul 31 21:01:12.137753 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.137724    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"]
Jul 31 21:01:12.137985 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.137956    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd" podUID="b2d8999d-c644-4658-bb69-415a49b2a69e" containerName="payload-pre-processing" containerID="cri-o://7438c1b90871f2e3b9e327ea9df2b0071a1f26bc5a4930447d2b38ae86e0676c" gracePeriod=30
Jul 31 21:01:12.384688 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.384598    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-337fe245-bltz7"]
Jul 31 21:01:12.388618 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.388593    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-337fe245-bltz7"]
Jul 31 21:01:12.416905 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.416882    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"
Jul 31 21:01:12.419676 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.419656    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"
Jul 31 21:01:12.510843 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.510815    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqbxc\" (UniqueName: \"kubernetes.io/projected/b2d8999d-c644-4658-bb69-415a49b2a69e-kube-api-access-gqbxc\") pod \"b2d8999d-c644-4658-bb69-415a49b2a69e\" (UID: \"b2d8999d-c644-4658-bb69-415a49b2a69e\") "
Jul 31 21:01:12.511089 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.510857    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7346af3a-c73d-4d11-9f56-35f8b050d439-plugins-config-volume\") pod \"7346af3a-c73d-4d11-9f56-35f8b050d439\" (UID: \"7346af3a-c73d-4d11-9f56-35f8b050d439\") "
Jul 31 21:01:12.511089 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.510896    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d8999d-c644-4658-bb69-415a49b2a69e-plugins-config-volume\") pod \"b2d8999d-c644-4658-bb69-415a49b2a69e\" (UID: \"b2d8999d-c644-4658-bb69-415a49b2a69e\") "
Jul 31 21:01:12.511089 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.510938    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mw59h\" (UniqueName: \"kubernetes.io/projected/7346af3a-c73d-4d11-9f56-35f8b050d439-kube-api-access-mw59h\") pod \"7346af3a-c73d-4d11-9f56-35f8b050d439\" (UID: \"7346af3a-c73d-4d11-9f56-35f8b050d439\") "
Jul 31 21:01:12.511353 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.511312    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7346af3a-c73d-4d11-9f56-35f8b050d439-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7346af3a-c73d-4d11-9f56-35f8b050d439" (UID: "7346af3a-c73d-4d11-9f56-35f8b050d439"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:01:12.511427 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.511318    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2d8999d-c644-4658-bb69-415a49b2a69e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b2d8999d-c644-4658-bb69-415a49b2a69e" (UID: "b2d8999d-c644-4658-bb69-415a49b2a69e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:01:12.514084 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.514053    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7346af3a-c73d-4d11-9f56-35f8b050d439-kube-api-access-mw59h" (OuterVolumeSpecName: "kube-api-access-mw59h") pod "7346af3a-c73d-4d11-9f56-35f8b050d439" (UID: "7346af3a-c73d-4d11-9f56-35f8b050d439"). InnerVolumeSpecName "kube-api-access-mw59h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:01:12.514234 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.514110    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2d8999d-c644-4658-bb69-415a49b2a69e-kube-api-access-gqbxc" (OuterVolumeSpecName: "kube-api-access-gqbxc") pod "b2d8999d-c644-4658-bb69-415a49b2a69e" (UID: "b2d8999d-c644-4658-bb69-415a49b2a69e"). InnerVolumeSpecName "kube-api-access-gqbxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:01:12.569860 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.569828    2566 generic.go:356] "Generic (PLEG): container finished" podID="b2d8999d-c644-4658-bb69-415a49b2a69e" containerID="7438c1b90871f2e3b9e327ea9df2b0071a1f26bc5a4930447d2b38ae86e0676c" exitCode=0
Jul 31 21:01:12.570072 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.569874    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"
Jul 31 21:01:12.570072 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.569917    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd" event={"ID":"b2d8999d-c644-4658-bb69-415a49b2a69e","Type":"ContainerDied","Data":"7438c1b90871f2e3b9e327ea9df2b0071a1f26bc5a4930447d2b38ae86e0676c"}
Jul 31 21:01:12.570072 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.569967    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd" event={"ID":"b2d8999d-c644-4658-bb69-415a49b2a69e","Type":"ContainerDied","Data":"c5e5db32a8d26d02c8a2bfb03c33ab22389cb4d17950e297e244d61a60c00e95"}
Jul 31 21:01:12.570072 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.569998    2566 scope.go:117] "RemoveContainer" containerID="7438c1b90871f2e3b9e327ea9df2b0071a1f26bc5a4930447d2b38ae86e0676c"
Jul 31 21:01:12.571459 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.571439    2566 generic.go:356] "Generic (PLEG): container finished" podID="7346af3a-c73d-4d11-9f56-35f8b050d439" containerID="ff1090e1dbbed539db8191432bf77cb27a48885589d7af3f651b1824491d7ff6" exitCode=0
Jul 31 21:01:12.571568 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.571469    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc" event={"ID":"7346af3a-c73d-4d11-9f56-35f8b050d439","Type":"ContainerDied","Data":"ff1090e1dbbed539db8191432bf77cb27a48885589d7af3f651b1824491d7ff6"}
Jul 31 21:01:12.571568 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.571532    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc" event={"ID":"7346af3a-c73d-4d11-9f56-35f8b050d439","Type":"ContainerDied","Data":"049b9424d01ed40d31cbb7b45e79bf62fd5ef909af15618a97b749eea8e01ad9"}
Jul 31 21:01:12.571568 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.571491    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"
Jul 31 21:01:12.583195 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.581974    2566 scope.go:117] "RemoveContainer" containerID="7438c1b90871f2e3b9e327ea9df2b0071a1f26bc5a4930447d2b38ae86e0676c"
Jul 31 21:01:12.583195 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:01:12.582399    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7438c1b90871f2e3b9e327ea9df2b0071a1f26bc5a4930447d2b38ae86e0676c\": container with ID starting with 7438c1b90871f2e3b9e327ea9df2b0071a1f26bc5a4930447d2b38ae86e0676c not found: ID does not exist" containerID="7438c1b90871f2e3b9e327ea9df2b0071a1f26bc5a4930447d2b38ae86e0676c"
Jul 31 21:01:12.583195 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.582440    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7438c1b90871f2e3b9e327ea9df2b0071a1f26bc5a4930447d2b38ae86e0676c"} err="failed to get container status \"7438c1b90871f2e3b9e327ea9df2b0071a1f26bc5a4930447d2b38ae86e0676c\": rpc error: code = NotFound desc = could not find container \"7438c1b90871f2e3b9e327ea9df2b0071a1f26bc5a4930447d2b38ae86e0676c\": container with ID starting with 7438c1b90871f2e3b9e327ea9df2b0071a1f26bc5a4930447d2b38ae86e0676c not found: ID does not exist"
Jul 31 21:01:12.583195 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.582464    2566 scope.go:117] "RemoveContainer" containerID="ff1090e1dbbed539db8191432bf77cb27a48885589d7af3f651b1824491d7ff6"
Jul 31 21:01:12.593736 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.593708    2566 scope.go:117] "RemoveContainer" containerID="ff1090e1dbbed539db8191432bf77cb27a48885589d7af3f651b1824491d7ff6"
Jul 31 21:01:12.594070 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:01:12.594049    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff1090e1dbbed539db8191432bf77cb27a48885589d7af3f651b1824491d7ff6\": container with ID starting with ff1090e1dbbed539db8191432bf77cb27a48885589d7af3f651b1824491d7ff6 not found: ID does not exist" containerID="ff1090e1dbbed539db8191432bf77cb27a48885589d7af3f651b1824491d7ff6"
Jul 31 21:01:12.594175 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.594084    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1090e1dbbed539db8191432bf77cb27a48885589d7af3f651b1824491d7ff6"} err="failed to get container status \"ff1090e1dbbed539db8191432bf77cb27a48885589d7af3f651b1824491d7ff6\": rpc error: code = NotFound desc = could not find container \"ff1090e1dbbed539db8191432bf77cb27a48885589d7af3f651b1824491d7ff6\": container with ID starting with ff1090e1dbbed539db8191432bf77cb27a48885589d7af3f651b1824491d7ff6 not found: ID does not exist"
Jul 31 21:01:12.594563 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.594545    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"]
Jul 31 21:01:12.598031 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.598010    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-337fe245-5b989bbc88-bgwpd"]
Jul 31 21:01:12.608665 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.608639    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"]
Jul 31 21:01:12.612294 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.612266    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw59h\" (UniqueName: \"kubernetes.io/projected/7346af3a-c73d-4d11-9f56-35f8b050d439-kube-api-access-mw59h\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:01:12.612395 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.612301    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqbxc\" (UniqueName: \"kubernetes.io/projected/b2d8999d-c644-4658-bb69-415a49b2a69e-kube-api-access-gqbxc\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:01:12.612395 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.612320    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7346af3a-c73d-4d11-9f56-35f8b050d439-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:01:12.612395 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.612335    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d8999d-c644-4658-bb69-415a49b2a69e-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:01:12.612607 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:12.612587    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-337fe245-78454b9cb9-v6vgc"]
Jul 31 21:01:13.295284 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.295251    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"]
Jul 31 21:01:13.295795 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.295776    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="141530d5-3933-4124-b3df-012cb90777ef" containerName="revoke-keys"
Jul 31 21:01:13.295874 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.295798    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="141530d5-3933-4124-b3df-012cb90777ef" containerName="revoke-keys"
Jul 31 21:01:13.295874 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.295821    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2d8999d-c644-4658-bb69-415a49b2a69e" containerName="payload-pre-processing"
Jul 31 21:01:13.295874 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.295830    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2d8999d-c644-4658-bb69-415a49b2a69e" containerName="payload-pre-processing"
Jul 31 21:01:13.295874 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.295844    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7346af3a-c73d-4d11-9f56-35f8b050d439" containerName="payload-processing"
Jul 31 21:01:13.295874 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.295854    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7346af3a-c73d-4d11-9f56-35f8b050d439" containerName="payload-processing"
Jul 31 21:01:13.296102 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.295944    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="141530d5-3933-4124-b3df-012cb90777ef" containerName="revoke-keys"
Jul 31 21:01:13.296102 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.295960    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2d8999d-c644-4658-bb69-415a49b2a69e" containerName="payload-pre-processing"
Jul 31 21:01:13.296102 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.295969    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7346af3a-c73d-4d11-9f56-35f8b050d439" containerName="payload-processing"
Jul 31 21:01:13.296102 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.295978    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="623958b5-00b3-43a8-a265-149811d9e946" containerName="istio-proxy"
Jul 31 21:01:13.300354 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.300334    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.302740 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.302715    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-80cfef96-openshift-default-dockercfg-qddj5\""
Jul 31 21:01:13.308414 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.308388    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"]
Jul 31 21:01:13.419742 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.419698    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-istio-data\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.419927 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.419753    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06374953-b724-45fa-953f-9a5c5d6124ce-istio-token\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.419927 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.419785    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-workload-socket\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.419927 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.419823    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-credential-socket\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.419927 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.419856    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06374953-b724-45fa-953f-9a5c5d6124ce-istio-podinfo\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.419927 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.419886    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-workload-certs\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.419927 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.419908    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zff6\" (UniqueName: \"kubernetes.io/projected/06374953-b724-45fa-953f-9a5c5d6124ce-kube-api-access-7zff6\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.420251 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.420024    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06374953-b724-45fa-953f-9a5c5d6124ce-istiod-ca-cert\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.420251 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.420084    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-istio-envoy\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.520993 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.520953    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-istio-envoy\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.521252 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.521008    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-istio-data\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.521252 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.521034    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06374953-b724-45fa-953f-9a5c5d6124ce-istio-token\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.521252 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.521056    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-workload-socket\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.521252 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.521085    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-credential-socket\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.521252 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.521105    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06374953-b724-45fa-953f-9a5c5d6124ce-istio-podinfo\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.521252 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.521125    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-workload-certs\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.521585 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.521286    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zff6\" (UniqueName: \"kubernetes.io/projected/06374953-b724-45fa-953f-9a5c5d6124ce-kube-api-access-7zff6\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.521585 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.521343    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06374953-b724-45fa-953f-9a5c5d6124ce-istiod-ca-cert\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.521585 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.521572    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-workload-socket\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.521744 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.521721    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-credential-socket\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.521851 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.521802    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-istio-data\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.521851 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.521828    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-workload-certs\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.522315 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.522287    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06374953-b724-45fa-953f-9a5c5d6124ce-istiod-ca-cert\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.523694 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.523675    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-istio-envoy\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.523806 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.523795    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06374953-b724-45fa-953f-9a5c5d6124ce-istio-podinfo\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.529308 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.529283    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06374953-b724-45fa-953f-9a5c5d6124ce-istio-token\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.529642 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.529610    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zff6\" (UniqueName: \"kubernetes.io/projected/06374953-b724-45fa-953f-9a5c5d6124ce-kube-api-access-7zff6\") pod \"e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") " pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.612462 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.612364    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:13.767083 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.767054    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"]
Jul 31 21:01:13.769549 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:01:13.769518    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06374953_b724_45fa_953f_9a5c5d6124ce.slice/crio-1f4b08726777d9ed81e92a7bc16de431235dcb6c35391f712fcb661db826008e WatchSource:0}: Error finding container 1f4b08726777d9ed81e92a7bc16de431235dcb6c35391f712fcb661db826008e: Status 404 returned error can't find the container with id 1f4b08726777d9ed81e92a7bc16de431235dcb6c35391f712fcb661db826008e
Jul 31 21:01:13.771547 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.771512    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:01:13.771670 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.771595    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:01:13.771670 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.771640    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:01:13.937920 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.937817    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="141530d5-3933-4124-b3df-012cb90777ef" path="/var/lib/kubelet/pods/141530d5-3933-4124-b3df-012cb90777ef/volumes"
Jul 31 21:01:13.938278 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.938252    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7346af3a-c73d-4d11-9f56-35f8b050d439" path="/var/lib/kubelet/pods/7346af3a-c73d-4d11-9f56-35f8b050d439/volumes"
Jul 31 21:01:13.938589 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:13.938577    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2d8999d-c644-4658-bb69-415a49b2a69e" path="/var/lib/kubelet/pods/b2d8999d-c644-4658-bb69-415a49b2a69e/volumes"
Jul 31 21:01:14.586019 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:14.585981    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96" event={"ID":"06374953-b724-45fa-953f-9a5c5d6124ce","Type":"ContainerStarted","Data":"be5d403258a98b724c7920411d37a3cd9ed9a294f88c9cab507a87769e4869f9"}
Jul 31 21:01:14.586456 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:14.586036    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96" event={"ID":"06374953-b724-45fa-953f-9a5c5d6124ce","Type":"ContainerStarted","Data":"1f4b08726777d9ed81e92a7bc16de431235dcb6c35391f712fcb661db826008e"}
Jul 31 21:01:14.608474 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:14.608418    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96" podStartSLOduration=1.608400199 podStartE2EDuration="1.608400199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:01:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:01:14.606262839 +0000 UTC m=+1879.211655305" watchObservedRunningTime="2026-07-31 21:01:14.608400199 +0000 UTC m=+1879.213792736"
Jul 31 21:01:14.613111 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:14.613085    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:14.618239 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:14.618213    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:15.591491 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:15.591453    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:15.592453 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:15.592434    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:17.648291 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.648197    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"]
Jul 31 21:01:17.653021 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.652996    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"
Jul 31 21:01:17.655689 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.655664    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-80cfef96-dockercfg-75rxb\""
Jul 31 21:01:17.656106 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.656086    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-80cfef96\""
Jul 31 21:01:17.661382 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.661280    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"]
Jul 31 21:01:17.688285 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.688249    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"]
Jul 31 21:01:17.691592 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.691573    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"
Jul 31 21:01:17.699187 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.699087    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"]
Jul 31 21:01:17.756899 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.756866    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00e3f79a-b5c9-4316-a21b-c6b3334f08dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm\" (UID: \"00e3f79a-b5c9-4316-a21b-c6b3334f08dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"
Jul 31 21:01:17.757112 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.756936    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhfjs\" (UniqueName: \"kubernetes.io/projected/00e3f79a-b5c9-4316-a21b-c6b3334f08dd-kube-api-access-bhfjs\") pod \"payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm\" (UID: \"00e3f79a-b5c9-4316-a21b-c6b3334f08dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"
Jul 31 21:01:17.858397 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.858355    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhfjs\" (UniqueName: \"kubernetes.io/projected/00e3f79a-b5c9-4316-a21b-c6b3334f08dd-kube-api-access-bhfjs\") pod \"payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm\" (UID: \"00e3f79a-b5c9-4316-a21b-c6b3334f08dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"
Jul 31 21:01:17.858581 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.858412    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djp5r\" (UniqueName: \"kubernetes.io/projected/f2ab1701-81e3-4fd8-9fac-93925e6d2162-kube-api-access-djp5r\") pod \"payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt\" (UID: \"f2ab1701-81e3-4fd8-9fac-93925e6d2162\") " pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"
Jul 31 21:01:17.858581 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.858451    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2ab1701-81e3-4fd8-9fac-93925e6d2162-plugins-config-volume\") pod \"payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt\" (UID: \"f2ab1701-81e3-4fd8-9fac-93925e6d2162\") " pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"
Jul 31 21:01:17.858581 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.858488    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00e3f79a-b5c9-4316-a21b-c6b3334f08dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm\" (UID: \"00e3f79a-b5c9-4316-a21b-c6b3334f08dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"
Jul 31 21:01:17.859192 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.859174    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00e3f79a-b5c9-4316-a21b-c6b3334f08dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm\" (UID: \"00e3f79a-b5c9-4316-a21b-c6b3334f08dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"
Jul 31 21:01:17.866462 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.866433    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhfjs\" (UniqueName: \"kubernetes.io/projected/00e3f79a-b5c9-4316-a21b-c6b3334f08dd-kube-api-access-bhfjs\") pod \"payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm\" (UID: \"00e3f79a-b5c9-4316-a21b-c6b3334f08dd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"
Jul 31 21:01:17.958994 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.958895    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djp5r\" (UniqueName: \"kubernetes.io/projected/f2ab1701-81e3-4fd8-9fac-93925e6d2162-kube-api-access-djp5r\") pod \"payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt\" (UID: \"f2ab1701-81e3-4fd8-9fac-93925e6d2162\") " pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"
Jul 31 21:01:17.958994 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.958953    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2ab1701-81e3-4fd8-9fac-93925e6d2162-plugins-config-volume\") pod \"payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt\" (UID: \"f2ab1701-81e3-4fd8-9fac-93925e6d2162\") " pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"
Jul 31 21:01:17.959734 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.959710    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2ab1701-81e3-4fd8-9fac-93925e6d2162-plugins-config-volume\") pod \"payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt\" (UID: \"f2ab1701-81e3-4fd8-9fac-93925e6d2162\") " pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"
Jul 31 21:01:17.965364 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.965338    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"
Jul 31 21:01:17.966584 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:17.966561    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djp5r\" (UniqueName: \"kubernetes.io/projected/f2ab1701-81e3-4fd8-9fac-93925e6d2162-kube-api-access-djp5r\") pod \"payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt\" (UID: \"f2ab1701-81e3-4fd8-9fac-93925e6d2162\") " pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"
Jul 31 21:01:18.002691 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:18.002654    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"
Jul 31 21:01:18.112839 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:18.112810    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"]
Jul 31 21:01:18.116084 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:01:18.116049    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e3f79a_b5c9_4316_a21b_c6b3334f08dd.slice/crio-991f5977aef808fa43252257f87afd900114335eeb92617088ad0081e299bdf5 WatchSource:0}: Error finding container 991f5977aef808fa43252257f87afd900114335eeb92617088ad0081e299bdf5: Status 404 returned error can't find the container with id 991f5977aef808fa43252257f87afd900114335eeb92617088ad0081e299bdf5
Jul 31 21:01:18.161077 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:18.161049    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"]
Jul 31 21:01:18.162937 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:01:18.162912    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ab1701_81e3_4fd8_9fac_93925e6d2162.slice/crio-a190aeb540f4a1091e893fe50eeaacaf0d90f03d6b522fc357e65f949dadcc50 WatchSource:0}: Error finding container a190aeb540f4a1091e893fe50eeaacaf0d90f03d6b522fc357e65f949dadcc50: Status 404 returned error can't find the container with id a190aeb540f4a1091e893fe50eeaacaf0d90f03d6b522fc357e65f949dadcc50
Jul 31 21:01:18.610610 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:18.610567    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm" event={"ID":"00e3f79a-b5c9-4316-a21b-c6b3334f08dd","Type":"ContainerStarted","Data":"75cb101b58983c69275df1a5b2e17522dd2c886da814557b87478f7d1fa4c702"}
Jul 31 21:01:18.610830 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:18.610727    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"
Jul 31 21:01:18.610830 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:18.610773    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm" event={"ID":"00e3f79a-b5c9-4316-a21b-c6b3334f08dd","Type":"ContainerStarted","Data":"991f5977aef808fa43252257f87afd900114335eeb92617088ad0081e299bdf5"}
Jul 31 21:01:18.612023 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:18.611997    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt" event={"ID":"f2ab1701-81e3-4fd8-9fac-93925e6d2162","Type":"ContainerStarted","Data":"d0921b6135f09307fd10722a4d092043de6c483c193e0500fb3dec5672ef9b37"}
Jul 31 21:01:18.612139 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:18.612043    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt" event={"ID":"f2ab1701-81e3-4fd8-9fac-93925e6d2162","Type":"ContainerStarted","Data":"a190aeb540f4a1091e893fe50eeaacaf0d90f03d6b522fc357e65f949dadcc50"}
Jul 31 21:01:18.612139 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:18.612071    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"
Jul 31 21:01:18.625441 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:18.625396    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm" podStartSLOduration=1.62537967 podStartE2EDuration="1.62537967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:01:18.624016648 +0000 UTC m=+1883.229409113" watchObservedRunningTime="2026-07-31 21:01:18.62537967 +0000 UTC m=+1883.230772145"
Jul 31 21:01:18.645175 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:18.641022    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt" podStartSLOduration=1.641000121 podStartE2EDuration="1.641000121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:01:18.639251647 +0000 UTC m=+1883.244644116" watchObservedRunningTime="2026-07-31 21:01:18.641000121 +0000 UTC m=+1883.246392603"
Jul 31 21:01:29.619376 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:29.619346    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"
Jul 31 21:01:29.619855 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:29.619424    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"
Jul 31 21:01:30.592700 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:30.592663    2566 patch_prober.go:28] interesting pod/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 31 21:01:30.592956 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:30.592730    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96" podUID="06374953-b724-45fa-953f-9a5c5d6124ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 31 21:01:30.685163 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:30.685119    2566 generic.go:356] "Generic (PLEG): container finished" podID="06374953-b724-45fa-953f-9a5c5d6124ce" containerID="be5d403258a98b724c7920411d37a3cd9ed9a294f88c9cab507a87769e4869f9" exitCode=0
Jul 31 21:01:30.685517 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:30.685179    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96" event={"ID":"06374953-b724-45fa-953f-9a5c5d6124ce","Type":"ContainerDied","Data":"be5d403258a98b724c7920411d37a3cd9ed9a294f88c9cab507a87769e4869f9"}
Jul 31 21:01:30.685576 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:30.685515    2566 scope.go:117] "RemoveContainer" containerID="be5d403258a98b724c7920411d37a3cd9ed9a294f88c9cab507a87769e4869f9"
Jul 31 21:01:30.686577 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:30.686548    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:01:30.686641 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:30.686617    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:01:30.686683 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:30.686648    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:01:31.693029 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:31.692989    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96" event={"ID":"06374953-b724-45fa-953f-9a5c5d6124ce","Type":"ContainerStarted","Data":"baaebd97ae09875b8f9fc0b85989d3cea47721baef3de4009eec483004c9c494"}
Jul 31 21:01:32.613368 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:32.613326    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:32.613564 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:32.613536    2566 patch_prober.go:28] interesting pod/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 31 21:01:32.613610 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:32.613588    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96" podUID="06374953-b724-45fa-953f-9a5c5d6124ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 31 21:01:33.613103 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:33.613060    2566 patch_prober.go:28] interesting pod/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 31 21:01:33.613540 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:33.613131    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96" podUID="06374953-b724-45fa-953f-9a5c5d6124ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 31 21:01:34.613266 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:34.613223    2566 patch_prober.go:28] interesting pod/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 31 21:01:34.613672 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:34.613284    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96" podUID="06374953-b724-45fa-953f-9a5c5d6124ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 31 21:01:35.613635 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:35.613595    2566 patch_prober.go:28] interesting pod/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 31 21:01:35.614061 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:35.613652    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96" podUID="06374953-b724-45fa-953f-9a5c5d6124ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 31 21:01:36.613343 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:36.613301    2566 patch_prober.go:28] interesting pod/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 31 21:01:36.613555 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:36.613368    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96" podUID="06374953-b724-45fa-953f-9a5c5d6124ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 31 21:01:37.616813 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:37.616781    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:37.617254 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:37.617048    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:37.617809 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:37.617792    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:01:57.626946 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:57.626905    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"]
Jul 31 21:01:57.627491 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:57.627120    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt" podUID="f2ab1701-81e3-4fd8-9fac-93925e6d2162" containerName="payload-processing" containerID="cri-o://d0921b6135f09307fd10722a4d092043de6c483c193e0500fb3dec5672ef9b37" gracePeriod=30
Jul 31 21:01:57.633024 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:57.632955    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"]
Jul 31 21:01:57.633258 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:57.633188    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm" podUID="00e3f79a-b5c9-4316-a21b-c6b3334f08dd" containerName="payload-pre-processing" containerID="cri-o://75cb101b58983c69275df1a5b2e17522dd2c886da814557b87478f7d1fa4c702" gracePeriod=30
Jul 31 21:01:57.827988 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:57.827904    2566 generic.go:356] "Generic (PLEG): container finished" podID="f2ab1701-81e3-4fd8-9fac-93925e6d2162" containerID="d0921b6135f09307fd10722a4d092043de6c483c193e0500fb3dec5672ef9b37" exitCode=0
Jul 31 21:01:57.828189 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:57.827964    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt" event={"ID":"f2ab1701-81e3-4fd8-9fac-93925e6d2162","Type":"ContainerDied","Data":"d0921b6135f09307fd10722a4d092043de6c483c193e0500fb3dec5672ef9b37"}
Jul 31 21:01:57.834368 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:57.834020    2566 generic.go:356] "Generic (PLEG): container finished" podID="00e3f79a-b5c9-4316-a21b-c6b3334f08dd" containerID="75cb101b58983c69275df1a5b2e17522dd2c886da814557b87478f7d1fa4c702" exitCode=0
Jul 31 21:01:57.834626 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:57.834597    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm" event={"ID":"00e3f79a-b5c9-4316-a21b-c6b3334f08dd","Type":"ContainerDied","Data":"75cb101b58983c69275df1a5b2e17522dd2c886da814557b87478f7d1fa4c702"}
Jul 31 21:01:57.908169 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:57.908121    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"
Jul 31 21:01:57.924915 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:57.924450    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"
Jul 31 21:01:58.005298 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.005263    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00e3f79a-b5c9-4316-a21b-c6b3334f08dd-plugins-config-volume\") pod \"00e3f79a-b5c9-4316-a21b-c6b3334f08dd\" (UID: \"00e3f79a-b5c9-4316-a21b-c6b3334f08dd\") "
Jul 31 21:01:58.005493 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.005322    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhfjs\" (UniqueName: \"kubernetes.io/projected/00e3f79a-b5c9-4316-a21b-c6b3334f08dd-kube-api-access-bhfjs\") pod \"00e3f79a-b5c9-4316-a21b-c6b3334f08dd\" (UID: \"00e3f79a-b5c9-4316-a21b-c6b3334f08dd\") "
Jul 31 21:01:58.005493 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.005358    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2ab1701-81e3-4fd8-9fac-93925e6d2162-plugins-config-volume\") pod \"f2ab1701-81e3-4fd8-9fac-93925e6d2162\" (UID: \"f2ab1701-81e3-4fd8-9fac-93925e6d2162\") "
Jul 31 21:01:58.005493 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.005401    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djp5r\" (UniqueName: \"kubernetes.io/projected/f2ab1701-81e3-4fd8-9fac-93925e6d2162-kube-api-access-djp5r\") pod \"f2ab1701-81e3-4fd8-9fac-93925e6d2162\" (UID: \"f2ab1701-81e3-4fd8-9fac-93925e6d2162\") "
Jul 31 21:01:58.005747 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.005722    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2ab1701-81e3-4fd8-9fac-93925e6d2162-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f2ab1701-81e3-4fd8-9fac-93925e6d2162" (UID: "f2ab1701-81e3-4fd8-9fac-93925e6d2162"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:01:58.005801 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.005722    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00e3f79a-b5c9-4316-a21b-c6b3334f08dd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "00e3f79a-b5c9-4316-a21b-c6b3334f08dd" (UID: "00e3f79a-b5c9-4316-a21b-c6b3334f08dd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:01:58.007654 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.007634    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00e3f79a-b5c9-4316-a21b-c6b3334f08dd-kube-api-access-bhfjs" (OuterVolumeSpecName: "kube-api-access-bhfjs") pod "00e3f79a-b5c9-4316-a21b-c6b3334f08dd" (UID: "00e3f79a-b5c9-4316-a21b-c6b3334f08dd"). InnerVolumeSpecName "kube-api-access-bhfjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:01:58.007654 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.007644    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2ab1701-81e3-4fd8-9fac-93925e6d2162-kube-api-access-djp5r" (OuterVolumeSpecName: "kube-api-access-djp5r") pod "f2ab1701-81e3-4fd8-9fac-93925e6d2162" (UID: "f2ab1701-81e3-4fd8-9fac-93925e6d2162"). InnerVolumeSpecName "kube-api-access-djp5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:01:58.106256 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.106218    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djp5r\" (UniqueName: \"kubernetes.io/projected/f2ab1701-81e3-4fd8-9fac-93925e6d2162-kube-api-access-djp5r\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:01:58.106256 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.106251    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00e3f79a-b5c9-4316-a21b-c6b3334f08dd-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:01:58.106256 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.106264    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhfjs\" (UniqueName: \"kubernetes.io/projected/00e3f79a-b5c9-4316-a21b-c6b3334f08dd-kube-api-access-bhfjs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:01:58.106525 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.106274    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2ab1701-81e3-4fd8-9fac-93925e6d2162-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:01:58.841381 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.841349    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"
Jul 31 21:01:58.841381 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.841378    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt" event={"ID":"f2ab1701-81e3-4fd8-9fac-93925e6d2162","Type":"ContainerDied","Data":"a190aeb540f4a1091e893fe50eeaacaf0d90f03d6b522fc357e65f949dadcc50"}
Jul 31 21:01:58.841915 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.841448    2566 scope.go:117] "RemoveContainer" containerID="d0921b6135f09307fd10722a4d092043de6c483c193e0500fb3dec5672ef9b37"
Jul 31 21:01:58.843308 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.843069    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"
Jul 31 21:01:58.843308 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.843068    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm" event={"ID":"00e3f79a-b5c9-4316-a21b-c6b3334f08dd","Type":"ContainerDied","Data":"991f5977aef808fa43252257f87afd900114335eeb92617088ad0081e299bdf5"}
Jul 31 21:01:58.852519 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.852495    2566 scope.go:117] "RemoveContainer" containerID="75cb101b58983c69275df1a5b2e17522dd2c886da814557b87478f7d1fa4c702"
Jul 31 21:01:58.865465 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.865438    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"]
Jul 31 21:01:58.869957 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.869929    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-80cfef96-798c9b87c8-gqhdt"]
Jul 31 21:01:58.879746 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.879723    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"]
Jul 31 21:01:58.885094 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.885070    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-80cfef96-d76db56cb-jgwgm"]
Jul 31 21:01:58.946624 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.946530    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"]
Jul 31 21:01:58.946811 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:58.946786    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96" podUID="06374953-b724-45fa-953f-9a5c5d6124ce" containerName="istio-proxy" containerID="cri-o://baaebd97ae09875b8f9fc0b85989d3cea47721baef3de4009eec483004c9c494" gracePeriod=30
Jul 31 21:01:59.935605 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:59.935563    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00e3f79a-b5c9-4316-a21b-c6b3334f08dd" path="/var/lib/kubelet/pods/00e3f79a-b5c9-4316-a21b-c6b3334f08dd/volumes"
Jul 31 21:01:59.936099 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:01:59.936082    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2ab1701-81e3-4fd8-9fac-93925e6d2162" path="/var/lib/kubelet/pods/f2ab1701-81e3-4fd8-9fac-93925e6d2162/volumes"
Jul 31 21:02:03.694879 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.694842    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"]
Jul 31 21:02:03.695405 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.695245    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2ab1701-81e3-4fd8-9fac-93925e6d2162" containerName="payload-processing"
Jul 31 21:02:03.695405 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.695258    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2ab1701-81e3-4fd8-9fac-93925e6d2162" containerName="payload-processing"
Jul 31 21:02:03.695405 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.695269    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00e3f79a-b5c9-4316-a21b-c6b3334f08dd" containerName="payload-pre-processing"
Jul 31 21:02:03.695405 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.695275    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="00e3f79a-b5c9-4316-a21b-c6b3334f08dd" containerName="payload-pre-processing"
Jul 31 21:02:03.695405 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.695329    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2ab1701-81e3-4fd8-9fac-93925e6d2162" containerName="payload-processing"
Jul 31 21:02:03.695405 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.695339    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="00e3f79a-b5c9-4316-a21b-c6b3334f08dd" containerName="payload-pre-processing"
Jul 31 21:02:03.700058 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.700039    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"
Jul 31 21:02:03.702346 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.702305    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-393f5f2a\""
Jul 31 21:02:03.702662 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.702645    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-393f5f2a-dockercfg-7w7lp\""
Jul 31 21:02:03.710307 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.710280    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"]
Jul 31 21:02:03.740630 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.740590    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"]
Jul 31 21:02:03.744221 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.744193    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"
Jul 31 21:02:03.757308 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.757276    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"]
Jul 31 21:02:03.758849 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.758820    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn\" (UID: \"8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"
Jul 31 21:02:03.758975 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.758867    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2n8w\" (UniqueName: \"kubernetes.io/projected/8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e-kube-api-access-g2n8w\") pod \"payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn\" (UID: \"8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"
Jul 31 21:02:03.859664 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.859626    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2n8w\" (UniqueName: \"kubernetes.io/projected/8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e-kube-api-access-g2n8w\") pod \"payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn\" (UID: \"8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"
Jul 31 21:02:03.859866 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.859753    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a60e7e8b-35e5-4dc0-930b-3d67fa7c800b-plugins-config-volume\") pod \"payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l\" (UID: \"a60e7e8b-35e5-4dc0-930b-3d67fa7c800b\") " pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"
Jul 31 21:02:03.859866 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.859786    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxlvq\" (UniqueName: \"kubernetes.io/projected/a60e7e8b-35e5-4dc0-930b-3d67fa7c800b-kube-api-access-zxlvq\") pod \"payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l\" (UID: \"a60e7e8b-35e5-4dc0-930b-3d67fa7c800b\") " pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"
Jul 31 21:02:03.859866 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.859825    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn\" (UID: \"8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"
Jul 31 21:02:03.860564 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.860540    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn\" (UID: \"8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"
Jul 31 21:02:03.871996 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.871964    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2n8w\" (UniqueName: \"kubernetes.io/projected/8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e-kube-api-access-g2n8w\") pod \"payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn\" (UID: \"8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"
Jul 31 21:02:03.960935 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.960898    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a60e7e8b-35e5-4dc0-930b-3d67fa7c800b-plugins-config-volume\") pod \"payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l\" (UID: \"a60e7e8b-35e5-4dc0-930b-3d67fa7c800b\") " pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"
Jul 31 21:02:03.961052 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.960951    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxlvq\" (UniqueName: \"kubernetes.io/projected/a60e7e8b-35e5-4dc0-930b-3d67fa7c800b-kube-api-access-zxlvq\") pod \"payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l\" (UID: \"a60e7e8b-35e5-4dc0-930b-3d67fa7c800b\") " pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"
Jul 31 21:02:03.961794 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.961757    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a60e7e8b-35e5-4dc0-930b-3d67fa7c800b-plugins-config-volume\") pod \"payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l\" (UID: \"a60e7e8b-35e5-4dc0-930b-3d67fa7c800b\") " pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"
Jul 31 21:02:03.969435 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:03.969412    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxlvq\" (UniqueName: \"kubernetes.io/projected/a60e7e8b-35e5-4dc0-930b-3d67fa7c800b-kube-api-access-zxlvq\") pod \"payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l\" (UID: \"a60e7e8b-35e5-4dc0-930b-3d67fa7c800b\") " pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"
Jul 31 21:02:04.011556 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.011516    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"
Jul 31 21:02:04.056050 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.055999    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"
Jul 31 21:02:04.180032 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.179968    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"]
Jul 31 21:02:04.182546 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:02:04.182517    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e0a7a3b_762c_4f21_b2cf_0f80a6eecd2e.slice/crio-4c28006056144e9e480fa1589570f7eefd1fa722ee90149ddee4f51e456d6934 WatchSource:0}: Error finding container 4c28006056144e9e480fa1589570f7eefd1fa722ee90149ddee4f51e456d6934: Status 404 returned error can't find the container with id 4c28006056144e9e480fa1589570f7eefd1fa722ee90149ddee4f51e456d6934
Jul 31 21:02:04.237711 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.237686    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"]
Jul 31 21:02:04.239695 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:02:04.239667    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60e7e8b_35e5_4dc0_930b_3d67fa7c800b.slice/crio-fbb8e5150770d2ff628be4ad1b1329735c1b6d3386805e4182f0444cc60805a8 WatchSource:0}: Error finding container fbb8e5150770d2ff628be4ad1b1329735c1b6d3386805e4182f0444cc60805a8: Status 404 returned error can't find the container with id fbb8e5150770d2ff628be4ad1b1329735c1b6d3386805e4182f0444cc60805a8
Jul 31 21:02:04.247954 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.247904    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:02:04.363394 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.363362    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-workload-socket\") pod \"06374953-b724-45fa-953f-9a5c5d6124ce\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") "
Jul 31 21:02:04.363565 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.363443    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-credential-socket\") pod \"06374953-b724-45fa-953f-9a5c5d6124ce\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") "
Jul 31 21:02:04.363565 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.363478    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-workload-certs\") pod \"06374953-b724-45fa-953f-9a5c5d6124ce\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") "
Jul 31 21:02:04.363565 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.363500    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zff6\" (UniqueName: \"kubernetes.io/projected/06374953-b724-45fa-953f-9a5c5d6124ce-kube-api-access-7zff6\") pod \"06374953-b724-45fa-953f-9a5c5d6124ce\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") "
Jul 31 21:02:04.363565 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.363538    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-istio-envoy\") pod \"06374953-b724-45fa-953f-9a5c5d6124ce\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") "
Jul 31 21:02:04.363732 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.363568    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-istio-data\") pod \"06374953-b724-45fa-953f-9a5c5d6124ce\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") "
Jul 31 21:02:04.363732 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.363592    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06374953-b724-45fa-953f-9a5c5d6124ce-istio-token\") pod \"06374953-b724-45fa-953f-9a5c5d6124ce\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") "
Jul 31 21:02:04.363732 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.363635    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06374953-b724-45fa-953f-9a5c5d6124ce-istio-podinfo\") pod \"06374953-b724-45fa-953f-9a5c5d6124ce\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") "
Jul 31 21:02:04.363732 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.363668    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06374953-b724-45fa-953f-9a5c5d6124ce-istiod-ca-cert\") pod \"06374953-b724-45fa-953f-9a5c5d6124ce\" (UID: \"06374953-b724-45fa-953f-9a5c5d6124ce\") "
Jul 31 21:02:04.363732 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.363682    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "06374953-b724-45fa-953f-9a5c5d6124ce" (UID: "06374953-b724-45fa-953f-9a5c5d6124ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:02:04.363911 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.363790    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "06374953-b724-45fa-953f-9a5c5d6124ce" (UID: "06374953-b724-45fa-953f-9a5c5d6124ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:02:04.363911 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.363807    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "06374953-b724-45fa-953f-9a5c5d6124ce" (UID: "06374953-b724-45fa-953f-9a5c5d6124ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:02:04.363911 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.363870    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "06374953-b724-45fa-953f-9a5c5d6124ce" (UID: "06374953-b724-45fa-953f-9a5c5d6124ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:02:04.364024 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.363986    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-credential-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:02:04.364024 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.364003    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-workload-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:02:04.364024 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.364016    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-istio-data\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:02:04.364188 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.364029    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-workload-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:02:04.364188 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.364060    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06374953-b724-45fa-953f-9a5c5d6124ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "06374953-b724-45fa-953f-9a5c5d6124ce" (UID: "06374953-b724-45fa-953f-9a5c5d6124ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:02:04.366114 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.366089    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "06374953-b724-45fa-953f-9a5c5d6124ce" (UID: "06374953-b724-45fa-953f-9a5c5d6124ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:02:04.366604 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.366581    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06374953-b724-45fa-953f-9a5c5d6124ce-kube-api-access-7zff6" (OuterVolumeSpecName: "kube-api-access-7zff6") pod "06374953-b724-45fa-953f-9a5c5d6124ce" (UID: "06374953-b724-45fa-953f-9a5c5d6124ce"). InnerVolumeSpecName "kube-api-access-7zff6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:02:04.366604 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.366594    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06374953-b724-45fa-953f-9a5c5d6124ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "06374953-b724-45fa-953f-9a5c5d6124ce" (UID: "06374953-b724-45fa-953f-9a5c5d6124ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:02:04.366712 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.366687    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/06374953-b724-45fa-953f-9a5c5d6124ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "06374953-b724-45fa-953f-9a5c5d6124ce" (UID: "06374953-b724-45fa-953f-9a5c5d6124ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 21:02:04.464988 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.464950    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zff6\" (UniqueName: \"kubernetes.io/projected/06374953-b724-45fa-953f-9a5c5d6124ce-kube-api-access-7zff6\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:02:04.464988 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.464989    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06374953-b724-45fa-953f-9a5c5d6124ce-istio-envoy\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:02:04.465249 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.465003    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06374953-b724-45fa-953f-9a5c5d6124ce-istio-token\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:02:04.465249 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.465015    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06374953-b724-45fa-953f-9a5c5d6124ce-istio-podinfo\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:02:04.465249 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.465027    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06374953-b724-45fa-953f-9a5c5d6124ce-istiod-ca-cert\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:02:04.876993 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.876962    2566 generic.go:356] "Generic (PLEG): container finished" podID="06374953-b724-45fa-953f-9a5c5d6124ce" containerID="baaebd97ae09875b8f9fc0b85989d3cea47721baef3de4009eec483004c9c494" exitCode=0
Jul 31 21:02:04.877497 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.877022    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"
Jul 31 21:02:04.877497 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.877036    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96" event={"ID":"06374953-b724-45fa-953f-9a5c5d6124ce","Type":"ContainerDied","Data":"baaebd97ae09875b8f9fc0b85989d3cea47721baef3de4009eec483004c9c494"}
Jul 31 21:02:04.877497 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.877093    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96" event={"ID":"06374953-b724-45fa-953f-9a5c5d6124ce","Type":"ContainerDied","Data":"1f4b08726777d9ed81e92a7bc16de431235dcb6c35391f712fcb661db826008e"}
Jul 31 21:02:04.877497 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.877125    2566 scope.go:117] "RemoveContainer" containerID="baaebd97ae09875b8f9fc0b85989d3cea47721baef3de4009eec483004c9c494"
Jul 31 21:02:04.879132 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.879106    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l" event={"ID":"a60e7e8b-35e5-4dc0-930b-3d67fa7c800b","Type":"ContainerStarted","Data":"4cc603b78f68db90af663da244212648b60cd08c1865bf0ee0a8ec865a4a4a27"}
Jul 31 21:02:04.879307 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.879176    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l" event={"ID":"a60e7e8b-35e5-4dc0-930b-3d67fa7c800b","Type":"ContainerStarted","Data":"fbb8e5150770d2ff628be4ad1b1329735c1b6d3386805e4182f0444cc60805a8"}
Jul 31 21:02:04.879307 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.879211    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"
Jul 31 21:02:04.881226 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.881056    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn" event={"ID":"8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e","Type":"ContainerStarted","Data":"97fa15170b7d35ad20e6687b07bafbcf2c6d2414f22dd83eea4e8bdd53376a36"}
Jul 31 21:02:04.881226 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.881100    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn" event={"ID":"8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e","Type":"ContainerStarted","Data":"4c28006056144e9e480fa1589570f7eefd1fa722ee90149ddee4f51e456d6934"}
Jul 31 21:02:04.881226 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.881162    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"
Jul 31 21:02:04.891561 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.891544    2566 scope.go:117] "RemoveContainer" containerID="be5d403258a98b724c7920411d37a3cd9ed9a294f88c9cab507a87769e4869f9"
Jul 31 21:02:04.899804 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.899758    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn" podStartSLOduration=1.8997402810000001 podStartE2EDuration="1.899740281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:02:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:02:04.897985228 +0000 UTC m=+1929.503377703" watchObservedRunningTime="2026-07-31 21:02:04.899740281 +0000 UTC m=+1929.505132756"
Jul 31 21:02:04.900465 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.900443    2566 scope.go:117] "RemoveContainer" containerID="baaebd97ae09875b8f9fc0b85989d3cea47721baef3de4009eec483004c9c494"
Jul 31 21:02:04.900773 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:02:04.900746    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baaebd97ae09875b8f9fc0b85989d3cea47721baef3de4009eec483004c9c494\": container with ID starting with baaebd97ae09875b8f9fc0b85989d3cea47721baef3de4009eec483004c9c494 not found: ID does not exist" containerID="baaebd97ae09875b8f9fc0b85989d3cea47721baef3de4009eec483004c9c494"
Jul 31 21:02:04.900836 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.900787    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baaebd97ae09875b8f9fc0b85989d3cea47721baef3de4009eec483004c9c494"} err="failed to get container status \"baaebd97ae09875b8f9fc0b85989d3cea47721baef3de4009eec483004c9c494\": rpc error: code = NotFound desc = could not find container \"baaebd97ae09875b8f9fc0b85989d3cea47721baef3de4009eec483004c9c494\": container with ID starting with baaebd97ae09875b8f9fc0b85989d3cea47721baef3de4009eec483004c9c494 not found: ID does not exist"
Jul 31 21:02:04.900836 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.900811    2566 scope.go:117] "RemoveContainer" containerID="be5d403258a98b724c7920411d37a3cd9ed9a294f88c9cab507a87769e4869f9"
Jul 31 21:02:04.901068 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:02:04.901050    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be5d403258a98b724c7920411d37a3cd9ed9a294f88c9cab507a87769e4869f9\": container with ID starting with be5d403258a98b724c7920411d37a3cd9ed9a294f88c9cab507a87769e4869f9 not found: ID does not exist" containerID="be5d403258a98b724c7920411d37a3cd9ed9a294f88c9cab507a87769e4869f9"
Jul 31 21:02:04.901119 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.901074    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be5d403258a98b724c7920411d37a3cd9ed9a294f88c9cab507a87769e4869f9"} err="failed to get container status \"be5d403258a98b724c7920411d37a3cd9ed9a294f88c9cab507a87769e4869f9\": rpc error: code = NotFound desc = could not find container \"be5d403258a98b724c7920411d37a3cd9ed9a294f88c9cab507a87769e4869f9\": container with ID starting with be5d403258a98b724c7920411d37a3cd9ed9a294f88c9cab507a87769e4869f9 not found: ID does not exist"
Jul 31 21:02:04.912208 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.912162    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l" podStartSLOduration=1.91212934 podStartE2EDuration="1.91212934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:02:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:02:04.911895461 +0000 UTC m=+1929.517287938" watchObservedRunningTime="2026-07-31 21:02:04.91212934 +0000 UTC m=+1929.517521807"
Jul 31 21:02:04.925055 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.925029    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"]
Jul 31 21:02:04.929565 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:04.929509    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-80cfef96-openshift-default-6ff96b66c4-pvx96"]
Jul 31 21:02:05.937632 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:05.937594    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06374953-b724-45fa-953f-9a5c5d6124ce" path="/var/lib/kubelet/pods/06374953-b724-45fa-953f-9a5c5d6124ce/volumes"
Jul 31 21:02:15.895075 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:15.895041    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"
Jul 31 21:02:15.895535 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:15.895130    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"
Jul 31 21:02:26.886633 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:26.886597    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9"]
Jul 31 21:02:26.887019 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:26.886951    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06374953-b724-45fa-953f-9a5c5d6124ce" containerName="istio-proxy"
Jul 31 21:02:26.887019 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:26.886961    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="06374953-b724-45fa-953f-9a5c5d6124ce" containerName="istio-proxy"
Jul 31 21:02:26.887739 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:26.887708    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="06374953-b724-45fa-953f-9a5c5d6124ce" containerName="istio-proxy"
Jul 31 21:02:26.893904 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:26.893875    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9"
Jul 31 21:02:26.896723 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:26.896691    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:02:26.897497 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:26.897469    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9"]
Jul 31 21:02:27.055735 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:27.055695    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0977c83b-db47-45b2-b07a-8ece1cac5de0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9\" (UID: \"0977c83b-db47-45b2-b07a-8ece1cac5de0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9"
Jul 31 21:02:27.157082 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:27.156991    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0977c83b-db47-45b2-b07a-8ece1cac5de0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9\" (UID: \"0977c83b-db47-45b2-b07a-8ece1cac5de0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9"
Jul 31 21:02:27.157632 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:27.157610    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0977c83b-db47-45b2-b07a-8ece1cac5de0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9\" (UID: \"0977c83b-db47-45b2-b07a-8ece1cac5de0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9"
Jul 31 21:02:27.206765 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:27.206729    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9"
Jul 31 21:02:27.339260 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:27.339229    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9"]
Jul 31 21:02:27.340719 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:02:27.340687    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0977c83b_db47_45b2_b07a_8ece1cac5de0.slice/crio-0a1f43e54c579dcf18560ae355ff5000533339757f4a12a264959ad91a40d0f0 WatchSource:0}: Error finding container 0a1f43e54c579dcf18560ae355ff5000533339757f4a12a264959ad91a40d0f0: Status 404 returned error can't find the container with id 0a1f43e54c579dcf18560ae355ff5000533339757f4a12a264959ad91a40d0f0
Jul 31 21:02:28.007216 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:28.007105    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9" event={"ID":"0977c83b-db47-45b2-b07a-8ece1cac5de0","Type":"ContainerStarted","Data":"e8587e3841d9ba76c547b8e671c2bc8531cf0fc795fc69fb2f5d7d5c96bd7944"}
Jul 31 21:02:28.007216 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:28.007181    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9" event={"ID":"0977c83b-db47-45b2-b07a-8ece1cac5de0","Type":"ContainerStarted","Data":"0a1f43e54c579dcf18560ae355ff5000533339757f4a12a264959ad91a40d0f0"}
Jul 31 21:02:28.021339 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:28.021289    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9" podStartSLOduration=2.021271338 podStartE2EDuration="2.021271338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:02:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:02:28.020007405 +0000 UTC m=+1952.625399882" watchObservedRunningTime="2026-07-31 21:02:28.021271338 +0000 UTC m=+1952.626663813"
Jul 31 21:02:29.013848 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:29.013808    2566 generic.go:356] "Generic (PLEG): container finished" podID="0977c83b-db47-45b2-b07a-8ece1cac5de0" containerID="e8587e3841d9ba76c547b8e671c2bc8531cf0fc795fc69fb2f5d7d5c96bd7944" exitCode=0
Jul 31 21:02:29.014284 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:29.013895    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9" event={"ID":"0977c83b-db47-45b2-b07a-8ece1cac5de0","Type":"ContainerDied","Data":"e8587e3841d9ba76c547b8e671c2bc8531cf0fc795fc69fb2f5d7d5c96bd7944"}
Jul 31 21:02:30.152872 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:30.152845    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9"
Jul 31 21:02:30.282832 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:30.282738    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0977c83b-db47-45b2-b07a-8ece1cac5de0-maas-api-service-ca\") pod \"0977c83b-db47-45b2-b07a-8ece1cac5de0\" (UID: \"0977c83b-db47-45b2-b07a-8ece1cac5de0\") "
Jul 31 21:02:30.283137 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:30.283109    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0977c83b-db47-45b2-b07a-8ece1cac5de0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0977c83b-db47-45b2-b07a-8ece1cac5de0" (UID: "0977c83b-db47-45b2-b07a-8ece1cac5de0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:02:30.383843 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:30.383791    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0977c83b-db47-45b2-b07a-8ece1cac5de0-maas-api-service-ca\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:02:31.023659 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:31.023631    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9"
Jul 31 21:02:31.023839 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:31.023672    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9" event={"ID":"0977c83b-db47-45b2-b07a-8ece1cac5de0","Type":"ContainerDied","Data":"0a1f43e54c579dcf18560ae355ff5000533339757f4a12a264959ad91a40d0f0"}
Jul 31 21:02:31.023839 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:31.023719    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a1f43e54c579dcf18560ae355ff5000533339757f4a12a264959ad91a40d0f0"
Jul 31 21:02:33.606863 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:33.606829    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"]
Jul 31 21:02:33.607324 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:33.607054    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l" podUID="a60e7e8b-35e5-4dc0-930b-3d67fa7c800b" containerName="payload-processing" containerID="cri-o://4cc603b78f68db90af663da244212648b60cd08c1865bf0ee0a8ec865a4a4a27" gracePeriod=30
Jul 31 21:02:33.616664 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:33.616622    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"]
Jul 31 21:02:33.617702 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:33.616933    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn" podUID="8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e" containerName="payload-pre-processing" containerID="cri-o://97fa15170b7d35ad20e6687b07bafbcf2c6d2414f22dd83eea4e8bdd53376a36" gracePeriod=30
Jul 31 21:02:33.744085 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:33.744050    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9"]
Jul 31 21:02:33.745826 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:33.745801    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-393f5f2a-szkr9"]
Jul 31 21:02:33.939493 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:33.939466    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0977c83b-db47-45b2-b07a-8ece1cac5de0" path="/var/lib/kubelet/pods/0977c83b-db47-45b2-b07a-8ece1cac5de0/volumes"
Jul 31 21:02:33.943251 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:33.943224    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"
Jul 31 21:02:33.945784 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:33.945765    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"
Jul 31 21:02:34.010780 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.010745    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e-plugins-config-volume\") pod \"8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e\" (UID: \"8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e\") "
Jul 31 21:02:34.010780 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.010782    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2n8w\" (UniqueName: \"kubernetes.io/projected/8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e-kube-api-access-g2n8w\") pod \"8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e\" (UID: \"8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e\") "
Jul 31 21:02:34.011182 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.011134    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e" (UID: "8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:02:34.012984 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.012961    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e-kube-api-access-g2n8w" (OuterVolumeSpecName: "kube-api-access-g2n8w") pod "8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e" (UID: "8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e"). InnerVolumeSpecName "kube-api-access-g2n8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:02:34.047071 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.047044    2566 generic.go:356] "Generic (PLEG): container finished" podID="a60e7e8b-35e5-4dc0-930b-3d67fa7c800b" containerID="4cc603b78f68db90af663da244212648b60cd08c1865bf0ee0a8ec865a4a4a27" exitCode=0
Jul 31 21:02:34.047294 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.047086    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"
Jul 31 21:02:34.047294 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.047085    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l" event={"ID":"a60e7e8b-35e5-4dc0-930b-3d67fa7c800b","Type":"ContainerDied","Data":"4cc603b78f68db90af663da244212648b60cd08c1865bf0ee0a8ec865a4a4a27"}
Jul 31 21:02:34.047294 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.047159    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l" event={"ID":"a60e7e8b-35e5-4dc0-930b-3d67fa7c800b","Type":"ContainerDied","Data":"fbb8e5150770d2ff628be4ad1b1329735c1b6d3386805e4182f0444cc60805a8"}
Jul 31 21:02:34.047294 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.047188    2566 scope.go:117] "RemoveContainer" containerID="4cc603b78f68db90af663da244212648b60cd08c1865bf0ee0a8ec865a4a4a27"
Jul 31 21:02:34.048410 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.048391    2566 generic.go:356] "Generic (PLEG): container finished" podID="8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e" containerID="97fa15170b7d35ad20e6687b07bafbcf2c6d2414f22dd83eea4e8bdd53376a36" exitCode=0
Jul 31 21:02:34.048502 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.048426    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"
Jul 31 21:02:34.048502 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.048483    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn" event={"ID":"8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e","Type":"ContainerDied","Data":"97fa15170b7d35ad20e6687b07bafbcf2c6d2414f22dd83eea4e8bdd53376a36"}
Jul 31 21:02:34.048601 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.048538    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn" event={"ID":"8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e","Type":"ContainerDied","Data":"4c28006056144e9e480fa1589570f7eefd1fa722ee90149ddee4f51e456d6934"}
Jul 31 21:02:34.056065 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.056044    2566 scope.go:117] "RemoveContainer" containerID="4cc603b78f68db90af663da244212648b60cd08c1865bf0ee0a8ec865a4a4a27"
Jul 31 21:02:34.056396 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:02:34.056365    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cc603b78f68db90af663da244212648b60cd08c1865bf0ee0a8ec865a4a4a27\": container with ID starting with 4cc603b78f68db90af663da244212648b60cd08c1865bf0ee0a8ec865a4a4a27 not found: ID does not exist" containerID="4cc603b78f68db90af663da244212648b60cd08c1865bf0ee0a8ec865a4a4a27"
Jul 31 21:02:34.056479 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.056402    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc603b78f68db90af663da244212648b60cd08c1865bf0ee0a8ec865a4a4a27"} err="failed to get container status \"4cc603b78f68db90af663da244212648b60cd08c1865bf0ee0a8ec865a4a4a27\": rpc error: code = NotFound desc = could not find container \"4cc603b78f68db90af663da244212648b60cd08c1865bf0ee0a8ec865a4a4a27\": container with ID starting with 4cc603b78f68db90af663da244212648b60cd08c1865bf0ee0a8ec865a4a4a27 not found: ID does not exist"
Jul 31 21:02:34.056479 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.056419    2566 scope.go:117] "RemoveContainer" containerID="97fa15170b7d35ad20e6687b07bafbcf2c6d2414f22dd83eea4e8bdd53376a36"
Jul 31 21:02:34.065227 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.065164    2566 scope.go:117] "RemoveContainer" containerID="97fa15170b7d35ad20e6687b07bafbcf2c6d2414f22dd83eea4e8bdd53376a36"
Jul 31 21:02:34.065509 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:02:34.065488    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97fa15170b7d35ad20e6687b07bafbcf2c6d2414f22dd83eea4e8bdd53376a36\": container with ID starting with 97fa15170b7d35ad20e6687b07bafbcf2c6d2414f22dd83eea4e8bdd53376a36 not found: ID does not exist" containerID="97fa15170b7d35ad20e6687b07bafbcf2c6d2414f22dd83eea4e8bdd53376a36"
Jul 31 21:02:34.065549 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.065516    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97fa15170b7d35ad20e6687b07bafbcf2c6d2414f22dd83eea4e8bdd53376a36"} err="failed to get container status \"97fa15170b7d35ad20e6687b07bafbcf2c6d2414f22dd83eea4e8bdd53376a36\": rpc error: code = NotFound desc = could not find container \"97fa15170b7d35ad20e6687b07bafbcf2c6d2414f22dd83eea4e8bdd53376a36\": container with ID starting with 97fa15170b7d35ad20e6687b07bafbcf2c6d2414f22dd83eea4e8bdd53376a36 not found: ID does not exist"
Jul 31 21:02:34.068989 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.068952    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"]
Jul 31 21:02:34.070548 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.070524    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-393f5f2a-56476fb756-7x6wn"]
Jul 31 21:02:34.111865 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.111831    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a60e7e8b-35e5-4dc0-930b-3d67fa7c800b-plugins-config-volume\") pod \"a60e7e8b-35e5-4dc0-930b-3d67fa7c800b\" (UID: \"a60e7e8b-35e5-4dc0-930b-3d67fa7c800b\") "
Jul 31 21:02:34.112037 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.111888    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxlvq\" (UniqueName: \"kubernetes.io/projected/a60e7e8b-35e5-4dc0-930b-3d67fa7c800b-kube-api-access-zxlvq\") pod \"a60e7e8b-35e5-4dc0-930b-3d67fa7c800b\" (UID: \"a60e7e8b-35e5-4dc0-930b-3d67fa7c800b\") "
Jul 31 21:02:34.112120 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.112081    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:02:34.112120 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.112100    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2n8w\" (UniqueName: \"kubernetes.io/projected/8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e-kube-api-access-g2n8w\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:02:34.112335 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.112294    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a60e7e8b-35e5-4dc0-930b-3d67fa7c800b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a60e7e8b-35e5-4dc0-930b-3d67fa7c800b" (UID: "a60e7e8b-35e5-4dc0-930b-3d67fa7c800b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:02:34.114379 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.114351    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a60e7e8b-35e5-4dc0-930b-3d67fa7c800b-kube-api-access-zxlvq" (OuterVolumeSpecName: "kube-api-access-zxlvq") pod "a60e7e8b-35e5-4dc0-930b-3d67fa7c800b" (UID: "a60e7e8b-35e5-4dc0-930b-3d67fa7c800b"). InnerVolumeSpecName "kube-api-access-zxlvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:02:34.213092 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.212998    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a60e7e8b-35e5-4dc0-930b-3d67fa7c800b-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:02:34.213092 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.213028    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxlvq\" (UniqueName: \"kubernetes.io/projected/a60e7e8b-35e5-4dc0-930b-3d67fa7c800b-kube-api-access-zxlvq\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:02:34.369330 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.369287    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"]
Jul 31 21:02:34.373194 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:34.373168    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-393f5f2a-85cfd89974-rks2l"]
Jul 31 21:02:35.937495 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:35.937460    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e" path="/var/lib/kubelet/pods/8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e/volumes"
Jul 31 21:02:35.937973 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:02:35.937856    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a60e7e8b-35e5-4dc0-930b-3d67fa7c800b" path="/var/lib/kubelet/pods/a60e7e8b-35e5-4dc0-930b-3d67fa7c800b/volumes"
Jul 31 21:04:31.011200 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.011163    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"]
Jul 31 21:04:31.011632 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.011500    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60e7e8b-35e5-4dc0-930b-3d67fa7c800b" containerName="payload-processing"
Jul 31 21:04:31.011632 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.011511    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60e7e8b-35e5-4dc0-930b-3d67fa7c800b" containerName="payload-processing"
Jul 31 21:04:31.011632 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.011525    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06374953-b724-45fa-953f-9a5c5d6124ce" containerName="istio-proxy"
Jul 31 21:04:31.011632 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.011531    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="06374953-b724-45fa-953f-9a5c5d6124ce" containerName="istio-proxy"
Jul 31 21:04:31.011632 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.011539    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e" containerName="payload-pre-processing"
Jul 31 21:04:31.011632 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.011545    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e" containerName="payload-pre-processing"
Jul 31 21:04:31.011632 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.011562    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0977c83b-db47-45b2-b07a-8ece1cac5de0" containerName="revoke-keys"
Jul 31 21:04:31.011632 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.011567    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0977c83b-db47-45b2-b07a-8ece1cac5de0" containerName="revoke-keys"
Jul 31 21:04:31.011632 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.011614    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e0a7a3b-762c-4f21-b2cf-0f80a6eecd2e" containerName="payload-pre-processing"
Jul 31 21:04:31.011632 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.011623    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0977c83b-db47-45b2-b07a-8ece1cac5de0" containerName="revoke-keys"
Jul 31 21:04:31.011632 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.011628    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="06374953-b724-45fa-953f-9a5c5d6124ce" containerName="istio-proxy"
Jul 31 21:04:31.011632 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.011634    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a60e7e8b-35e5-4dc0-930b-3d67fa7c800b" containerName="payload-processing"
Jul 31 21:04:31.014482 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.014463    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.027965 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.027940    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-30ff49ee-openshift-default-dockercfg-mg8rv\""
Jul 31 21:04:31.056305 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.056267    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"]
Jul 31 21:04:31.100809 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.100770    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-workload-socket\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.100809 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.100808    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-podinfo\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.101040 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.100842    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-data\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.101040 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.100891    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-credential-socket\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.101040 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.100913    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db0d80c0-f26e-4e14-85d7-fededb27fae5-istiod-ca-cert\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.101040 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.100944    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-token\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.101040 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.100976    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-envoy\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.101040 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.101031    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xvvj\" (UniqueName: \"kubernetes.io/projected/db0d80c0-f26e-4e14-85d7-fededb27fae5-kube-api-access-8xvvj\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.101296 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.101052    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-workload-certs\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.202221 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.202170    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-data\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.202221 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.202227    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-credential-socket\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.202454 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.202247    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db0d80c0-f26e-4e14-85d7-fededb27fae5-istiod-ca-cert\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.202454 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.202270    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-token\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.202454 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.202304    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-envoy\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.202454 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.202336    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xvvj\" (UniqueName: \"kubernetes.io/projected/db0d80c0-f26e-4e14-85d7-fededb27fae5-kube-api-access-8xvvj\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.202454 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.202354    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-workload-certs\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.202454 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.202387    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-workload-socket\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.202454 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.202403    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-podinfo\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.203086 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.203060    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-credential-socket\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.203231 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.203188    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-workload-certs\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.203359 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.203337    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-workload-socket\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.203397 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.203349    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-data\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.203492 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.203475    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db0d80c0-f26e-4e14-85d7-fededb27fae5-istiod-ca-cert\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.205618 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.205596    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-envoy\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.205801 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.205781    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-podinfo\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.221051 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.221022    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xvvj\" (UniqueName: \"kubernetes.io/projected/db0d80c0-f26e-4e14-85d7-fededb27fae5-kube-api-access-8xvvj\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.229690 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.229654    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-token\") pod \"e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") " pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.324804 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.324762    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:31.472824 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.472797    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"]
Jul 31 21:04:31.475363 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:04:31.475334    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0d80c0_f26e_4e14_85d7_fededb27fae5.slice/crio-8c74efaf56943acfa52fd193b553ebd1811f284617ff84f04379da1dd2dc6012 WatchSource:0}: Error finding container 8c74efaf56943acfa52fd193b553ebd1811f284617ff84f04379da1dd2dc6012: Status 404 returned error can't find the container with id 8c74efaf56943acfa52fd193b553ebd1811f284617ff84f04379da1dd2dc6012
Jul 31 21:04:31.477448 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.477416    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:04:31.477530 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.477490    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:04:31.477530 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.477521    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:04:31.624020 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.623932    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz" event={"ID":"db0d80c0-f26e-4e14-85d7-fededb27fae5","Type":"ContainerStarted","Data":"65d55f95804713b32983d291e0fb97171efdb3b2e08a844da5682843b04d1c89"}
Jul 31 21:04:31.624020 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.623998    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz" event={"ID":"db0d80c0-f26e-4e14-85d7-fededb27fae5","Type":"ContainerStarted","Data":"8c74efaf56943acfa52fd193b553ebd1811f284617ff84f04379da1dd2dc6012"}
Jul 31 21:04:31.645887 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:31.645826    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz" podStartSLOduration=1.645811507 podStartE2EDuration="1.645811507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:04:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:04:31.644910598 +0000 UTC m=+2076.250303075" watchObservedRunningTime="2026-07-31 21:04:31.645811507 +0000 UTC m=+2076.251204033"
Jul 31 21:04:32.325638 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:32.325591    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:32.332288 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:32.332252    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:32.628722 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:32.628618    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:32.629930 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:32.629906    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:35.813481 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:35.813440    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"]
Jul 31 21:04:35.817430 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:35.817401    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"
Jul 31 21:04:35.819865 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:35.819840    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-30ff49ee-dockercfg-5xctq\""
Jul 31 21:04:35.819991 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:35.819873    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-30ff49ee\""
Jul 31 21:04:35.828352 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:35.828317    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"]
Jul 31 21:04:35.849619 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:35.849578    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xkrt\" (UniqueName: \"kubernetes.io/projected/4124967d-4dc8-4480-9e4e-a0df1c1d0eb7-kube-api-access-7xkrt\") pod \"payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp\" (UID: \"4124967d-4dc8-4480-9e4e-a0df1c1d0eb7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"
Jul 31 21:04:35.849802 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:35.849683    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4124967d-4dc8-4480-9e4e-a0df1c1d0eb7-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp\" (UID: \"4124967d-4dc8-4480-9e4e-a0df1c1d0eb7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"
Jul 31 21:04:35.951065 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:35.951022    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4124967d-4dc8-4480-9e4e-a0df1c1d0eb7-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp\" (UID: \"4124967d-4dc8-4480-9e4e-a0df1c1d0eb7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"
Jul 31 21:04:35.951273 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:35.951118    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xkrt\" (UniqueName: \"kubernetes.io/projected/4124967d-4dc8-4480-9e4e-a0df1c1d0eb7-kube-api-access-7xkrt\") pod \"payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp\" (UID: \"4124967d-4dc8-4480-9e4e-a0df1c1d0eb7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"
Jul 31 21:04:35.951809 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:35.951787    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4124967d-4dc8-4480-9e4e-a0df1c1d0eb7-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp\" (UID: \"4124967d-4dc8-4480-9e4e-a0df1c1d0eb7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"
Jul 31 21:04:35.959235 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:35.959201    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xkrt\" (UniqueName: \"kubernetes.io/projected/4124967d-4dc8-4480-9e4e-a0df1c1d0eb7-kube-api-access-7xkrt\") pod \"payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp\" (UID: \"4124967d-4dc8-4480-9e4e-a0df1c1d0eb7\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"
Jul 31 21:04:36.130870 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:36.130771    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"
Jul 31 21:04:36.274720 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:36.274694    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"]
Jul 31 21:04:36.276695 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:04:36.276665    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4124967d_4dc8_4480_9e4e_a0df1c1d0eb7.slice/crio-770682cbf1b5211ab9d61b406827b035e2afe510f021a926d68d0cae9b9000d3 WatchSource:0}: Error finding container 770682cbf1b5211ab9d61b406827b035e2afe510f021a926d68d0cae9b9000d3: Status 404 returned error can't find the container with id 770682cbf1b5211ab9d61b406827b035e2afe510f021a926d68d0cae9b9000d3
Jul 31 21:04:36.651797 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:36.651761    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp" event={"ID":"4124967d-4dc8-4480-9e4e-a0df1c1d0eb7","Type":"ContainerStarted","Data":"5dc9e9fadd82dfdfa7708afd89b41c5a682d1a79c41618057f7e24f2157ba66c"}
Jul 31 21:04:36.651979 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:36.651813    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp" event={"ID":"4124967d-4dc8-4480-9e4e-a0df1c1d0eb7","Type":"ContainerStarted","Data":"770682cbf1b5211ab9d61b406827b035e2afe510f021a926d68d0cae9b9000d3"}
Jul 31 21:04:36.651979 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:36.651891    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"
Jul 31 21:04:36.669634 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:36.669569    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp" podStartSLOduration=1.669549052 podStartE2EDuration="1.669549052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:04:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:04:36.667257028 +0000 UTC m=+2081.272649504" watchObservedRunningTime="2026-07-31 21:04:36.669549052 +0000 UTC m=+2081.274941530"
Jul 31 21:04:47.659344 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:47.659304    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"
Jul 31 21:04:48.266817 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:48.265525    2566 patch_prober.go:28] interesting pod/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:35556->10.133.0.59:15021: read: connection reset by peer" start-of-body=
Jul 31 21:04:48.266817 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:48.265604    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz" podUID="db0d80c0-f26e-4e14-85d7-fededb27fae5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:35556->10.133.0.59:15021: read: connection reset by peer"
Jul 31 21:04:48.717840 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:48.717806    2566 generic.go:356] "Generic (PLEG): container finished" podID="db0d80c0-f26e-4e14-85d7-fededb27fae5" containerID="65d55f95804713b32983d291e0fb97171efdb3b2e08a844da5682843b04d1c89" exitCode=0
Jul 31 21:04:48.718334 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:48.717880    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz" event={"ID":"db0d80c0-f26e-4e14-85d7-fededb27fae5","Type":"ContainerDied","Data":"65d55f95804713b32983d291e0fb97171efdb3b2e08a844da5682843b04d1c89"}
Jul 31 21:04:48.718334 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:48.718295    2566 scope.go:117] "RemoveContainer" containerID="65d55f95804713b32983d291e0fb97171efdb3b2e08a844da5682843b04d1c89"
Jul 31 21:04:48.719381 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:48.719356    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:04:48.719441 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:48.719418    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:04:48.719485 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:48.719449    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:04:49.724172 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:49.724113    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz" event={"ID":"db0d80c0-f26e-4e14-85d7-fededb27fae5","Type":"ContainerStarted","Data":"fd7428101b459b7d8295acf47fb02d65a7638f5110bfb9f2f3ac7137c09e7a30"}
Jul 31 21:04:50.324933 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:50.324895    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:50.325213 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:50.325191    2566 patch_prober.go:28] interesting pod/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 31 21:04:50.325275 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:50.325239    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz" podUID="db0d80c0-f26e-4e14-85d7-fededb27fae5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 31 21:04:51.326058 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:51.326022    2566 patch_prober.go:28] interesting pod/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 31 21:04:51.326475 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:51.326080    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz" podUID="db0d80c0-f26e-4e14-85d7-fededb27fae5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 31 21:04:52.325775 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:52.325737    2566 patch_prober.go:28] interesting pod/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 31 21:04:52.325970 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:52.325793    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz" podUID="db0d80c0-f26e-4e14-85d7-fededb27fae5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 31 21:04:53.325505 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:53.325459    2566 patch_prober.go:28] interesting pod/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 31 21:04:53.325916 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:53.325531    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz" podUID="db0d80c0-f26e-4e14-85d7-fededb27fae5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 31 21:04:54.326033 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:54.325990    2566 patch_prober.go:28] interesting pod/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 31 21:04:54.326567 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:54.326074    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz" podUID="db0d80c0-f26e-4e14-85d7-fededb27fae5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 31 21:04:55.329611 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:55.329580    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:55.330015 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:55.329854    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:04:55.330662 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:04:55.330646    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:05:16.969652 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:16.969616    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"]
Jul 31 21:05:16.971349 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:16.971305    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp" podUID="4124967d-4dc8-4480-9e4e-a0df1c1d0eb7" containerName="payload-pre-processing" containerID="cri-o://5dc9e9fadd82dfdfa7708afd89b41c5a682d1a79c41618057f7e24f2157ba66c" gracePeriod=30
Jul 31 21:05:17.248931 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:17.248900    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"
Jul 31 21:05:17.332161 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:17.332119    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4124967d-4dc8-4480-9e4e-a0df1c1d0eb7-plugins-config-volume\") pod \"4124967d-4dc8-4480-9e4e-a0df1c1d0eb7\" (UID: \"4124967d-4dc8-4480-9e4e-a0df1c1d0eb7\") "
Jul 31 21:05:17.332362 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:17.332184    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xkrt\" (UniqueName: \"kubernetes.io/projected/4124967d-4dc8-4480-9e4e-a0df1c1d0eb7-kube-api-access-7xkrt\") pod \"4124967d-4dc8-4480-9e4e-a0df1c1d0eb7\" (UID: \"4124967d-4dc8-4480-9e4e-a0df1c1d0eb7\") "
Jul 31 21:05:17.332698 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:17.332667    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4124967d-4dc8-4480-9e4e-a0df1c1d0eb7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4124967d-4dc8-4480-9e4e-a0df1c1d0eb7" (UID: "4124967d-4dc8-4480-9e4e-a0df1c1d0eb7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:05:17.334980 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:17.334954    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4124967d-4dc8-4480-9e4e-a0df1c1d0eb7-kube-api-access-7xkrt" (OuterVolumeSpecName: "kube-api-access-7xkrt") pod "4124967d-4dc8-4480-9e4e-a0df1c1d0eb7" (UID: "4124967d-4dc8-4480-9e4e-a0df1c1d0eb7"). InnerVolumeSpecName "kube-api-access-7xkrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:05:17.433707 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:17.433663    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4124967d-4dc8-4480-9e4e-a0df1c1d0eb7-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:05:17.433707 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:17.433702    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xkrt\" (UniqueName: \"kubernetes.io/projected/4124967d-4dc8-4480-9e4e-a0df1c1d0eb7-kube-api-access-7xkrt\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:05:17.870763 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:17.870727    2566 generic.go:356] "Generic (PLEG): container finished" podID="4124967d-4dc8-4480-9e4e-a0df1c1d0eb7" containerID="5dc9e9fadd82dfdfa7708afd89b41c5a682d1a79c41618057f7e24f2157ba66c" exitCode=0
Jul 31 21:05:17.870968 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:17.870770    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"
Jul 31 21:05:17.870968 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:17.870770    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp" event={"ID":"4124967d-4dc8-4480-9e4e-a0df1c1d0eb7","Type":"ContainerDied","Data":"5dc9e9fadd82dfdfa7708afd89b41c5a682d1a79c41618057f7e24f2157ba66c"}
Jul 31 21:05:17.870968 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:17.870950    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp" event={"ID":"4124967d-4dc8-4480-9e4e-a0df1c1d0eb7","Type":"ContainerDied","Data":"770682cbf1b5211ab9d61b406827b035e2afe510f021a926d68d0cae9b9000d3"}
Jul 31 21:05:17.871178 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:17.870991    2566 scope.go:117] "RemoveContainer" containerID="5dc9e9fadd82dfdfa7708afd89b41c5a682d1a79c41618057f7e24f2157ba66c"
Jul 31 21:05:17.879659 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:17.879644    2566 scope.go:117] "RemoveContainer" containerID="5dc9e9fadd82dfdfa7708afd89b41c5a682d1a79c41618057f7e24f2157ba66c"
Jul 31 21:05:17.879902 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:05:17.879882    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dc9e9fadd82dfdfa7708afd89b41c5a682d1a79c41618057f7e24f2157ba66c\": container with ID starting with 5dc9e9fadd82dfdfa7708afd89b41c5a682d1a79c41618057f7e24f2157ba66c not found: ID does not exist" containerID="5dc9e9fadd82dfdfa7708afd89b41c5a682d1a79c41618057f7e24f2157ba66c"
Jul 31 21:05:17.879943 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:17.879909    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dc9e9fadd82dfdfa7708afd89b41c5a682d1a79c41618057f7e24f2157ba66c"} err="failed to get container status \"5dc9e9fadd82dfdfa7708afd89b41c5a682d1a79c41618057f7e24f2157ba66c\": rpc error: code = NotFound desc = could not find container \"5dc9e9fadd82dfdfa7708afd89b41c5a682d1a79c41618057f7e24f2157ba66c\": container with ID starting with 5dc9e9fadd82dfdfa7708afd89b41c5a682d1a79c41618057f7e24f2157ba66c not found: ID does not exist"
Jul 31 21:05:17.895004 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:17.894978    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"]
Jul 31 21:05:17.897495 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:17.897463    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-30ff49ee-6864dd4668-dxggp"]
Jul 31 21:05:17.936381 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:17.936354    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4124967d-4dc8-4480-9e4e-a0df1c1d0eb7" path="/var/lib/kubelet/pods/4124967d-4dc8-4480-9e4e-a0df1c1d0eb7/volumes"
Jul 31 21:05:23.547940 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:23.547901    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"]
Jul 31 21:05:23.548461 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:23.548254    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz" podUID="db0d80c0-f26e-4e14-85d7-fededb27fae5" containerName="istio-proxy" containerID="cri-o://fd7428101b459b7d8295acf47fb02d65a7638f5110bfb9f2f3ac7137c09e7a30" gracePeriod=30
Jul 31 21:05:25.332325 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:25.332287    2566 patch_prober.go:28] interesting pod/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 21:05:25.332718 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:25.332348    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz" podUID="db0d80c0-f26e-4e14-85d7-fededb27fae5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 21:05:28.801294 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.801267    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:05:28.835580 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.835485    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-workload-socket\") pod \"db0d80c0-f26e-4e14-85d7-fededb27fae5\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") "
Jul 31 21:05:28.835580 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.835533    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db0d80c0-f26e-4e14-85d7-fededb27fae5-istiod-ca-cert\") pod \"db0d80c0-f26e-4e14-85d7-fededb27fae5\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") "
Jul 31 21:05:28.835818 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.835584    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-credential-socket\") pod \"db0d80c0-f26e-4e14-85d7-fededb27fae5\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") "
Jul 31 21:05:28.835818 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.835608    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-podinfo\") pod \"db0d80c0-f26e-4e14-85d7-fededb27fae5\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") "
Jul 31 21:05:28.835818 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.835624    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-data\") pod \"db0d80c0-f26e-4e14-85d7-fededb27fae5\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") "
Jul 31 21:05:28.835818 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.835752    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xvvj\" (UniqueName: \"kubernetes.io/projected/db0d80c0-f26e-4e14-85d7-fededb27fae5-kube-api-access-8xvvj\") pod \"db0d80c0-f26e-4e14-85d7-fededb27fae5\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") "
Jul 31 21:05:28.835818 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.835803    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-workload-certs\") pod \"db0d80c0-f26e-4e14-85d7-fededb27fae5\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") "
Jul 31 21:05:28.836093 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.835849    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-envoy\") pod \"db0d80c0-f26e-4e14-85d7-fededb27fae5\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") "
Jul 31 21:05:28.836093 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.835883    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-token\") pod \"db0d80c0-f26e-4e14-85d7-fededb27fae5\" (UID: \"db0d80c0-f26e-4e14-85d7-fededb27fae5\") "
Jul 31 21:05:28.836093 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.835893    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "db0d80c0-f26e-4e14-85d7-fededb27fae5" (UID: "db0d80c0-f26e-4e14-85d7-fededb27fae5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:05:28.836093 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.835906    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-data" (OuterVolumeSpecName: "istio-data") pod "db0d80c0-f26e-4e14-85d7-fededb27fae5" (UID: "db0d80c0-f26e-4e14-85d7-fededb27fae5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:05:28.836093 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.835986    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db0d80c0-f26e-4e14-85d7-fededb27fae5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "db0d80c0-f26e-4e14-85d7-fededb27fae5" (UID: "db0d80c0-f26e-4e14-85d7-fededb27fae5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:05:28.836388 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.836115    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "db0d80c0-f26e-4e14-85d7-fededb27fae5" (UID: "db0d80c0-f26e-4e14-85d7-fededb27fae5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:05:28.836388 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.836323    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-workload-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:05:28.836388 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.836334    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "db0d80c0-f26e-4e14-85d7-fededb27fae5" (UID: "db0d80c0-f26e-4e14-85d7-fededb27fae5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:05:28.836388 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.836344    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db0d80c0-f26e-4e14-85d7-fededb27fae5-istiod-ca-cert\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:05:28.836388 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.836359    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-credential-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:05:28.836388 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.836372    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-data\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:05:28.838489 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.838440    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "db0d80c0-f26e-4e14-85d7-fededb27fae5" (UID: "db0d80c0-f26e-4e14-85d7-fededb27fae5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:05:28.838690 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.838664    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "db0d80c0-f26e-4e14-85d7-fededb27fae5" (UID: "db0d80c0-f26e-4e14-85d7-fededb27fae5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 21:05:28.838690 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.838674    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-token" (OuterVolumeSpecName: "istio-token") pod "db0d80c0-f26e-4e14-85d7-fededb27fae5" (UID: "db0d80c0-f26e-4e14-85d7-fededb27fae5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:05:28.838928 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.838898    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db0d80c0-f26e-4e14-85d7-fededb27fae5-kube-api-access-8xvvj" (OuterVolumeSpecName: "kube-api-access-8xvvj") pod "db0d80c0-f26e-4e14-85d7-fededb27fae5" (UID: "db0d80c0-f26e-4e14-85d7-fededb27fae5"). InnerVolumeSpecName "kube-api-access-8xvvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:05:28.926702 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.926663    2566 generic.go:356] "Generic (PLEG): container finished" podID="db0d80c0-f26e-4e14-85d7-fededb27fae5" containerID="fd7428101b459b7d8295acf47fb02d65a7638f5110bfb9f2f3ac7137c09e7a30" exitCode=0
Jul 31 21:05:28.926876 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.926715    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz" event={"ID":"db0d80c0-f26e-4e14-85d7-fededb27fae5","Type":"ContainerDied","Data":"fd7428101b459b7d8295acf47fb02d65a7638f5110bfb9f2f3ac7137c09e7a30"}
Jul 31 21:05:28.926876 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.926734    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"
Jul 31 21:05:28.926876 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.926800    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz" event={"ID":"db0d80c0-f26e-4e14-85d7-fededb27fae5","Type":"ContainerDied","Data":"8c74efaf56943acfa52fd193b553ebd1811f284617ff84f04379da1dd2dc6012"}
Jul 31 21:05:28.926876 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.926833    2566 scope.go:117] "RemoveContainer" containerID="fd7428101b459b7d8295acf47fb02d65a7638f5110bfb9f2f3ac7137c09e7a30"
Jul 31 21:05:28.936608 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.936588    2566 scope.go:117] "RemoveContainer" containerID="65d55f95804713b32983d291e0fb97171efdb3b2e08a844da5682843b04d1c89"
Jul 31 21:05:28.936860 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.936838    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-podinfo\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:05:28.936935 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.936868    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xvvj\" (UniqueName: \"kubernetes.io/projected/db0d80c0-f26e-4e14-85d7-fededb27fae5-kube-api-access-8xvvj\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:05:28.936935 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.936884    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-envoy\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:05:28.936935 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.936896    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db0d80c0-f26e-4e14-85d7-fededb27fae5-istio-token\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:05:28.936935 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.936908    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db0d80c0-f26e-4e14-85d7-fededb27fae5-workload-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:05:28.945017 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.944995    2566 scope.go:117] "RemoveContainer" containerID="fd7428101b459b7d8295acf47fb02d65a7638f5110bfb9f2f3ac7137c09e7a30"
Jul 31 21:05:28.945332 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:05:28.945308    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd7428101b459b7d8295acf47fb02d65a7638f5110bfb9f2f3ac7137c09e7a30\": container with ID starting with fd7428101b459b7d8295acf47fb02d65a7638f5110bfb9f2f3ac7137c09e7a30 not found: ID does not exist" containerID="fd7428101b459b7d8295acf47fb02d65a7638f5110bfb9f2f3ac7137c09e7a30"
Jul 31 21:05:28.945390 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.945342    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd7428101b459b7d8295acf47fb02d65a7638f5110bfb9f2f3ac7137c09e7a30"} err="failed to get container status \"fd7428101b459b7d8295acf47fb02d65a7638f5110bfb9f2f3ac7137c09e7a30\": rpc error: code = NotFound desc = could not find container \"fd7428101b459b7d8295acf47fb02d65a7638f5110bfb9f2f3ac7137c09e7a30\": container with ID starting with fd7428101b459b7d8295acf47fb02d65a7638f5110bfb9f2f3ac7137c09e7a30 not found: ID does not exist"
Jul 31 21:05:28.945390 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.945362    2566 scope.go:117] "RemoveContainer" containerID="65d55f95804713b32983d291e0fb97171efdb3b2e08a844da5682843b04d1c89"
Jul 31 21:05:28.945611 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:05:28.945592    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65d55f95804713b32983d291e0fb97171efdb3b2e08a844da5682843b04d1c89\": container with ID starting with 65d55f95804713b32983d291e0fb97171efdb3b2e08a844da5682843b04d1c89 not found: ID does not exist" containerID="65d55f95804713b32983d291e0fb97171efdb3b2e08a844da5682843b04d1c89"
Jul 31 21:05:28.945656 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.945618    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d55f95804713b32983d291e0fb97171efdb3b2e08a844da5682843b04d1c89"} err="failed to get container status \"65d55f95804713b32983d291e0fb97171efdb3b2e08a844da5682843b04d1c89\": rpc error: code = NotFound desc = could not find container \"65d55f95804713b32983d291e0fb97171efdb3b2e08a844da5682843b04d1c89\": container with ID starting with 65d55f95804713b32983d291e0fb97171efdb3b2e08a844da5682843b04d1c89 not found: ID does not exist"
Jul 31 21:05:28.949197 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.949172    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"]
Jul 31 21:05:28.953259 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:28.953237    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-30ff49ee-openshift-default-8d85fb-9grwz"]
Jul 31 21:05:29.935751 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:05:29.935719    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db0d80c0-f26e-4e14-85d7-fededb27fae5" path="/var/lib/kubelet/pods/db0d80c0-f26e-4e14-85d7-fededb27fae5/volumes"
Jul 31 21:06:04.444031 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:04.443995    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"]
Jul 31 21:06:04.444569 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:04.444235    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4" podUID="7c9379ac-9c05-4445-9f14-6318a014aa34" containerName="manager" containerID="cri-o://42bd8bd5501735a68d0633b74af31d251a458f32cebefd590e17f514b6bbf7a5" gracePeriod=10
Jul 31 21:06:04.703953 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:04.703877    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"
Jul 31 21:06:04.852641 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:04.852600    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c9379ac-9c05-4445-9f14-6318a014aa34-extensions-socket-volume\") pod \"7c9379ac-9c05-4445-9f14-6318a014aa34\" (UID: \"7c9379ac-9c05-4445-9f14-6318a014aa34\") "
Jul 31 21:06:04.852833 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:04.852722    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tz8nh\" (UniqueName: \"kubernetes.io/projected/7c9379ac-9c05-4445-9f14-6318a014aa34-kube-api-access-tz8nh\") pod \"7c9379ac-9c05-4445-9f14-6318a014aa34\" (UID: \"7c9379ac-9c05-4445-9f14-6318a014aa34\") "
Jul 31 21:06:04.853007 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:04.852984    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c9379ac-9c05-4445-9f14-6318a014aa34-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7c9379ac-9c05-4445-9f14-6318a014aa34" (UID: "7c9379ac-9c05-4445-9f14-6318a014aa34"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:06:04.855007 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:04.854979    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c9379ac-9c05-4445-9f14-6318a014aa34-kube-api-access-tz8nh" (OuterVolumeSpecName: "kube-api-access-tz8nh") pod "7c9379ac-9c05-4445-9f14-6318a014aa34" (UID: "7c9379ac-9c05-4445-9f14-6318a014aa34"). InnerVolumeSpecName "kube-api-access-tz8nh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:06:04.953727 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:04.953691    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz8nh\" (UniqueName: \"kubernetes.io/projected/7c9379ac-9c05-4445-9f14-6318a014aa34-kube-api-access-tz8nh\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:06:04.953727 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:04.953721    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c9379ac-9c05-4445-9f14-6318a014aa34-extensions-socket-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:06:05.101652 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:05.101610    2566 generic.go:356] "Generic (PLEG): container finished" podID="7c9379ac-9c05-4445-9f14-6318a014aa34" containerID="42bd8bd5501735a68d0633b74af31d251a458f32cebefd590e17f514b6bbf7a5" exitCode=0
Jul 31 21:06:05.101823 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:05.101658    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"
Jul 31 21:06:05.101823 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:05.101687    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4" event={"ID":"7c9379ac-9c05-4445-9f14-6318a014aa34","Type":"ContainerDied","Data":"42bd8bd5501735a68d0633b74af31d251a458f32cebefd590e17f514b6bbf7a5"}
Jul 31 21:06:05.101823 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:05.101738    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4" event={"ID":"7c9379ac-9c05-4445-9f14-6318a014aa34","Type":"ContainerDied","Data":"d01e713e358f2311ca4cb24283199f4fc3359c06a00d2834b66707203c5a08c9"}
Jul 31 21:06:05.101823 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:05.101760    2566 scope.go:117] "RemoveContainer" containerID="42bd8bd5501735a68d0633b74af31d251a458f32cebefd590e17f514b6bbf7a5"
Jul 31 21:06:05.112371 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:05.112349    2566 scope.go:117] "RemoveContainer" containerID="42bd8bd5501735a68d0633b74af31d251a458f32cebefd590e17f514b6bbf7a5"
Jul 31 21:06:05.112676 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:06:05.112656    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42bd8bd5501735a68d0633b74af31d251a458f32cebefd590e17f514b6bbf7a5\": container with ID starting with 42bd8bd5501735a68d0633b74af31d251a458f32cebefd590e17f514b6bbf7a5 not found: ID does not exist" containerID="42bd8bd5501735a68d0633b74af31d251a458f32cebefd590e17f514b6bbf7a5"
Jul 31 21:06:05.112762 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:05.112686    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42bd8bd5501735a68d0633b74af31d251a458f32cebefd590e17f514b6bbf7a5"} err="failed to get container status \"42bd8bd5501735a68d0633b74af31d251a458f32cebefd590e17f514b6bbf7a5\": rpc error: code = NotFound desc = could not find container \"42bd8bd5501735a68d0633b74af31d251a458f32cebefd590e17f514b6bbf7a5\": container with ID starting with 42bd8bd5501735a68d0633b74af31d251a458f32cebefd590e17f514b6bbf7a5 not found: ID does not exist"
Jul 31 21:06:05.123073 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:05.123044    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"]
Jul 31 21:06:05.128391 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:05.128365    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-whdc4"]
Jul 31 21:06:05.934821 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:05.934788    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c9379ac-9c05-4445-9f14-6318a014aa34" path="/var/lib/kubelet/pods/7c9379ac-9c05-4445-9f14-6318a014aa34/volumes"
Jul 31 21:06:56.144122 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:06:56.144087    2566 scope.go:117] "RemoveContainer" containerID="b8b1b04f87a97fa9cc629144488b3adcaf3bc9724f1a70ec95ae9bcd6853b3a5"
Jul 31 21:07:20.074205 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.074089    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jm82b"]
Jul 31 21:07:20.074696 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.074625    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c9379ac-9c05-4445-9f14-6318a014aa34" containerName="manager"
Jul 31 21:07:20.074696 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.074642    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c9379ac-9c05-4445-9f14-6318a014aa34" containerName="manager"
Jul 31 21:07:20.074696 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.074656    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db0d80c0-f26e-4e14-85d7-fededb27fae5" containerName="istio-proxy"
Jul 31 21:07:20.074696 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.074663    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="db0d80c0-f26e-4e14-85d7-fededb27fae5" containerName="istio-proxy"
Jul 31 21:07:20.074696 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.074694    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4124967d-4dc8-4480-9e4e-a0df1c1d0eb7" containerName="payload-pre-processing"
Jul 31 21:07:20.074959 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.074705    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4124967d-4dc8-4480-9e4e-a0df1c1d0eb7" containerName="payload-pre-processing"
Jul 31 21:07:20.074959 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.074789    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c9379ac-9c05-4445-9f14-6318a014aa34" containerName="manager"
Jul 31 21:07:20.074959 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.074802    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="db0d80c0-f26e-4e14-85d7-fededb27fae5" containerName="istio-proxy"
Jul 31 21:07:20.074959 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.074810    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4124967d-4dc8-4480-9e4e-a0df1c1d0eb7" containerName="payload-pre-processing"
Jul 31 21:07:20.074959 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.074822    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="db0d80c0-f26e-4e14-85d7-fededb27fae5" containerName="istio-proxy"
Jul 31 21:07:20.077808 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.077788    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jm82b"
Jul 31 21:07:20.080843 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.080824    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x6hqm\""
Jul 31 21:07:20.087307 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.087285    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jm82b"]
Jul 31 21:07:20.196527 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.196480    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a95aef9d-13dd-477f-a5ed-45ba2159d58e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-jm82b\" (UID: \"a95aef9d-13dd-477f-a5ed-45ba2159d58e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jm82b"
Jul 31 21:07:20.196527 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.196539    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w5v6\" (UniqueName: \"kubernetes.io/projected/a95aef9d-13dd-477f-a5ed-45ba2159d58e-kube-api-access-5w5v6\") pod \"kuadrant-operator-controller-manager-68cf589589-jm82b\" (UID: \"a95aef9d-13dd-477f-a5ed-45ba2159d58e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jm82b"
Jul 31 21:07:20.297985 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.297939    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a95aef9d-13dd-477f-a5ed-45ba2159d58e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-jm82b\" (UID: \"a95aef9d-13dd-477f-a5ed-45ba2159d58e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jm82b"
Jul 31 21:07:20.298205 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.297996    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w5v6\" (UniqueName: \"kubernetes.io/projected/a95aef9d-13dd-477f-a5ed-45ba2159d58e-kube-api-access-5w5v6\") pod \"kuadrant-operator-controller-manager-68cf589589-jm82b\" (UID: \"a95aef9d-13dd-477f-a5ed-45ba2159d58e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jm82b"
Jul 31 21:07:20.298382 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.298360    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a95aef9d-13dd-477f-a5ed-45ba2159d58e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-jm82b\" (UID: \"a95aef9d-13dd-477f-a5ed-45ba2159d58e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jm82b"
Jul 31 21:07:20.306321 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.306292    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w5v6\" (UniqueName: \"kubernetes.io/projected/a95aef9d-13dd-477f-a5ed-45ba2159d58e-kube-api-access-5w5v6\") pod \"kuadrant-operator-controller-manager-68cf589589-jm82b\" (UID: \"a95aef9d-13dd-477f-a5ed-45ba2159d58e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jm82b"
Jul 31 21:07:20.388094 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.387995    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jm82b"
Jul 31 21:07:20.525458 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:20.525432    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jm82b"]
Jul 31 21:07:20.527558 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:07:20.527522    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda95aef9d_13dd_477f_a5ed_45ba2159d58e.slice/crio-940387b630706d190bd43fec8fdc4420e41fe76725c9fac8db7e6c2fc661411b WatchSource:0}: Error finding container 940387b630706d190bd43fec8fdc4420e41fe76725c9fac8db7e6c2fc661411b: Status 404 returned error can't find the container with id 940387b630706d190bd43fec8fdc4420e41fe76725c9fac8db7e6c2fc661411b
Jul 31 21:07:21.467258 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:21.467223    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jm82b" event={"ID":"a95aef9d-13dd-477f-a5ed-45ba2159d58e","Type":"ContainerStarted","Data":"9d38557342835d756dd727d9b575a0f325e4a21f9e894e5096f0bc26a02542ab"}
Jul 31 21:07:21.467674 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:21.467276    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jm82b" event={"ID":"a95aef9d-13dd-477f-a5ed-45ba2159d58e","Type":"ContainerStarted","Data":"940387b630706d190bd43fec8fdc4420e41fe76725c9fac8db7e6c2fc661411b"}
Jul 31 21:07:21.467674 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:21.467374    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jm82b"
Jul 31 21:07:21.487673 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:21.487621    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jm82b" podStartSLOduration=1.48760366 podStartE2EDuration="1.48760366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:07:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:07:21.485577618 +0000 UTC m=+2246.090970094" watchObservedRunningTime="2026-07-31 21:07:21.48760366 +0000 UTC m=+2246.092996136"
Jul 31 21:07:32.474374 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:32.474343    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jm82b"
Jul 31 21:07:39.338167 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.338116    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"]
Jul 31 21:07:39.338673 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.338656    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db0d80c0-f26e-4e14-85d7-fededb27fae5" containerName="istio-proxy"
Jul 31 21:07:39.338756 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.338678    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="db0d80c0-f26e-4e14-85d7-fededb27fae5" containerName="istio-proxy"
Jul 31 21:07:39.341981 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.341963    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.344391 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.344367    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-cceca8ff-openshift-default-dockercfg-7mntv\""
Jul 31 21:07:39.351117 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.351087    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"]
Jul 31 21:07:39.473669 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.473621    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-data\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.473669 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.473677    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddf5g\" (UniqueName: \"kubernetes.io/projected/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-kube-api-access-ddf5g\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.473948 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.473710    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-workload-socket\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.473948 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.473725    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-credential-socket\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.473948 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.473857    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-envoy\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.474078 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.473961    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-token\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.474078 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.473984    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-podinfo\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.474078 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.474013    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-workload-certs\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.474078 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.474030    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istiod-ca-cert\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.574493 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.574459    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-workload-socket\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.574493 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.574494    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-credential-socket\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.574738 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.574511    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-envoy\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.574738 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.574560    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-token\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.574738 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.574581    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-podinfo\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.574738 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.574607    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-workload-certs\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.574738 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.574631    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istiod-ca-cert\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.574738 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.574671    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-data\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.574738 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.574698    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddf5g\" (UniqueName: \"kubernetes.io/projected/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-kube-api-access-ddf5g\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.575088 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.574932    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-credential-socket\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.575088 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.574982    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-workload-socket\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.575263 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.575239    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-data\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.575322 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.575285    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-workload-certs\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.575525 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.575470    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istiod-ca-cert\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.577121 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.577094    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-envoy\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.577386 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.577369    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-podinfo\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.582696 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.582667    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-token\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.583312 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.583289    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddf5g\" (UniqueName: \"kubernetes.io/projected/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-kube-api-access-ddf5g\") pod \"e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") " pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.655886 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.655779    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:39.812964 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.812933    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"]
Jul 31 21:07:39.815184 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:07:39.815126    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e9a8e5_96c2_4c7a_b276_0470016bb49b.slice/crio-dcc0d23276a4b65028febc9608c0abf029ca3626ab459d51940b2c4020bde6c6 WatchSource:0}: Error finding container dcc0d23276a4b65028febc9608c0abf029ca3626ab459d51940b2c4020bde6c6: Status 404 returned error can't find the container with id dcc0d23276a4b65028febc9608c0abf029ca3626ab459d51940b2c4020bde6c6
Jul 31 21:07:39.817421 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.817375    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:07:39.817514 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.817459    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:07:39.817514 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:39.817495    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:07:40.562953 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:40.562914    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52" event={"ID":"c2e9a8e5-96c2-4c7a-b276-0470016bb49b","Type":"ContainerStarted","Data":"8e86f75c5567ac4a362f1136ff28982e0094cae9cee9c21142b33fed79b3b438"}
Jul 31 21:07:40.563406 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:40.562977    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52" event={"ID":"c2e9a8e5-96c2-4c7a-b276-0470016bb49b","Type":"ContainerStarted","Data":"dcc0d23276a4b65028febc9608c0abf029ca3626ab459d51940b2c4020bde6c6"}
Jul 31 21:07:40.584807 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:40.584750    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52" podStartSLOduration=1.584730926 podStartE2EDuration="1.584730926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:07:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:07:40.584457263 +0000 UTC m=+2265.189849739" watchObservedRunningTime="2026-07-31 21:07:40.584730926 +0000 UTC m=+2265.190123786"
Jul 31 21:07:40.656946 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:40.656901    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:40.662054 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:40.662024    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:41.568035 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:41.567995    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:41.569033 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:41.569009    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:44.425313 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:44.425273    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"]
Jul 31 21:07:44.428830 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:44.428805    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"
Jul 31 21:07:44.431502 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:44.431471    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-cceca8ff\""
Jul 31 21:07:44.431639 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:44.431527    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-cceca8ff-dockercfg-h927g\""
Jul 31 21:07:44.439485 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:44.439451    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"]
Jul 31 21:07:44.521299 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:44.521264    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5g5r\" (UniqueName: \"kubernetes.io/projected/f9fc8a8b-85cd-4e5a-8350-9185a6930ba5-kube-api-access-s5g5r\") pod \"payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn\" (UID: \"f9fc8a8b-85cd-4e5a-8350-9185a6930ba5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"
Jul 31 21:07:44.521480 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:44.521319    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9fc8a8b-85cd-4e5a-8350-9185a6930ba5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn\" (UID: \"f9fc8a8b-85cd-4e5a-8350-9185a6930ba5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"
Jul 31 21:07:44.621829 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:44.621792    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5g5r\" (UniqueName: \"kubernetes.io/projected/f9fc8a8b-85cd-4e5a-8350-9185a6930ba5-kube-api-access-s5g5r\") pod \"payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn\" (UID: \"f9fc8a8b-85cd-4e5a-8350-9185a6930ba5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"
Jul 31 21:07:44.621999 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:44.621845    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9fc8a8b-85cd-4e5a-8350-9185a6930ba5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn\" (UID: \"f9fc8a8b-85cd-4e5a-8350-9185a6930ba5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"
Jul 31 21:07:44.622540 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:44.622520    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9fc8a8b-85cd-4e5a-8350-9185a6930ba5-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn\" (UID: \"f9fc8a8b-85cd-4e5a-8350-9185a6930ba5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"
Jul 31 21:07:44.629358 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:44.629327    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5g5r\" (UniqueName: \"kubernetes.io/projected/f9fc8a8b-85cd-4e5a-8350-9185a6930ba5-kube-api-access-s5g5r\") pod \"payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn\" (UID: \"f9fc8a8b-85cd-4e5a-8350-9185a6930ba5\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"
Jul 31 21:07:44.741697 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:44.741606    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"
Jul 31 21:07:44.885310 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:44.885279    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"]
Jul 31 21:07:44.887498 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:07:44.887470    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9fc8a8b_85cd_4e5a_8350_9185a6930ba5.slice/crio-5ce60f0806b1d97948065b6ec8377a1f63026b39a8dd00630479c1721cdaac61 WatchSource:0}: Error finding container 5ce60f0806b1d97948065b6ec8377a1f63026b39a8dd00630479c1721cdaac61: Status 404 returned error can't find the container with id 5ce60f0806b1d97948065b6ec8377a1f63026b39a8dd00630479c1721cdaac61
Jul 31 21:07:45.588966 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:45.588930    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn" event={"ID":"f9fc8a8b-85cd-4e5a-8350-9185a6930ba5","Type":"ContainerStarted","Data":"001f923e24c561ff6748394e42f79f49152417b959160d770df3acec9db80fe1"}
Jul 31 21:07:45.589407 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:45.588988    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn" event={"ID":"f9fc8a8b-85cd-4e5a-8350-9185a6930ba5","Type":"ContainerStarted","Data":"5ce60f0806b1d97948065b6ec8377a1f63026b39a8dd00630479c1721cdaac61"}
Jul 31 21:07:45.589407 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:45.589088    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"
Jul 31 21:07:45.604360 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:45.604303    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn" podStartSLOduration=1.604286948 podStartE2EDuration="1.604286948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:07:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:07:45.602391046 +0000 UTC m=+2270.207783522" watchObservedRunningTime="2026-07-31 21:07:45.604286948 +0000 UTC m=+2270.209679454"
Jul 31 21:07:56.166876 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:56.166842    2566 scope.go:117] "RemoveContainer" containerID="bbafbe232cc6ceb900b876b8b4b81f28bc8e9e17f52e4c0fdd746f447843a012"
Jul 31 21:07:56.569755 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:56.569718    2566 patch_prober.go:28] interesting pod/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 31 21:07:56.569934 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:56.569784    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52" podUID="c2e9a8e5-96c2-4c7a-b276-0470016bb49b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 31 21:07:56.597421 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:56.597390    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"
Jul 31 21:07:56.645090 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:56.645060    2566 generic.go:356] "Generic (PLEG): container finished" podID="c2e9a8e5-96c2-4c7a-b276-0470016bb49b" containerID="8e86f75c5567ac4a362f1136ff28982e0094cae9cee9c21142b33fed79b3b438" exitCode=0
Jul 31 21:07:56.645279 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:56.645135    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52" event={"ID":"c2e9a8e5-96c2-4c7a-b276-0470016bb49b","Type":"ContainerDied","Data":"8e86f75c5567ac4a362f1136ff28982e0094cae9cee9c21142b33fed79b3b438"}
Jul 31 21:07:56.645586 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:56.645556    2566 scope.go:117] "RemoveContainer" containerID="8e86f75c5567ac4a362f1136ff28982e0094cae9cee9c21142b33fed79b3b438"
Jul 31 21:07:56.646717 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:56.646687    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:07:56.646797 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:56.646777    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:07:56.646836 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:56.646824    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:07:57.655785 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:57.655747    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52" event={"ID":"c2e9a8e5-96c2-4c7a-b276-0470016bb49b","Type":"ContainerStarted","Data":"a354184ed2fa739732e8fef1273041e119a98520970ada15b335af4238d7d73f"}
Jul 31 21:07:58.656817 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:58.656766    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:07:58.657357 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:58.657059    2566 patch_prober.go:28] interesting pod/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 31 21:07:58.657357 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:58.657122    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52" podUID="c2e9a8e5-96c2-4c7a-b276-0470016bb49b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 31 21:07:59.656488 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:59.656445    2566 patch_prober.go:28] interesting pod/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 31 21:07:59.656688 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:07:59.656508    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52" podUID="c2e9a8e5-96c2-4c7a-b276-0470016bb49b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 31 21:08:00.656869 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:00.656822    2566 patch_prober.go:28] interesting pod/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 31 21:08:00.657383 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:00.656894    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52" podUID="c2e9a8e5-96c2-4c7a-b276-0470016bb49b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 31 21:08:01.657168 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:01.657107    2566 patch_prober.go:28] interesting pod/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 31 21:08:01.657667 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:01.657206    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52" podUID="c2e9a8e5-96c2-4c7a-b276-0470016bb49b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 31 21:08:02.656807 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:02.656768    2566 patch_prober.go:28] interesting pod/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 31 21:08:02.657008 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:02.656841    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52" podUID="c2e9a8e5-96c2-4c7a-b276-0470016bb49b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 31 21:08:03.661419 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:03.661378    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:08:03.661915 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:03.661809    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:08:03.662480 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:03.662460    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:08:34.278848 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.278817    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"]
Jul 31 21:08:34.282347 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.282325    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.285845 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.285812    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-cceca8ff\"/\"default-dockercfg-2vrcr\""
Jul 31 21:08:34.285845 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.285830    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-cceca8ff\"/\"e2e-lifecycle-model-cceca8ff-kserve-self-signed-certs\""
Jul 31 21:08:34.286058 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.285847    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-cceca8ff\"/\"openshift-service-ca.crt\""
Jul 31 21:08:34.286058 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.285818    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-cceca8ff\"/\"kube-root-ca.crt\""
Jul 31 21:08:34.291585 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.291562    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"]
Jul 31 21:08:34.375842 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.375808    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-home\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.376006 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.375846    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbmng\" (UniqueName: \"kubernetes.io/projected/1074c052-abd6-4ec5-98eb-7ed3670a0b89-kube-api-access-xbmng\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.376006 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.375879    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-model-cache\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.376006 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.375912    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-tmp-dir\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.376006 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.375990    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-dshm\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.376161 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.376010    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1074c052-abd6-4ec5-98eb-7ed3670a0b89-tls-certs\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.477226 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.477186    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-home\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.477226 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.477231    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbmng\" (UniqueName: \"kubernetes.io/projected/1074c052-abd6-4ec5-98eb-7ed3670a0b89-kube-api-access-xbmng\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.477468 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.477258    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-model-cache\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.477468 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.477293    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-tmp-dir\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.477468 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.477370    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-dshm\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.477468 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.477392    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1074c052-abd6-4ec5-98eb-7ed3670a0b89-tls-certs\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.477678 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.477629    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-home\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.477737 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.477680    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-model-cache\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.477737 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.477692    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-tmp-dir\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.479872 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.479853    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-dshm\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.480069 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.480053    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1074c052-abd6-4ec5-98eb-7ed3670a0b89-tls-certs\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.485599 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.485574    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbmng\" (UniqueName: \"kubernetes.io/projected/1074c052-abd6-4ec5-98eb-7ed3670a0b89-kube-api-access-xbmng\") pod \"e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") " pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.592228 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.592180    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:34.746613 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.746583    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"]
Jul 31 21:08:34.750054 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:08:34.750026    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1074c052_abd6_4ec5_98eb_7ed3670a0b89.slice/crio-aaaf27ec1d948f1d12fa7636d71e878b5335a483121652d09ef9f4fa51fc99dc WatchSource:0}: Error finding container aaaf27ec1d948f1d12fa7636d71e878b5335a483121652d09ef9f4fa51fc99dc: Status 404 returned error can't find the container with id aaaf27ec1d948f1d12fa7636d71e878b5335a483121652d09ef9f4fa51fc99dc
Jul 31 21:08:34.844435 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.844336    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s" event={"ID":"1074c052-abd6-4ec5-98eb-7ed3670a0b89","Type":"ContainerStarted","Data":"501d5f25995bcea5344cb83988a27afd579cc2362d4c216b33126aefeed71360"}
Jul 31 21:08:34.844435 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.844387    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s" event={"ID":"1074c052-abd6-4ec5-98eb-7ed3670a0b89","Type":"ContainerStarted","Data":"aaaf27ec1d948f1d12fa7636d71e878b5335a483121652d09ef9f4fa51fc99dc"}
Jul 31 21:08:34.861391 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:34.860840    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s" podStartSLOduration=0.860819354 podStartE2EDuration="860.819354ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:08:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:08:34.859503941 +0000 UTC m=+2319.464896429" watchObservedRunningTime="2026-07-31 21:08:34.860819354 +0000 UTC m=+2319.466211830"
Jul 31 21:08:44.593305 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:44.593267    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:44.593792 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:44.593354    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:44.605882 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:44.605849    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:44.904520 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:44.904434    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:08:56.186243 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:08:56.186123    2566 scope.go:117] "RemoveContainer" containerID="e8587e3841d9ba76c547b8e671c2bc8531cf0fc795fc69fb2f5d7d5c96bd7944"
Jul 31 21:09:18.091465 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:18.091431    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"]
Jul 31 21:09:18.091984 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:18.091650    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn" podUID="f9fc8a8b-85cd-4e5a-8350-9185a6930ba5" containerName="payload-pre-processing" containerID="cri-o://001f923e24c561ff6748394e42f79f49152417b959160d770df3acec9db80fe1" gracePeriod=30
Jul 31 21:09:18.349483 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:18.349416    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"
Jul 31 21:09:18.437911 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:18.437877    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9fc8a8b-85cd-4e5a-8350-9185a6930ba5-plugins-config-volume\") pod \"f9fc8a8b-85cd-4e5a-8350-9185a6930ba5\" (UID: \"f9fc8a8b-85cd-4e5a-8350-9185a6930ba5\") "
Jul 31 21:09:18.438117 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:18.437981    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5g5r\" (UniqueName: \"kubernetes.io/projected/f9fc8a8b-85cd-4e5a-8350-9185a6930ba5-kube-api-access-s5g5r\") pod \"f9fc8a8b-85cd-4e5a-8350-9185a6930ba5\" (UID: \"f9fc8a8b-85cd-4e5a-8350-9185a6930ba5\") "
Jul 31 21:09:18.438350 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:18.438323    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9fc8a8b-85cd-4e5a-8350-9185a6930ba5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f9fc8a8b-85cd-4e5a-8350-9185a6930ba5" (UID: "f9fc8a8b-85cd-4e5a-8350-9185a6930ba5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:09:18.440268 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:18.440240    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9fc8a8b-85cd-4e5a-8350-9185a6930ba5-kube-api-access-s5g5r" (OuterVolumeSpecName: "kube-api-access-s5g5r") pod "f9fc8a8b-85cd-4e5a-8350-9185a6930ba5" (UID: "f9fc8a8b-85cd-4e5a-8350-9185a6930ba5"). InnerVolumeSpecName "kube-api-access-s5g5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:09:18.538896 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:18.538852    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9fc8a8b-85cd-4e5a-8350-9185a6930ba5-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:09:18.538896 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:18.538888    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5g5r\" (UniqueName: \"kubernetes.io/projected/f9fc8a8b-85cd-4e5a-8350-9185a6930ba5-kube-api-access-s5g5r\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:09:19.064994 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:19.064956    2566 generic.go:356] "Generic (PLEG): container finished" podID="f9fc8a8b-85cd-4e5a-8350-9185a6930ba5" containerID="001f923e24c561ff6748394e42f79f49152417b959160d770df3acec9db80fe1" exitCode=0
Jul 31 21:09:19.064994 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:19.064993    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"
Jul 31 21:09:19.065256 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:19.065049    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn" event={"ID":"f9fc8a8b-85cd-4e5a-8350-9185a6930ba5","Type":"ContainerDied","Data":"001f923e24c561ff6748394e42f79f49152417b959160d770df3acec9db80fe1"}
Jul 31 21:09:19.065256 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:19.065111    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn" event={"ID":"f9fc8a8b-85cd-4e5a-8350-9185a6930ba5","Type":"ContainerDied","Data":"5ce60f0806b1d97948065b6ec8377a1f63026b39a8dd00630479c1721cdaac61"}
Jul 31 21:09:19.065256 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:19.065172    2566 scope.go:117] "RemoveContainer" containerID="001f923e24c561ff6748394e42f79f49152417b959160d770df3acec9db80fe1"
Jul 31 21:09:19.078944 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:19.078920    2566 scope.go:117] "RemoveContainer" containerID="001f923e24c561ff6748394e42f79f49152417b959160d770df3acec9db80fe1"
Jul 31 21:09:19.079301 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:09:19.079278    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"001f923e24c561ff6748394e42f79f49152417b959160d770df3acec9db80fe1\": container with ID starting with 001f923e24c561ff6748394e42f79f49152417b959160d770df3acec9db80fe1 not found: ID does not exist" containerID="001f923e24c561ff6748394e42f79f49152417b959160d770df3acec9db80fe1"
Jul 31 21:09:19.079368 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:19.079310    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"001f923e24c561ff6748394e42f79f49152417b959160d770df3acec9db80fe1"} err="failed to get container status \"001f923e24c561ff6748394e42f79f49152417b959160d770df3acec9db80fe1\": rpc error: code = NotFound desc = could not find container \"001f923e24c561ff6748394e42f79f49152417b959160d770df3acec9db80fe1\": container with ID starting with 001f923e24c561ff6748394e42f79f49152417b959160d770df3acec9db80fe1 not found: ID does not exist"
Jul 31 21:09:19.092786 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:19.092755    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"]
Jul 31 21:09:19.094462 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:19.094442    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-cceca8ff-866d457dcb-dp4gn"]
Jul 31 21:09:19.935756 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:19.935718    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9fc8a8b-85cd-4e5a-8350-9185a6930ba5" path="/var/lib/kubelet/pods/f9fc8a8b-85cd-4e5a-8350-9185a6930ba5/volumes"
Jul 31 21:09:26.576700 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:26.576666    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"]
Jul 31 21:09:41.596865 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:41.596819    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s" podUID="1074c052-abd6-4ec5-98eb-7ed3670a0b89" containerName="main" containerID="cri-o://501d5f25995bcea5344cb83988a27afd579cc2362d4c216b33126aefeed71360" gracePeriod=45
Jul 31 21:09:41.855340 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:41.855272    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:09:41.952249 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:41.952216    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-tmp-dir\") pod \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") "
Jul 31 21:09:41.952249 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:41.952250    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-dshm\") pod \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") "
Jul 31 21:09:41.952494 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:41.952285    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1074c052-abd6-4ec5-98eb-7ed3670a0b89-tls-certs\") pod \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") "
Jul 31 21:09:41.952494 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:41.952316    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbmng\" (UniqueName: \"kubernetes.io/projected/1074c052-abd6-4ec5-98eb-7ed3670a0b89-kube-api-access-xbmng\") pod \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") "
Jul 31 21:09:41.952494 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:41.952350    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-home\") pod \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") "
Jul 31 21:09:41.952494 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:41.952367    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-model-cache\") pod \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\" (UID: \"1074c052-abd6-4ec5-98eb-7ed3670a0b89\") "
Jul 31 21:09:41.952724 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:41.952515    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1074c052-abd6-4ec5-98eb-7ed3670a0b89" (UID: "1074c052-abd6-4ec5-98eb-7ed3670a0b89"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:09:41.952724 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:41.952652    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-home" (OuterVolumeSpecName: "home") pod "1074c052-abd6-4ec5-98eb-7ed3670a0b89" (UID: "1074c052-abd6-4ec5-98eb-7ed3670a0b89"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:09:41.952833 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:41.952741    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-model-cache" (OuterVolumeSpecName: "model-cache") pod "1074c052-abd6-4ec5-98eb-7ed3670a0b89" (UID: "1074c052-abd6-4ec5-98eb-7ed3670a0b89"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:09:41.954643 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:41.954613    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-dshm" (OuterVolumeSpecName: "dshm") pod "1074c052-abd6-4ec5-98eb-7ed3670a0b89" (UID: "1074c052-abd6-4ec5-98eb-7ed3670a0b89"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:09:41.954755 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:41.954685    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1074c052-abd6-4ec5-98eb-7ed3670a0b89-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1074c052-abd6-4ec5-98eb-7ed3670a0b89" (UID: "1074c052-abd6-4ec5-98eb-7ed3670a0b89"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:09:41.954755 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:41.954695    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1074c052-abd6-4ec5-98eb-7ed3670a0b89-kube-api-access-xbmng" (OuterVolumeSpecName: "kube-api-access-xbmng") pod "1074c052-abd6-4ec5-98eb-7ed3670a0b89" (UID: "1074c052-abd6-4ec5-98eb-7ed3670a0b89"). InnerVolumeSpecName "kube-api-access-xbmng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:09:42.053930 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:42.053884    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-tmp-dir\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:09:42.053930 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:42.053920    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-dshm\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:09:42.053930 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:42.053928    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1074c052-abd6-4ec5-98eb-7ed3670a0b89-tls-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:09:42.053930 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:42.053939    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbmng\" (UniqueName: \"kubernetes.io/projected/1074c052-abd6-4ec5-98eb-7ed3670a0b89-kube-api-access-xbmng\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:09:42.054250 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:42.053949    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-home\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:09:42.054250 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:42.053957    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1074c052-abd6-4ec5-98eb-7ed3670a0b89-model-cache\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:09:42.176112 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:42.176013    2566 generic.go:356] "Generic (PLEG): container finished" podID="1074c052-abd6-4ec5-98eb-7ed3670a0b89" containerID="501d5f25995bcea5344cb83988a27afd579cc2362d4c216b33126aefeed71360" exitCode=0
Jul 31 21:09:42.176112 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:42.176066    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"
Jul 31 21:09:42.176379 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:42.176113    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s" event={"ID":"1074c052-abd6-4ec5-98eb-7ed3670a0b89","Type":"ContainerDied","Data":"501d5f25995bcea5344cb83988a27afd579cc2362d4c216b33126aefeed71360"}
Jul 31 21:09:42.176379 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:42.176197    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s" event={"ID":"1074c052-abd6-4ec5-98eb-7ed3670a0b89","Type":"ContainerDied","Data":"aaaf27ec1d948f1d12fa7636d71e878b5335a483121652d09ef9f4fa51fc99dc"}
Jul 31 21:09:42.176379 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:42.176222    2566 scope.go:117] "RemoveContainer" containerID="501d5f25995bcea5344cb83988a27afd579cc2362d4c216b33126aefeed71360"
Jul 31 21:09:42.185462 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:42.185444    2566 scope.go:117] "RemoveContainer" containerID="501d5f25995bcea5344cb83988a27afd579cc2362d4c216b33126aefeed71360"
Jul 31 21:09:42.185733 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:09:42.185717    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"501d5f25995bcea5344cb83988a27afd579cc2362d4c216b33126aefeed71360\": container with ID starting with 501d5f25995bcea5344cb83988a27afd579cc2362d4c216b33126aefeed71360 not found: ID does not exist" containerID="501d5f25995bcea5344cb83988a27afd579cc2362d4c216b33126aefeed71360"
Jul 31 21:09:42.185772 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:42.185741    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"501d5f25995bcea5344cb83988a27afd579cc2362d4c216b33126aefeed71360"} err="failed to get container status \"501d5f25995bcea5344cb83988a27afd579cc2362d4c216b33126aefeed71360\": rpc error: code = NotFound desc = could not find container \"501d5f25995bcea5344cb83988a27afd579cc2362d4c216b33126aefeed71360\": container with ID starting with 501d5f25995bcea5344cb83988a27afd579cc2362d4c216b33126aefeed71360 not found: ID does not exist"
Jul 31 21:09:42.196164 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:42.196117    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"]
Jul 31 21:09:42.199907 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:42.199882    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-cceca8ff/e2e-lifecycle-model-cceca8ff-kserve-7ff9959787-w2s7s"]
Jul 31 21:09:43.935254 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:09:43.935218    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1074c052-abd6-4ec5-98eb-7ed3670a0b89" path="/var/lib/kubelet/pods/1074c052-abd6-4ec5-98eb-7ed3670a0b89/volumes"
Jul 31 21:10:09.290238 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:09.290195    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"]
Jul 31 21:10:09.290894 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:09.290487    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52" podUID="c2e9a8e5-96c2-4c7a-b276-0470016bb49b" containerName="istio-proxy" containerID="cri-o://a354184ed2fa739732e8fef1273041e119a98520970ada15b335af4238d7d73f" gracePeriod=30
Jul 31 21:10:14.556316 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.556239    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:10:14.647581 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.647551    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istiod-ca-cert\") pod \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") "
Jul 31 21:10:14.647771 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.647591    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-data\") pod \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") "
Jul 31 21:10:14.647771 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.647637    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-credential-socket\") pod \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") "
Jul 31 21:10:14.647771 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.647671    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-token\") pod \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") "
Jul 31 21:10:14.647771 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.647707    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddf5g\" (UniqueName: \"kubernetes.io/projected/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-kube-api-access-ddf5g\") pod \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") "
Jul 31 21:10:14.647771 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.647733    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-envoy\") pod \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") "
Jul 31 21:10:14.647771 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.647756    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-podinfo\") pod \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") "
Jul 31 21:10:14.648072 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.647793    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-workload-certs\") pod \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") "
Jul 31 21:10:14.648072 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.647829    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-workload-socket\") pod \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\" (UID: \"c2e9a8e5-96c2-4c7a-b276-0470016bb49b\") "
Jul 31 21:10:14.648072 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.647934    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-data" (OuterVolumeSpecName: "istio-data") pod "c2e9a8e5-96c2-4c7a-b276-0470016bb49b" (UID: "c2e9a8e5-96c2-4c7a-b276-0470016bb49b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:10:14.648072 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.648054    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c2e9a8e5-96c2-4c7a-b276-0470016bb49b" (UID: "c2e9a8e5-96c2-4c7a-b276-0470016bb49b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:10:14.648309 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.648119    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c2e9a8e5-96c2-4c7a-b276-0470016bb49b" (UID: "c2e9a8e5-96c2-4c7a-b276-0470016bb49b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:10:14.648309 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.648177    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-data\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:10:14.648309 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.648177    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c2e9a8e5-96c2-4c7a-b276-0470016bb49b" (UID: "c2e9a8e5-96c2-4c7a-b276-0470016bb49b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:10:14.648417 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.648368    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c2e9a8e5-96c2-4c7a-b276-0470016bb49b" (UID: "c2e9a8e5-96c2-4c7a-b276-0470016bb49b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:10:14.650239 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.650210    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c2e9a8e5-96c2-4c7a-b276-0470016bb49b" (UID: "c2e9a8e5-96c2-4c7a-b276-0470016bb49b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 21:10:14.650239 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.650229    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c2e9a8e5-96c2-4c7a-b276-0470016bb49b" (UID: "c2e9a8e5-96c2-4c7a-b276-0470016bb49b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:10:14.650428 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.650242    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-kube-api-access-ddf5g" (OuterVolumeSpecName: "kube-api-access-ddf5g") pod "c2e9a8e5-96c2-4c7a-b276-0470016bb49b" (UID: "c2e9a8e5-96c2-4c7a-b276-0470016bb49b"). InnerVolumeSpecName "kube-api-access-ddf5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:10:14.650486 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.650467    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-token" (OuterVolumeSpecName: "istio-token") pod "c2e9a8e5-96c2-4c7a-b276-0470016bb49b" (UID: "c2e9a8e5-96c2-4c7a-b276-0470016bb49b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:10:14.749551 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.749515    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istiod-ca-cert\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:10:14.749551 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.749549    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-credential-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:10:14.749551 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.749561    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-token\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:10:14.749808 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.749570    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddf5g\" (UniqueName: \"kubernetes.io/projected/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-kube-api-access-ddf5g\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:10:14.749808 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.749580    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-envoy\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:10:14.749808 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.749589    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-istio-podinfo\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:10:14.749808 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.749596    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-workload-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:10:14.749808 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:14.749603    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2e9a8e5-96c2-4c7a-b276-0470016bb49b-workload-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:10:15.332678 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:15.332634    2566 generic.go:356] "Generic (PLEG): container finished" podID="c2e9a8e5-96c2-4c7a-b276-0470016bb49b" containerID="a354184ed2fa739732e8fef1273041e119a98520970ada15b335af4238d7d73f" exitCode=0
Jul 31 21:10:15.332878 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:15.332699    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"
Jul 31 21:10:15.332878 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:15.332735    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52" event={"ID":"c2e9a8e5-96c2-4c7a-b276-0470016bb49b","Type":"ContainerDied","Data":"a354184ed2fa739732e8fef1273041e119a98520970ada15b335af4238d7d73f"}
Jul 31 21:10:15.332878 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:15.332806    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52" event={"ID":"c2e9a8e5-96c2-4c7a-b276-0470016bb49b","Type":"ContainerDied","Data":"dcc0d23276a4b65028febc9608c0abf029ca3626ab459d51940b2c4020bde6c6"}
Jul 31 21:10:15.332878 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:15.332840    2566 scope.go:117] "RemoveContainer" containerID="a354184ed2fa739732e8fef1273041e119a98520970ada15b335af4238d7d73f"
Jul 31 21:10:15.342203 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:15.342179    2566 scope.go:117] "RemoveContainer" containerID="8e86f75c5567ac4a362f1136ff28982e0094cae9cee9c21142b33fed79b3b438"
Jul 31 21:10:15.350052 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:15.350032    2566 scope.go:117] "RemoveContainer" containerID="a354184ed2fa739732e8fef1273041e119a98520970ada15b335af4238d7d73f"
Jul 31 21:10:15.350357 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:10:15.350336    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a354184ed2fa739732e8fef1273041e119a98520970ada15b335af4238d7d73f\": container with ID starting with a354184ed2fa739732e8fef1273041e119a98520970ada15b335af4238d7d73f not found: ID does not exist" containerID="a354184ed2fa739732e8fef1273041e119a98520970ada15b335af4238d7d73f"
Jul 31 21:10:15.350438 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:15.350371    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a354184ed2fa739732e8fef1273041e119a98520970ada15b335af4238d7d73f"} err="failed to get container status \"a354184ed2fa739732e8fef1273041e119a98520970ada15b335af4238d7d73f\": rpc error: code = NotFound desc = could not find container \"a354184ed2fa739732e8fef1273041e119a98520970ada15b335af4238d7d73f\": container with ID starting with a354184ed2fa739732e8fef1273041e119a98520970ada15b335af4238d7d73f not found: ID does not exist"
Jul 31 21:10:15.350438 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:15.350397    2566 scope.go:117] "RemoveContainer" containerID="8e86f75c5567ac4a362f1136ff28982e0094cae9cee9c21142b33fed79b3b438"
Jul 31 21:10:15.350648 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:10:15.350629    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e86f75c5567ac4a362f1136ff28982e0094cae9cee9c21142b33fed79b3b438\": container with ID starting with 8e86f75c5567ac4a362f1136ff28982e0094cae9cee9c21142b33fed79b3b438 not found: ID does not exist" containerID="8e86f75c5567ac4a362f1136ff28982e0094cae9cee9c21142b33fed79b3b438"
Jul 31 21:10:15.350690 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:15.350656    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e86f75c5567ac4a362f1136ff28982e0094cae9cee9c21142b33fed79b3b438"} err="failed to get container status \"8e86f75c5567ac4a362f1136ff28982e0094cae9cee9c21142b33fed79b3b438\": rpc error: code = NotFound desc = could not find container \"8e86f75c5567ac4a362f1136ff28982e0094cae9cee9c21142b33fed79b3b438\": container with ID starting with 8e86f75c5567ac4a362f1136ff28982e0094cae9cee9c21142b33fed79b3b438 not found: ID does not exist"
Jul 31 21:10:15.354690 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:15.354667    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"]
Jul 31 21:10:15.360613 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:15.360592    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-cceca8ff-openshift-default-58f4c66cb8-zjv52"]
Jul 31 21:10:15.935228 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:10:15.935195    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2e9a8e5-96c2-4c7a-b276-0470016bb49b" path="/var/lib/kubelet/pods/c2e9a8e5-96c2-4c7a-b276-0470016bb49b/volumes"
Jul 31 21:11:14.838741 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.838700    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"]
Jul 31 21:11:14.839369 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.839053    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1074c052-abd6-4ec5-98eb-7ed3670a0b89" containerName="main"
Jul 31 21:11:14.839369 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.839064    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1074c052-abd6-4ec5-98eb-7ed3670a0b89" containerName="main"
Jul 31 21:11:14.839369 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.839075    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9fc8a8b-85cd-4e5a-8350-9185a6930ba5" containerName="payload-pre-processing"
Jul 31 21:11:14.839369 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.839081    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9fc8a8b-85cd-4e5a-8350-9185a6930ba5" containerName="payload-pre-processing"
Jul 31 21:11:14.839369 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.839088    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2e9a8e5-96c2-4c7a-b276-0470016bb49b" containerName="istio-proxy"
Jul 31 21:11:14.839369 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.839094    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2e9a8e5-96c2-4c7a-b276-0470016bb49b" containerName="istio-proxy"
Jul 31 21:11:14.839369 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.839102    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2e9a8e5-96c2-4c7a-b276-0470016bb49b" containerName="istio-proxy"
Jul 31 21:11:14.839369 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.839109    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2e9a8e5-96c2-4c7a-b276-0470016bb49b" containerName="istio-proxy"
Jul 31 21:11:14.839369 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.839192    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1074c052-abd6-4ec5-98eb-7ed3670a0b89" containerName="main"
Jul 31 21:11:14.839369 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.839202    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2e9a8e5-96c2-4c7a-b276-0470016bb49b" containerName="istio-proxy"
Jul 31 21:11:14.839369 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.839207    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2e9a8e5-96c2-4c7a-b276-0470016bb49b" containerName="istio-proxy"
Jul 31 21:11:14.839369 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.839214    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9fc8a8b-85cd-4e5a-8350-9185a6930ba5" containerName="payload-pre-processing"
Jul 31 21:11:14.842100 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.842081    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:14.844421 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.844400    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ecdb81-openshift-default-dockercfg-bbz7j\""
Jul 31 21:11:14.853613 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.853583    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"]
Jul 31 21:11:14.973201 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.973141    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/388e6474-987d-4680-94bf-4e85af878b8d-istio-token\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:14.973201 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.973210    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-istio-envoy\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:14.973477 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.973230    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-credential-socket\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:14.973477 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.973306    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vht8b\" (UniqueName: \"kubernetes.io/projected/388e6474-987d-4680-94bf-4e85af878b8d-kube-api-access-vht8b\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:14.973477 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.973364    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388e6474-987d-4680-94bf-4e85af878b8d-istiod-ca-cert\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:14.973477 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.973412    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-istio-data\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:14.973477 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.973431    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388e6474-987d-4680-94bf-4e85af878b8d-istio-podinfo\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:14.973763 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.973479    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-workload-socket\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:14.973763 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:14.973498    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-workload-certs\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.074328 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.074287    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-istio-data\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.074328 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.074331    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388e6474-987d-4680-94bf-4e85af878b8d-istio-podinfo\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.074590 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.074358    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-workload-socket\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.074590 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.074376    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-workload-certs\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.074590 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.074408    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/388e6474-987d-4680-94bf-4e85af878b8d-istio-token\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.074590 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.074444    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-istio-envoy\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.074590 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.074474    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-credential-socket\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.074590 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.074497    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vht8b\" (UniqueName: \"kubernetes.io/projected/388e6474-987d-4680-94bf-4e85af878b8d-kube-api-access-vht8b\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.074905 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.074616    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388e6474-987d-4680-94bf-4e85af878b8d-istiod-ca-cert\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.074905 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.074755    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-istio-data\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.074905 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.074866    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-workload-certs\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.075087 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.075003    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-credential-socket\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.075204 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.075170    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-workload-socket\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.075570 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.075515    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388e6474-987d-4680-94bf-4e85af878b8d-istiod-ca-cert\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.077055 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.077031    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-istio-envoy\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.077055 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.077046    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388e6474-987d-4680-94bf-4e85af878b8d-istio-podinfo\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.082238 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.082212    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vht8b\" (UniqueName: \"kubernetes.io/projected/388e6474-987d-4680-94bf-4e85af878b8d-kube-api-access-vht8b\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.082376 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.082356    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/388e6474-987d-4680-94bf-4e85af878b8d-istio-token\") pod \"e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") " pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.155256 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.155160    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:15.302495 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.302457    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"]
Jul 31 21:11:15.304076 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:11:15.304051    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod388e6474_987d_4680_94bf_4e85af878b8d.slice/crio-335a949b8a4045c8c4de6ca1161a7ef5cc02dc08a08bdbdfc5564f01830d7b9b WatchSource:0}: Error finding container 335a949b8a4045c8c4de6ca1161a7ef5cc02dc08a08bdbdfc5564f01830d7b9b: Status 404 returned error can't find the container with id 335a949b8a4045c8c4de6ca1161a7ef5cc02dc08a08bdbdfc5564f01830d7b9b
Jul 31 21:11:15.306267 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.306237    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:11:15.306346 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.306310    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:11:15.306389 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.306343    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:11:15.620290 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.620250    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk" event={"ID":"388e6474-987d-4680-94bf-4e85af878b8d","Type":"ContainerStarted","Data":"9dfa3f54a8f139df07618d105f4f15cad47a44df7c53dcbc0ace67fe7778d3cd"}
Jul 31 21:11:15.620480 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.620306    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk" event={"ID":"388e6474-987d-4680-94bf-4e85af878b8d","Type":"ContainerStarted","Data":"335a949b8a4045c8c4de6ca1161a7ef5cc02dc08a08bdbdfc5564f01830d7b9b"}
Jul 31 21:11:15.641234 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:15.641123    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk" podStartSLOduration=1.6411024269999999 podStartE2EDuration="1.641102427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:11:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:11:15.638118312 +0000 UTC m=+2480.243510791" watchObservedRunningTime="2026-07-31 21:11:15.641102427 +0000 UTC m=+2480.246494903"
Jul 31 21:11:16.155488 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:16.155440    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:16.160581 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:16.160551    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:16.624984 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:16.624948    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:16.626009 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:16.625987    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:19.527876 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:19.527841    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"]
Jul 31 21:11:19.531353 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:19.531332    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"
Jul 31 21:11:19.533730 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:19.533708    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-ecdb81\""
Jul 31 21:11:19.533847 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:19.533829    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-ecdb81-dockercfg-x2xvn\""
Jul 31 21:11:19.541178 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:19.541132    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"]
Jul 31 21:11:19.615258 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:19.615225    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trn7n\" (UniqueName: \"kubernetes.io/projected/47a05b94-ab02-4dd8-b8aa-78666b6f17ad-kube-api-access-trn7n\") pod \"payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8\" (UID: \"47a05b94-ab02-4dd8-b8aa-78666b6f17ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"
Jul 31 21:11:19.615445 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:19.615284    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47a05b94-ab02-4dd8-b8aa-78666b6f17ad-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8\" (UID: \"47a05b94-ab02-4dd8-b8aa-78666b6f17ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"
Jul 31 21:11:19.715981 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:19.715939    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trn7n\" (UniqueName: \"kubernetes.io/projected/47a05b94-ab02-4dd8-b8aa-78666b6f17ad-kube-api-access-trn7n\") pod \"payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8\" (UID: \"47a05b94-ab02-4dd8-b8aa-78666b6f17ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"
Jul 31 21:11:19.716190 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:19.715997    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47a05b94-ab02-4dd8-b8aa-78666b6f17ad-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8\" (UID: \"47a05b94-ab02-4dd8-b8aa-78666b6f17ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"
Jul 31 21:11:19.716783 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:19.716759    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47a05b94-ab02-4dd8-b8aa-78666b6f17ad-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8\" (UID: \"47a05b94-ab02-4dd8-b8aa-78666b6f17ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"
Jul 31 21:11:19.724999 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:19.724963    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trn7n\" (UniqueName: \"kubernetes.io/projected/47a05b94-ab02-4dd8-b8aa-78666b6f17ad-kube-api-access-trn7n\") pod \"payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8\" (UID: \"47a05b94-ab02-4dd8-b8aa-78666b6f17ad\") " pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"
Jul 31 21:11:19.844826 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:19.844782    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"
Jul 31 21:11:19.986554 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:19.986529    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"]
Jul 31 21:11:19.988444 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:11:19.988416    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a05b94_ab02_4dd8_b8aa_78666b6f17ad.slice/crio-4cd77554a20aaa6dcb0733954fa9fbff90dbceab1ca81a172ec53f1df04687de WatchSource:0}: Error finding container 4cd77554a20aaa6dcb0733954fa9fbff90dbceab1ca81a172ec53f1df04687de: Status 404 returned error can't find the container with id 4cd77554a20aaa6dcb0733954fa9fbff90dbceab1ca81a172ec53f1df04687de
Jul 31 21:11:20.645337 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:20.645297    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8" event={"ID":"47a05b94-ab02-4dd8-b8aa-78666b6f17ad","Type":"ContainerStarted","Data":"bfe414e6b2e5908cbb650725d36a43ac2f2cc5bca71a18959dc43745611bb5a6"}
Jul 31 21:11:20.645736 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:20.645354    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8" event={"ID":"47a05b94-ab02-4dd8-b8aa-78666b6f17ad","Type":"ContainerStarted","Data":"4cd77554a20aaa6dcb0733954fa9fbff90dbceab1ca81a172ec53f1df04687de"}
Jul 31 21:11:20.645736 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:20.645390    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"
Jul 31 21:11:20.661233 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:20.661170    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8" podStartSLOduration=1.6611281500000001 podStartE2EDuration="1.66112815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:11:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:11:20.660659299 +0000 UTC m=+2485.266051772" watchObservedRunningTime="2026-07-31 21:11:20.66112815 +0000 UTC m=+2485.266520626"
Jul 31 21:11:30.703463 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:30.703426    2566 generic.go:356] "Generic (PLEG): container finished" podID="388e6474-987d-4680-94bf-4e85af878b8d" containerID="9dfa3f54a8f139df07618d105f4f15cad47a44df7c53dcbc0ace67fe7778d3cd" exitCode=0
Jul 31 21:11:30.703888 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:30.703496    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk" event={"ID":"388e6474-987d-4680-94bf-4e85af878b8d","Type":"ContainerDied","Data":"9dfa3f54a8f139df07618d105f4f15cad47a44df7c53dcbc0ace67fe7778d3cd"}
Jul 31 21:11:30.703888 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:30.703864    2566 scope.go:117] "RemoveContainer" containerID="9dfa3f54a8f139df07618d105f4f15cad47a44df7c53dcbc0ace67fe7778d3cd"
Jul 31 21:11:30.704968 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:30.704936    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:11:30.705034 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:30.705008    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:11:30.705071 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:30.705054    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:11:31.624986 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:31.624952    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:31.655865 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:31.655802    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"
Jul 31 21:11:31.710430 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:31.710398    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk" event={"ID":"388e6474-987d-4680-94bf-4e85af878b8d","Type":"ContainerStarted","Data":"5d5066e0e8dd34bdfdc5e8635064c5830d3cf347993be5b9aceeb3e6c6efe9c1"}
Jul 31 21:11:32.155324 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:32.155280    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:32.156777 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:32.156749    2566 patch_prober.go:28] interesting pod/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 31 21:11:32.156921 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:32.156804    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk" podUID="388e6474-987d-4680-94bf-4e85af878b8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 31 21:11:33.156139 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:33.156098    2566 patch_prober.go:28] interesting pod/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 31 21:11:33.156566 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:33.156189    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk" podUID="388e6474-987d-4680-94bf-4e85af878b8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 31 21:11:34.156292 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:34.156251    2566 patch_prober.go:28] interesting pod/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 31 21:11:34.156829 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:34.156314    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk" podUID="388e6474-987d-4680-94bf-4e85af878b8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 31 21:11:35.155976 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:35.155935    2566 patch_prober.go:28] interesting pod/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 31 21:11:35.156179 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:35.156006    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk" podUID="388e6474-987d-4680-94bf-4e85af878b8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 31 21:11:36.156657 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:36.156619    2566 patch_prober.go:28] interesting pod/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 31 21:11:36.157087 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:36.156676    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk" podUID="388e6474-987d-4680-94bf-4e85af878b8d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 31 21:11:37.160282 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:37.160250    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:37.160824 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:37.160801    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:37.161547 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:37.161528    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:11:43.237974 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.237934    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"]
Jul 31 21:11:43.241944 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.241920    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.244374 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.244350    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c8d2ed-openshift-default-dockercfg-k24qn\""
Jul 31 21:11:43.251843 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.251815    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"]
Jul 31 21:11:43.334638 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.334597    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-envoy\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.334830 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.334663    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-workload-certs\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.334830 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.334696    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-data\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.334830 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.334740    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e5eb07-2321-4f26-83c7-a836dc544139-istiod-ca-cert\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.334830 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.334808    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-workload-socket\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.335173 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.334853    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtrrz\" (UniqueName: \"kubernetes.io/projected/a5e5eb07-2321-4f26-83c7-a836dc544139-kube-api-access-xtrrz\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.335173 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.334986    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-credential-socket\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.335173 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.335047    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-podinfo\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.335173 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.335077    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-token\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.436229 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.436190    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e5eb07-2321-4f26-83c7-a836dc544139-istiod-ca-cert\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.436424 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.436244    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-workload-socket\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.436424 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.436393    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtrrz\" (UniqueName: \"kubernetes.io/projected/a5e5eb07-2321-4f26-83c7-a836dc544139-kube-api-access-xtrrz\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.436551 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.436516    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-credential-socket\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.436899 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.436643    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-podinfo\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.437003 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.436931    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-token\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.437003 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.436969    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-envoy\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.437003 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.436687    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-workload-socket\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.437199 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.437021    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-workload-certs\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.437199 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.436872    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-credential-socket\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.437199 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.437047    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-data\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.437199 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.437048    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e5eb07-2321-4f26-83c7-a836dc544139-istiod-ca-cert\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.437423 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.437305    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-workload-certs\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.437649 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.437625    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-data\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.439462 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.439438    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-envoy\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.439736 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.439716    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-podinfo\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.444249 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.444220    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtrrz\" (UniqueName: \"kubernetes.io/projected/a5e5eb07-2321-4f26-83c7-a836dc544139-kube-api-access-xtrrz\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.444994 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.444972    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-token\") pod \"e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") " pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.553418 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.553388    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:43.705250 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.705217    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"]
Jul 31 21:11:43.707630 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:11:43.707599    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e5eb07_2321_4f26_83c7_a836dc544139.slice/crio-d2f2b9382cdf000f274a9594c50de0ff2ef265f07f87815126b6b1a39bf08e8b WatchSource:0}: Error finding container d2f2b9382cdf000f274a9594c50de0ff2ef265f07f87815126b6b1a39bf08e8b: Status 404 returned error can't find the container with id d2f2b9382cdf000f274a9594c50de0ff2ef265f07f87815126b6b1a39bf08e8b
Jul 31 21:11:43.709901 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.709870    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:11:43.710003 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.709956    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:11:43.710070 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.709999    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:11:43.777730 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.777695    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp" event={"ID":"a5e5eb07-2321-4f26-83c7-a836dc544139","Type":"ContainerStarted","Data":"d6fde36352ae8431a98671ab764de652b0b61b13a0aef3d3a1eb48904ec93672"}
Jul 31 21:11:43.777858 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.777755    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp" event={"ID":"a5e5eb07-2321-4f26-83c7-a836dc544139","Type":"ContainerStarted","Data":"d2f2b9382cdf000f274a9594c50de0ff2ef265f07f87815126b6b1a39bf08e8b"}
Jul 31 21:11:43.799950 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:43.799889    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp" podStartSLOduration=0.799863378 podStartE2EDuration="799.863378ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:11:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:11:43.796909817 +0000 UTC m=+2508.402302312" watchObservedRunningTime="2026-07-31 21:11:43.799863378 +0000 UTC m=+2508.405255855"
Jul 31 21:11:44.554225 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:44.554192    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:44.560095 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:44.560069    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:44.782513 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:44.782481    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:44.783583 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:44.783562    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:11:47.558189 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:47.558096    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"]
Jul 31 21:11:47.561388 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:47.561368    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"
Jul 31 21:11:47.563878 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:47.563854    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-c8d2ed\""
Jul 31 21:11:47.564008 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:47.563943    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-c8d2ed-dockercfg-cr8mb\""
Jul 31 21:11:47.572109 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:47.572078    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"]
Jul 31 21:11:47.678412 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:47.678376    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldjcm\" (UniqueName: \"kubernetes.io/projected/15610e6b-ea8c-402f-95d8-a7c3d39e032f-kube-api-access-ldjcm\") pod \"payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct\" (UID: \"15610e6b-ea8c-402f-95d8-a7c3d39e032f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"
Jul 31 21:11:47.678592 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:47.678496    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15610e6b-ea8c-402f-95d8-a7c3d39e032f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct\" (UID: \"15610e6b-ea8c-402f-95d8-a7c3d39e032f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"
Jul 31 21:11:47.779390 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:47.779355    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldjcm\" (UniqueName: \"kubernetes.io/projected/15610e6b-ea8c-402f-95d8-a7c3d39e032f-kube-api-access-ldjcm\") pod \"payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct\" (UID: \"15610e6b-ea8c-402f-95d8-a7c3d39e032f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"
Jul 31 21:11:47.779567 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:47.779449    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15610e6b-ea8c-402f-95d8-a7c3d39e032f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct\" (UID: \"15610e6b-ea8c-402f-95d8-a7c3d39e032f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"
Jul 31 21:11:47.780156 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:47.780117    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15610e6b-ea8c-402f-95d8-a7c3d39e032f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct\" (UID: \"15610e6b-ea8c-402f-95d8-a7c3d39e032f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"
Jul 31 21:11:47.787664 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:47.787639    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldjcm\" (UniqueName: \"kubernetes.io/projected/15610e6b-ea8c-402f-95d8-a7c3d39e032f-kube-api-access-ldjcm\") pod \"payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct\" (UID: \"15610e6b-ea8c-402f-95d8-a7c3d39e032f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"
Jul 31 21:11:47.874100 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:47.874001    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"
Jul 31 21:11:48.014815 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:48.014633    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"]
Jul 31 21:11:48.018387 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:11:48.018356    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15610e6b_ea8c_402f_95d8_a7c3d39e032f.slice/crio-b1d60f1b968895b3b49d5fbd1e49009a999b605aae71326b91745e5dd21a08b7 WatchSource:0}: Error finding container b1d60f1b968895b3b49d5fbd1e49009a999b605aae71326b91745e5dd21a08b7: Status 404 returned error can't find the container with id b1d60f1b968895b3b49d5fbd1e49009a999b605aae71326b91745e5dd21a08b7
Jul 31 21:11:48.804393 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:48.804361    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct" event={"ID":"15610e6b-ea8c-402f-95d8-a7c3d39e032f","Type":"ContainerStarted","Data":"f8a326dd637e0ba60b3dcc01c26297945a5c64c337612dadcbc12b1d18932ad9"}
Jul 31 21:11:48.804821 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:48.804416    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct" event={"ID":"15610e6b-ea8c-402f-95d8-a7c3d39e032f","Type":"ContainerStarted","Data":"b1d60f1b968895b3b49d5fbd1e49009a999b605aae71326b91745e5dd21a08b7"}
Jul 31 21:11:48.804821 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:48.804474    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"
Jul 31 21:11:48.820678 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:48.820627    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct" podStartSLOduration=1.8206115999999999 podStartE2EDuration="1.8206116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:11:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:11:48.819562686 +0000 UTC m=+2513.424955162" watchObservedRunningTime="2026-07-31 21:11:48.8206116 +0000 UTC m=+2513.426004075"
Jul 31 21:11:59.784394 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:59.784352    2566 patch_prober.go:28] interesting pod/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 31 21:11:59.784818 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:59.784417    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp" podUID="a5e5eb07-2321-4f26-83c7-a836dc544139" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 31 21:11:59.811342 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:59.811313    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"
Jul 31 21:11:59.870598 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:59.870559    2566 generic.go:356] "Generic (PLEG): container finished" podID="a5e5eb07-2321-4f26-83c7-a836dc544139" containerID="d6fde36352ae8431a98671ab764de652b0b61b13a0aef3d3a1eb48904ec93672" exitCode=0
Jul 31 21:11:59.870797 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:59.870634    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp" event={"ID":"a5e5eb07-2321-4f26-83c7-a836dc544139","Type":"ContainerDied","Data":"d6fde36352ae8431a98671ab764de652b0b61b13a0aef3d3a1eb48904ec93672"}
Jul 31 21:11:59.871085 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:59.871068    2566 scope.go:117] "RemoveContainer" containerID="d6fde36352ae8431a98671ab764de652b0b61b13a0aef3d3a1eb48904ec93672"
Jul 31 21:11:59.872216 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:59.872192    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:11:59.872291 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:59.872260    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:11:59.872340 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:11:59.872292    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:12:00.877806 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:00.877770    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp" event={"ID":"a5e5eb07-2321-4f26-83c7-a836dc544139","Type":"ContainerStarted","Data":"a31adcbcd99ca2142c1e3a4a676553fcccbd8394143853bf08d57d6437e0b4db"}
Jul 31 21:12:01.554162 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:01.554108    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:12:01.554395 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:01.554336    2566 patch_prober.go:28] interesting pod/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 31 21:12:01.554464 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:01.554386    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp" podUID="a5e5eb07-2321-4f26-83c7-a836dc544139" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 31 21:12:02.554337 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:02.554296    2566 patch_prober.go:28] interesting pod/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 31 21:12:02.554739 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:02.554368    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp" podUID="a5e5eb07-2321-4f26-83c7-a836dc544139" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 31 21:12:03.554430 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:03.554385    2566 patch_prober.go:28] interesting pod/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 31 21:12:03.554843 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:03.554460    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp" podUID="a5e5eb07-2321-4f26-83c7-a836dc544139" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 31 21:12:04.554813 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:04.554766    2566 patch_prober.go:28] interesting pod/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 31 21:12:04.555319 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:04.554844    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp" podUID="a5e5eb07-2321-4f26-83c7-a836dc544139" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 31 21:12:05.554571 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:05.554532    2566 patch_prober.go:28] interesting pod/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 31 21:12:05.554762 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:05.554588    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp" podUID="a5e5eb07-2321-4f26-83c7-a836dc544139" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 31 21:12:06.554250 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:06.554211    2566 patch_prober.go:28] interesting pod/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 31 21:12:06.554673 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:06.554276    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp" podUID="a5e5eb07-2321-4f26-83c7-a836dc544139" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 31 21:12:07.558012 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:07.557980    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:12:07.558430 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:07.558335    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:12:07.559055 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:07.559036    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:12:36.387675 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.387637    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"]
Jul 31 21:12:36.391032 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.391012    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.393438 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.393413    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ecdb81\"/\"default-dockercfg-ddjdp\""
Jul 31 21:12:36.394394 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.394373    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ecdb81\"/\"openshift-service-ca.crt\""
Jul 31 21:12:36.394521 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.394501    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ecdb81\"/\"test-model-ecdb81-kserve-self-signed-certs\""
Jul 31 21:12:36.394592 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.394542    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ecdb81\"/\"kube-root-ca.crt\""
Jul 31 21:12:36.400718 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.400682    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"]
Jul 31 21:12:36.417329 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.417294    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-model-cache\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.417510 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.417338    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmx4l\" (UniqueName: \"kubernetes.io/projected/93b33b24-97c7-4757-b648-667cb43c961b-kube-api-access-bmx4l\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.417510 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.417416    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-tmp-dir\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.417510 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.417455    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-dshm\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.417510 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.417483    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93b33b24-97c7-4757-b648-667cb43c961b-tls-certs\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.417510 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.417503    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-home\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.518209 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.518140    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-dshm\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.518209 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.518218    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93b33b24-97c7-4757-b648-667cb43c961b-tls-certs\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.518490 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.518236    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-home\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.518490 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.518273    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-model-cache\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.518490 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.518291    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmx4l\" (UniqueName: \"kubernetes.io/projected/93b33b24-97c7-4757-b648-667cb43c961b-kube-api-access-bmx4l\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.518490 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.518347    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-tmp-dir\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.518711 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.518690    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-model-cache\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.518759 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.518681    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-home\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.518759 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.518745    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-tmp-dir\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.521217 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.521185    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-dshm\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.521357 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.521340    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93b33b24-97c7-4757-b648-667cb43c961b-tls-certs\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.526833 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.526812    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmx4l\" (UniqueName: \"kubernetes.io/projected/93b33b24-97c7-4757-b648-667cb43c961b-kube-api-access-bmx4l\") pod \"test-model-ecdb81-kserve-64cf8d8df9-4gcbf\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") " pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.703187 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.703052    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:36.842710 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:36.842685    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"]
Jul 31 21:12:36.845647 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:12:36.845612    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93b33b24_97c7_4757_b648_667cb43c961b.slice/crio-56df5534c68b4d9e1782d33e5ade3f261f0244f64dbb52fe70052beed7f9d7cc WatchSource:0}: Error finding container 56df5534c68b4d9e1782d33e5ade3f261f0244f64dbb52fe70052beed7f9d7cc: Status 404 returned error can't find the container with id 56df5534c68b4d9e1782d33e5ade3f261f0244f64dbb52fe70052beed7f9d7cc
Jul 31 21:12:37.065129 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:37.065094    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf" event={"ID":"93b33b24-97c7-4757-b648-667cb43c961b","Type":"ContainerStarted","Data":"8ea18dc802e17304a38134a72b05292e1fa7f6dac558045a12f8dff88ae70f28"}
Jul 31 21:12:37.065129 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:37.065135    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf" event={"ID":"93b33b24-97c7-4757-b648-667cb43c961b","Type":"ContainerStarted","Data":"56df5534c68b4d9e1782d33e5ade3f261f0244f64dbb52fe70052beed7f9d7cc"}
Jul 31 21:12:37.082017 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:37.081964    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf" podStartSLOduration=1.081944526 podStartE2EDuration="1.081944526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:12:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:12:37.080533688 +0000 UTC m=+2561.685926163" watchObservedRunningTime="2026-07-31 21:12:37.081944526 +0000 UTC m=+2561.687337065"
Jul 31 21:12:46.703915 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:46.703873    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:46.704433 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:46.703937    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:46.717105 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:46.717077    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:12:47.125524 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:12:47.125494    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:13:51.015911 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:51.015872    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"]
Jul 31 21:13:56.230030 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:56.229994    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"]
Jul 31 21:13:56.230717 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:56.230667    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8" podUID="47a05b94-ab02-4dd8-b8aa-78666b6f17ad" containerName="payload-processing" containerID="cri-o://bfe414e6b2e5908cbb650725d36a43ac2f2cc5bca71a18959dc43745611bb5a6" gracePeriod=30
Jul 31 21:13:56.468539 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:56.468500    2566 generic.go:356] "Generic (PLEG): container finished" podID="47a05b94-ab02-4dd8-b8aa-78666b6f17ad" containerID="bfe414e6b2e5908cbb650725d36a43ac2f2cc5bca71a18959dc43745611bb5a6" exitCode=0
Jul 31 21:13:56.468750 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:56.468570    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8" event={"ID":"47a05b94-ab02-4dd8-b8aa-78666b6f17ad","Type":"ContainerDied","Data":"bfe414e6b2e5908cbb650725d36a43ac2f2cc5bca71a18959dc43745611bb5a6"}
Jul 31 21:13:56.495880 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:56.495855    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"
Jul 31 21:13:56.560741 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:56.560705    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47a05b94-ab02-4dd8-b8aa-78666b6f17ad-plugins-config-volume\") pod \"47a05b94-ab02-4dd8-b8aa-78666b6f17ad\" (UID: \"47a05b94-ab02-4dd8-b8aa-78666b6f17ad\") "
Jul 31 21:13:56.560937 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:56.560782    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trn7n\" (UniqueName: \"kubernetes.io/projected/47a05b94-ab02-4dd8-b8aa-78666b6f17ad-kube-api-access-trn7n\") pod \"47a05b94-ab02-4dd8-b8aa-78666b6f17ad\" (UID: \"47a05b94-ab02-4dd8-b8aa-78666b6f17ad\") "
Jul 31 21:13:56.561098 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:56.561072    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47a05b94-ab02-4dd8-b8aa-78666b6f17ad-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "47a05b94-ab02-4dd8-b8aa-78666b6f17ad" (UID: "47a05b94-ab02-4dd8-b8aa-78666b6f17ad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:13:56.563363 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:56.563330    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47a05b94-ab02-4dd8-b8aa-78666b6f17ad-kube-api-access-trn7n" (OuterVolumeSpecName: "kube-api-access-trn7n") pod "47a05b94-ab02-4dd8-b8aa-78666b6f17ad" (UID: "47a05b94-ab02-4dd8-b8aa-78666b6f17ad"). InnerVolumeSpecName "kube-api-access-trn7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:13:56.661580 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:56.661541    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47a05b94-ab02-4dd8-b8aa-78666b6f17ad-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:13:56.661580 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:56.661575    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trn7n\" (UniqueName: \"kubernetes.io/projected/47a05b94-ab02-4dd8-b8aa-78666b6f17ad-kube-api-access-trn7n\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:13:57.475103 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:57.475074    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"
Jul 31 21:13:57.475656 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:57.475072    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8" event={"ID":"47a05b94-ab02-4dd8-b8aa-78666b6f17ad","Type":"ContainerDied","Data":"4cd77554a20aaa6dcb0733954fa9fbff90dbceab1ca81a172ec53f1df04687de"}
Jul 31 21:13:57.475656 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:57.475241    2566 scope.go:117] "RemoveContainer" containerID="bfe414e6b2e5908cbb650725d36a43ac2f2cc5bca71a18959dc43745611bb5a6"
Jul 31 21:13:57.497090 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:57.497059    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"]
Jul 31 21:13:57.498813 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:57.498793    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-ecdb81-7d5d674b76-t7tr8"]
Jul 31 21:13:57.935518 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:13:57.935484    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47a05b94-ab02-4dd8-b8aa-78666b6f17ad" path="/var/lib/kubelet/pods/47a05b94-ab02-4dd8-b8aa-78666b6f17ad/volumes"
Jul 31 21:14:06.037545 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.037471    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf" podUID="93b33b24-97c7-4757-b648-667cb43c961b" containerName="main" containerID="cri-o://8ea18dc802e17304a38134a72b05292e1fa7f6dac558045a12f8dff88ae70f28" gracePeriod=45
Jul 31 21:14:06.293089 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.293061    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:14:06.343357 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.343322    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93b33b24-97c7-4757-b648-667cb43c961b-tls-certs\") pod \"93b33b24-97c7-4757-b648-667cb43c961b\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") "
Jul 31 21:14:06.343564 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.343375    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-dshm\") pod \"93b33b24-97c7-4757-b648-667cb43c961b\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") "
Jul 31 21:14:06.343564 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.343401    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-tmp-dir\") pod \"93b33b24-97c7-4757-b648-667cb43c961b\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") "
Jul 31 21:14:06.343564 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.343430    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-model-cache\") pod \"93b33b24-97c7-4757-b648-667cb43c961b\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") "
Jul 31 21:14:06.343564 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.343445    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-home\") pod \"93b33b24-97c7-4757-b648-667cb43c961b\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") "
Jul 31 21:14:06.343564 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.343491    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmx4l\" (UniqueName: \"kubernetes.io/projected/93b33b24-97c7-4757-b648-667cb43c961b-kube-api-access-bmx4l\") pod \"93b33b24-97c7-4757-b648-667cb43c961b\" (UID: \"93b33b24-97c7-4757-b648-667cb43c961b\") "
Jul 31 21:14:06.343827 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.343725    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "93b33b24-97c7-4757-b648-667cb43c961b" (UID: "93b33b24-97c7-4757-b648-667cb43c961b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:14:06.343827 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.343734    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-home" (OuterVolumeSpecName: "home") pod "93b33b24-97c7-4757-b648-667cb43c961b" (UID: "93b33b24-97c7-4757-b648-667cb43c961b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:14:06.343827 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.343753    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-model-cache" (OuterVolumeSpecName: "model-cache") pod "93b33b24-97c7-4757-b648-667cb43c961b" (UID: "93b33b24-97c7-4757-b648-667cb43c961b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:14:06.345867 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.345829    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-dshm" (OuterVolumeSpecName: "dshm") pod "93b33b24-97c7-4757-b648-667cb43c961b" (UID: "93b33b24-97c7-4757-b648-667cb43c961b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:14:06.345867 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.345843    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93b33b24-97c7-4757-b648-667cb43c961b-kube-api-access-bmx4l" (OuterVolumeSpecName: "kube-api-access-bmx4l") pod "93b33b24-97c7-4757-b648-667cb43c961b" (UID: "93b33b24-97c7-4757-b648-667cb43c961b"). InnerVolumeSpecName "kube-api-access-bmx4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:14:06.346014 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.345867    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93b33b24-97c7-4757-b648-667cb43c961b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "93b33b24-97c7-4757-b648-667cb43c961b" (UID: "93b33b24-97c7-4757-b648-667cb43c961b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:14:06.444556 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.444507    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93b33b24-97c7-4757-b648-667cb43c961b-tls-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:06.444556 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.444544    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-dshm\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:06.444794 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.444582    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-tmp-dir\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:06.444794 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.444593    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-model-cache\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:06.444794 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.444604    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93b33b24-97c7-4757-b648-667cb43c961b-home\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:06.444794 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.444615    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmx4l\" (UniqueName: \"kubernetes.io/projected/93b33b24-97c7-4757-b648-667cb43c961b-kube-api-access-bmx4l\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:06.522777 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.522741    2566 generic.go:356] "Generic (PLEG): container finished" podID="93b33b24-97c7-4757-b648-667cb43c961b" containerID="8ea18dc802e17304a38134a72b05292e1fa7f6dac558045a12f8dff88ae70f28" exitCode=0
Jul 31 21:14:06.522955 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.522782    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"
Jul 31 21:14:06.522955 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.522824    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf" event={"ID":"93b33b24-97c7-4757-b648-667cb43c961b","Type":"ContainerDied","Data":"8ea18dc802e17304a38134a72b05292e1fa7f6dac558045a12f8dff88ae70f28"}
Jul 31 21:14:06.522955 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.522865    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf" event={"ID":"93b33b24-97c7-4757-b648-667cb43c961b","Type":"ContainerDied","Data":"56df5534c68b4d9e1782d33e5ade3f261f0244f64dbb52fe70052beed7f9d7cc"}
Jul 31 21:14:06.522955 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.522883    2566 scope.go:117] "RemoveContainer" containerID="8ea18dc802e17304a38134a72b05292e1fa7f6dac558045a12f8dff88ae70f28"
Jul 31 21:14:06.532360 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.532343    2566 scope.go:117] "RemoveContainer" containerID="8ea18dc802e17304a38134a72b05292e1fa7f6dac558045a12f8dff88ae70f28"
Jul 31 21:14:06.532639 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:14:06.532611    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ea18dc802e17304a38134a72b05292e1fa7f6dac558045a12f8dff88ae70f28\": container with ID starting with 8ea18dc802e17304a38134a72b05292e1fa7f6dac558045a12f8dff88ae70f28 not found: ID does not exist" containerID="8ea18dc802e17304a38134a72b05292e1fa7f6dac558045a12f8dff88ae70f28"
Jul 31 21:14:06.532639 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.532649    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ea18dc802e17304a38134a72b05292e1fa7f6dac558045a12f8dff88ae70f28"} err="failed to get container status \"8ea18dc802e17304a38134a72b05292e1fa7f6dac558045a12f8dff88ae70f28\": rpc error: code = NotFound desc = could not find container \"8ea18dc802e17304a38134a72b05292e1fa7f6dac558045a12f8dff88ae70f28\": container with ID starting with 8ea18dc802e17304a38134a72b05292e1fa7f6dac558045a12f8dff88ae70f28 not found: ID does not exist"
Jul 31 21:14:06.543200 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.543124    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"]
Jul 31 21:14:06.548546 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:06.548524    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-ecdb81/test-model-ecdb81-kserve-64cf8d8df9-4gcbf"]
Jul 31 21:14:07.935658 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:07.935627    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93b33b24-97c7-4757-b648-667cb43c961b" path="/var/lib/kubelet/pods/93b33b24-97c7-4757-b648-667cb43c961b/volumes"
Jul 31 21:14:08.055495 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:08.055456    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"]
Jul 31 21:14:08.055819 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:08.055754    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk" podUID="388e6474-987d-4680-94bf-4e85af878b8d" containerName="istio-proxy" containerID="cri-o://5d5066e0e8dd34bdfdc5e8635064c5830d3cf347993be5b9aceeb3e6c6efe9c1" gracePeriod=30
Jul 31 21:14:13.316462 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.316433    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:14:13.413514 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.413405    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-workload-certs\") pod \"388e6474-987d-4680-94bf-4e85af878b8d\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") "
Jul 31 21:14:13.413514 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.413468    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-credential-socket\") pod \"388e6474-987d-4680-94bf-4e85af878b8d\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") "
Jul 31 21:14:13.413514 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.413494    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-istio-data\") pod \"388e6474-987d-4680-94bf-4e85af878b8d\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") "
Jul 31 21:14:13.413514 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.413519    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388e6474-987d-4680-94bf-4e85af878b8d-istiod-ca-cert\") pod \"388e6474-987d-4680-94bf-4e85af878b8d\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") "
Jul 31 21:14:13.413861 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.413556    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/388e6474-987d-4680-94bf-4e85af878b8d-istio-token\") pod \"388e6474-987d-4680-94bf-4e85af878b8d\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") "
Jul 31 21:14:13.413861 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.413600    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-istio-envoy\") pod \"388e6474-987d-4680-94bf-4e85af878b8d\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") "
Jul 31 21:14:13.413861 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.413634    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vht8b\" (UniqueName: \"kubernetes.io/projected/388e6474-987d-4680-94bf-4e85af878b8d-kube-api-access-vht8b\") pod \"388e6474-987d-4680-94bf-4e85af878b8d\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") "
Jul 31 21:14:13.413861 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.413658    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388e6474-987d-4680-94bf-4e85af878b8d-istio-podinfo\") pod \"388e6474-987d-4680-94bf-4e85af878b8d\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") "
Jul 31 21:14:13.413861 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.413691    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-workload-socket\") pod \"388e6474-987d-4680-94bf-4e85af878b8d\" (UID: \"388e6474-987d-4680-94bf-4e85af878b8d\") "
Jul 31 21:14:13.414129 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.413855    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "388e6474-987d-4680-94bf-4e85af878b8d" (UID: "388e6474-987d-4680-94bf-4e85af878b8d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:14:13.414129 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.413877    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-istio-data" (OuterVolumeSpecName: "istio-data") pod "388e6474-987d-4680-94bf-4e85af878b8d" (UID: "388e6474-987d-4680-94bf-4e85af878b8d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:14:13.414129 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.413897    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "388e6474-987d-4680-94bf-4e85af878b8d" (UID: "388e6474-987d-4680-94bf-4e85af878b8d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:14:13.414129 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.413962    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/388e6474-987d-4680-94bf-4e85af878b8d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "388e6474-987d-4680-94bf-4e85af878b8d" (UID: "388e6474-987d-4680-94bf-4e85af878b8d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:14:13.414129 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.414107    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "388e6474-987d-4680-94bf-4e85af878b8d" (UID: "388e6474-987d-4680-94bf-4e85af878b8d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:14:13.415947 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.415922    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/388e6474-987d-4680-94bf-4e85af878b8d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "388e6474-987d-4680-94bf-4e85af878b8d" (UID: "388e6474-987d-4680-94bf-4e85af878b8d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 21:14:13.415947 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.415936    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/388e6474-987d-4680-94bf-4e85af878b8d-istio-token" (OuterVolumeSpecName: "istio-token") pod "388e6474-987d-4680-94bf-4e85af878b8d" (UID: "388e6474-987d-4680-94bf-4e85af878b8d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:14:13.416452 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.416435    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "388e6474-987d-4680-94bf-4e85af878b8d" (UID: "388e6474-987d-4680-94bf-4e85af878b8d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:14:13.416452 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.416442    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/388e6474-987d-4680-94bf-4e85af878b8d-kube-api-access-vht8b" (OuterVolumeSpecName: "kube-api-access-vht8b") pod "388e6474-987d-4680-94bf-4e85af878b8d" (UID: "388e6474-987d-4680-94bf-4e85af878b8d"). InnerVolumeSpecName "kube-api-access-vht8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:14:13.515340 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.515286    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/388e6474-987d-4680-94bf-4e85af878b8d-istio-podinfo\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:13.515340 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.515331    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-workload-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:13.515340 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.515343    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-workload-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:13.515340 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.515352    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-credential-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:13.515340 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.515361    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-istio-data\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:13.515654 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.515369    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/388e6474-987d-4680-94bf-4e85af878b8d-istiod-ca-cert\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:13.515654 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.515376    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/388e6474-987d-4680-94bf-4e85af878b8d-istio-token\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:13.515654 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.515383    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/388e6474-987d-4680-94bf-4e85af878b8d-istio-envoy\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:13.515654 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.515391    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vht8b\" (UniqueName: \"kubernetes.io/projected/388e6474-987d-4680-94bf-4e85af878b8d-kube-api-access-vht8b\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:13.562589 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.562557    2566 generic.go:356] "Generic (PLEG): container finished" podID="388e6474-987d-4680-94bf-4e85af878b8d" containerID="5d5066e0e8dd34bdfdc5e8635064c5830d3cf347993be5b9aceeb3e6c6efe9c1" exitCode=0
Jul 31 21:14:13.562782 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.562601    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"
Jul 31 21:14:13.562782 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.562647    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk" event={"ID":"388e6474-987d-4680-94bf-4e85af878b8d","Type":"ContainerDied","Data":"5d5066e0e8dd34bdfdc5e8635064c5830d3cf347993be5b9aceeb3e6c6efe9c1"}
Jul 31 21:14:13.562782 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.562707    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk" event={"ID":"388e6474-987d-4680-94bf-4e85af878b8d","Type":"ContainerDied","Data":"335a949b8a4045c8c4de6ca1161a7ef5cc02dc08a08bdbdfc5564f01830d7b9b"}
Jul 31 21:14:13.562782 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.562730    2566 scope.go:117] "RemoveContainer" containerID="5d5066e0e8dd34bdfdc5e8635064c5830d3cf347993be5b9aceeb3e6c6efe9c1"
Jul 31 21:14:13.571657 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.571641    2566 scope.go:117] "RemoveContainer" containerID="9dfa3f54a8f139df07618d105f4f15cad47a44df7c53dcbc0ace67fe7778d3cd"
Jul 31 21:14:13.579652 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.579630    2566 scope.go:117] "RemoveContainer" containerID="5d5066e0e8dd34bdfdc5e8635064c5830d3cf347993be5b9aceeb3e6c6efe9c1"
Jul 31 21:14:13.579951 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:14:13.579930    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d5066e0e8dd34bdfdc5e8635064c5830d3cf347993be5b9aceeb3e6c6efe9c1\": container with ID starting with 5d5066e0e8dd34bdfdc5e8635064c5830d3cf347993be5b9aceeb3e6c6efe9c1 not found: ID does not exist" containerID="5d5066e0e8dd34bdfdc5e8635064c5830d3cf347993be5b9aceeb3e6c6efe9c1"
Jul 31 21:14:13.579999 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.579963    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d5066e0e8dd34bdfdc5e8635064c5830d3cf347993be5b9aceeb3e6c6efe9c1"} err="failed to get container status \"5d5066e0e8dd34bdfdc5e8635064c5830d3cf347993be5b9aceeb3e6c6efe9c1\": rpc error: code = NotFound desc = could not find container \"5d5066e0e8dd34bdfdc5e8635064c5830d3cf347993be5b9aceeb3e6c6efe9c1\": container with ID starting with 5d5066e0e8dd34bdfdc5e8635064c5830d3cf347993be5b9aceeb3e6c6efe9c1 not found: ID does not exist"
Jul 31 21:14:13.579999 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.579983    2566 scope.go:117] "RemoveContainer" containerID="9dfa3f54a8f139df07618d105f4f15cad47a44df7c53dcbc0ace67fe7778d3cd"
Jul 31 21:14:13.580249 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:14:13.580231    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dfa3f54a8f139df07618d105f4f15cad47a44df7c53dcbc0ace67fe7778d3cd\": container with ID starting with 9dfa3f54a8f139df07618d105f4f15cad47a44df7c53dcbc0ace67fe7778d3cd not found: ID does not exist" containerID="9dfa3f54a8f139df07618d105f4f15cad47a44df7c53dcbc0ace67fe7778d3cd"
Jul 31 21:14:13.580293 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.580256    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dfa3f54a8f139df07618d105f4f15cad47a44df7c53dcbc0ace67fe7778d3cd"} err="failed to get container status \"9dfa3f54a8f139df07618d105f4f15cad47a44df7c53dcbc0ace67fe7778d3cd\": rpc error: code = NotFound desc = could not find container \"9dfa3f54a8f139df07618d105f4f15cad47a44df7c53dcbc0ace67fe7778d3cd\": container with ID starting with 9dfa3f54a8f139df07618d105f4f15cad47a44df7c53dcbc0ace67fe7778d3cd not found: ID does not exist"
Jul 31 21:14:13.583944 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.583922    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"]
Jul 31 21:14:13.586904 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.586883    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ecdb81-openshift-default-95f7dc87b-4l6sk"]
Jul 31 21:14:13.935312 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:13.935284    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="388e6474-987d-4680-94bf-4e85af878b8d" path="/var/lib/kubelet/pods/388e6474-987d-4680-94bf-4e85af878b8d/volumes"
Jul 31 21:14:18.869620 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:18.869580    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"]
Jul 31 21:14:18.870106 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:18.869835    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct" podUID="15610e6b-ea8c-402f-95d8-a7c3d39e032f" containerName="payload-pre-processing" containerID="cri-o://f8a326dd637e0ba60b3dcc01c26297945a5c64c337612dadcbc12b1d18932ad9" gracePeriod=30
Jul 31 21:14:19.130291 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:19.130219    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"
Jul 31 21:14:19.262875 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:19.262842    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldjcm\" (UniqueName: \"kubernetes.io/projected/15610e6b-ea8c-402f-95d8-a7c3d39e032f-kube-api-access-ldjcm\") pod \"15610e6b-ea8c-402f-95d8-a7c3d39e032f\" (UID: \"15610e6b-ea8c-402f-95d8-a7c3d39e032f\") "
Jul 31 21:14:19.263059 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:19.262963    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15610e6b-ea8c-402f-95d8-a7c3d39e032f-plugins-config-volume\") pod \"15610e6b-ea8c-402f-95d8-a7c3d39e032f\" (UID: \"15610e6b-ea8c-402f-95d8-a7c3d39e032f\") "
Jul 31 21:14:19.263369 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:19.263349    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15610e6b-ea8c-402f-95d8-a7c3d39e032f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "15610e6b-ea8c-402f-95d8-a7c3d39e032f" (UID: "15610e6b-ea8c-402f-95d8-a7c3d39e032f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:14:19.265103 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:19.265080    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15610e6b-ea8c-402f-95d8-a7c3d39e032f-kube-api-access-ldjcm" (OuterVolumeSpecName: "kube-api-access-ldjcm") pod "15610e6b-ea8c-402f-95d8-a7c3d39e032f" (UID: "15610e6b-ea8c-402f-95d8-a7c3d39e032f"). InnerVolumeSpecName "kube-api-access-ldjcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:14:19.363589 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:19.363547    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15610e6b-ea8c-402f-95d8-a7c3d39e032f-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:19.363589 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:19.363583    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldjcm\" (UniqueName: \"kubernetes.io/projected/15610e6b-ea8c-402f-95d8-a7c3d39e032f-kube-api-access-ldjcm\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:19.594303 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:19.594268    2566 generic.go:356] "Generic (PLEG): container finished" podID="15610e6b-ea8c-402f-95d8-a7c3d39e032f" containerID="f8a326dd637e0ba60b3dcc01c26297945a5c64c337612dadcbc12b1d18932ad9" exitCode=0
Jul 31 21:14:19.594463 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:19.594312    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"
Jul 31 21:14:19.594463 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:19.594355    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct" event={"ID":"15610e6b-ea8c-402f-95d8-a7c3d39e032f","Type":"ContainerDied","Data":"f8a326dd637e0ba60b3dcc01c26297945a5c64c337612dadcbc12b1d18932ad9"}
Jul 31 21:14:19.594463 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:19.594405    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct" event={"ID":"15610e6b-ea8c-402f-95d8-a7c3d39e032f","Type":"ContainerDied","Data":"b1d60f1b968895b3b49d5fbd1e49009a999b605aae71326b91745e5dd21a08b7"}
Jul 31 21:14:19.594463 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:19.594427    2566 scope.go:117] "RemoveContainer" containerID="f8a326dd637e0ba60b3dcc01c26297945a5c64c337612dadcbc12b1d18932ad9"
Jul 31 21:14:19.604546 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:19.604522    2566 scope.go:117] "RemoveContainer" containerID="f8a326dd637e0ba60b3dcc01c26297945a5c64c337612dadcbc12b1d18932ad9"
Jul 31 21:14:19.604835 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:14:19.604815    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8a326dd637e0ba60b3dcc01c26297945a5c64c337612dadcbc12b1d18932ad9\": container with ID starting with f8a326dd637e0ba60b3dcc01c26297945a5c64c337612dadcbc12b1d18932ad9 not found: ID does not exist" containerID="f8a326dd637e0ba60b3dcc01c26297945a5c64c337612dadcbc12b1d18932ad9"
Jul 31 21:14:19.604902 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:19.604843    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8a326dd637e0ba60b3dcc01c26297945a5c64c337612dadcbc12b1d18932ad9"} err="failed to get container status \"f8a326dd637e0ba60b3dcc01c26297945a5c64c337612dadcbc12b1d18932ad9\": rpc error: code = NotFound desc = could not find container \"f8a326dd637e0ba60b3dcc01c26297945a5c64c337612dadcbc12b1d18932ad9\": container with ID starting with f8a326dd637e0ba60b3dcc01c26297945a5c64c337612dadcbc12b1d18932ad9 not found: ID does not exist"
Jul 31 21:14:19.617781 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:19.617755    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"]
Jul 31 21:14:19.623202 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:19.623175    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-c8d2ed-6467f6d684-gslct"]
Jul 31 21:14:19.937634 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:19.937544    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15610e6b-ea8c-402f-95d8-a7c3d39e032f" path="/var/lib/kubelet/pods/15610e6b-ea8c-402f-95d8-a7c3d39e032f/volumes"
Jul 31 21:14:25.408537 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:25.408498    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"]
Jul 31 21:14:25.409016 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:25.408714    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp" podUID="a5e5eb07-2321-4f26-83c7-a836dc544139" containerName="istio-proxy" containerID="cri-o://a31adcbcd99ca2142c1e3a4a676553fcccbd8394143853bf08d57d6437e0b4db" gracePeriod=30
Jul 31 21:14:30.652854 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.652821    2566 generic.go:356] "Generic (PLEG): container finished" podID="a5e5eb07-2321-4f26-83c7-a836dc544139" containerID="a31adcbcd99ca2142c1e3a4a676553fcccbd8394143853bf08d57d6437e0b4db" exitCode=0
Jul 31 21:14:30.653259 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.652905    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp" event={"ID":"a5e5eb07-2321-4f26-83c7-a836dc544139","Type":"ContainerDied","Data":"a31adcbcd99ca2142c1e3a4a676553fcccbd8394143853bf08d57d6437e0b4db"}
Jul 31 21:14:30.653259 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.652981    2566 scope.go:117] "RemoveContainer" containerID="d6fde36352ae8431a98671ab764de652b0b61b13a0aef3d3a1eb48904ec93672"
Jul 31 21:14:30.668671 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:14:30.668632    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6fde36352ae8431a98671ab764de652b0b61b13a0aef3d3a1eb48904ec93672\": container with ID starting with d6fde36352ae8431a98671ab764de652b0b61b13a0aef3d3a1eb48904ec93672 not found: ID does not exist" containerID="d6fde36352ae8431a98671ab764de652b0b61b13a0aef3d3a1eb48904ec93672"
Jul 31 21:14:30.672286 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.672208    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:14:30.767457 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.767424    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-workload-socket\") pod \"a5e5eb07-2321-4f26-83c7-a836dc544139\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") "
Jul 31 21:14:30.767627 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.767473    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-token\") pod \"a5e5eb07-2321-4f26-83c7-a836dc544139\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") "
Jul 31 21:14:30.767627 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.767536    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-podinfo\") pod \"a5e5eb07-2321-4f26-83c7-a836dc544139\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") "
Jul 31 21:14:30.767627 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.767567    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtrrz\" (UniqueName: \"kubernetes.io/projected/a5e5eb07-2321-4f26-83c7-a836dc544139-kube-api-access-xtrrz\") pod \"a5e5eb07-2321-4f26-83c7-a836dc544139\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") "
Jul 31 21:14:30.767627 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.767604    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-envoy\") pod \"a5e5eb07-2321-4f26-83c7-a836dc544139\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") "
Jul 31 21:14:30.767863 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.767656    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-workload-certs\") pod \"a5e5eb07-2321-4f26-83c7-a836dc544139\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") "
Jul 31 21:14:30.767863 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.767713    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e5eb07-2321-4f26-83c7-a836dc544139-istiod-ca-cert\") pod \"a5e5eb07-2321-4f26-83c7-a836dc544139\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") "
Jul 31 21:14:30.767863 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.767725    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a5e5eb07-2321-4f26-83c7-a836dc544139" (UID: "a5e5eb07-2321-4f26-83c7-a836dc544139"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:14:30.767863 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.767757    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-credential-socket\") pod \"a5e5eb07-2321-4f26-83c7-a836dc544139\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") "
Jul 31 21:14:30.767863 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.767826    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-data\") pod \"a5e5eb07-2321-4f26-83c7-a836dc544139\" (UID: \"a5e5eb07-2321-4f26-83c7-a836dc544139\") "
Jul 31 21:14:30.768124 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.768014    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-workload-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:30.768271 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.768249    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-data" (OuterVolumeSpecName: "istio-data") pod "a5e5eb07-2321-4f26-83c7-a836dc544139" (UID: "a5e5eb07-2321-4f26-83c7-a836dc544139"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:14:30.768333 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.768271    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5e5eb07-2321-4f26-83c7-a836dc544139-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a5e5eb07-2321-4f26-83c7-a836dc544139" (UID: "a5e5eb07-2321-4f26-83c7-a836dc544139"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:14:30.768450 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.768430    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a5e5eb07-2321-4f26-83c7-a836dc544139" (UID: "a5e5eb07-2321-4f26-83c7-a836dc544139"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:14:30.768739 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.768713    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a5e5eb07-2321-4f26-83c7-a836dc544139" (UID: "a5e5eb07-2321-4f26-83c7-a836dc544139"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:14:30.770875 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.770681    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e5eb07-2321-4f26-83c7-a836dc544139-kube-api-access-xtrrz" (OuterVolumeSpecName: "kube-api-access-xtrrz") pod "a5e5eb07-2321-4f26-83c7-a836dc544139" (UID: "a5e5eb07-2321-4f26-83c7-a836dc544139"). InnerVolumeSpecName "kube-api-access-xtrrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:14:30.771943 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.771904    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a5e5eb07-2321-4f26-83c7-a836dc544139" (UID: "a5e5eb07-2321-4f26-83c7-a836dc544139"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 21:14:30.771943 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.771912    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-token" (OuterVolumeSpecName: "istio-token") pod "a5e5eb07-2321-4f26-83c7-a836dc544139" (UID: "a5e5eb07-2321-4f26-83c7-a836dc544139"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:14:30.772064 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.771971    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a5e5eb07-2321-4f26-83c7-a836dc544139" (UID: "a5e5eb07-2321-4f26-83c7-a836dc544139"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:14:30.869397 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.869355    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-data\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:30.869397 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.869386    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-token\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:30.869397 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.869395    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-podinfo\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:30.869397 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.869406    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtrrz\" (UniqueName: \"kubernetes.io/projected/a5e5eb07-2321-4f26-83c7-a836dc544139-kube-api-access-xtrrz\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:30.869751 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.869414    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-istio-envoy\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:30.869751 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.869422    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-workload-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:30.869751 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.869429    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5e5eb07-2321-4f26-83c7-a836dc544139-istiod-ca-cert\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:30.869751 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:30.869437    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5e5eb07-2321-4f26-83c7-a836dc544139-credential-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:14:31.377311 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377274    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"]
Jul 31 21:14:31.377672 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377659    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e5eb07-2321-4f26-83c7-a836dc544139" containerName="istio-proxy"
Jul 31 21:14:31.377716 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377674    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e5eb07-2321-4f26-83c7-a836dc544139" containerName="istio-proxy"
Jul 31 21:14:31.377716 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377683    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a05b94-ab02-4dd8-b8aa-78666b6f17ad" containerName="payload-processing"
Jul 31 21:14:31.377716 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377690    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a05b94-ab02-4dd8-b8aa-78666b6f17ad" containerName="payload-processing"
Jul 31 21:14:31.377716 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377701    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93b33b24-97c7-4757-b648-667cb43c961b" containerName="main"
Jul 31 21:14:31.377716 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377708    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="93b33b24-97c7-4757-b648-667cb43c961b" containerName="main"
Jul 31 21:14:31.377716 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377718    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15610e6b-ea8c-402f-95d8-a7c3d39e032f" containerName="payload-pre-processing"
Jul 31 21:14:31.377898 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377724    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="15610e6b-ea8c-402f-95d8-a7c3d39e032f" containerName="payload-pre-processing"
Jul 31 21:14:31.377898 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377732    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="388e6474-987d-4680-94bf-4e85af878b8d" containerName="istio-proxy"
Jul 31 21:14:31.377898 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377737    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="388e6474-987d-4680-94bf-4e85af878b8d" containerName="istio-proxy"
Jul 31 21:14:31.377898 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377744    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="388e6474-987d-4680-94bf-4e85af878b8d" containerName="istio-proxy"
Jul 31 21:14:31.377898 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377749    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="388e6474-987d-4680-94bf-4e85af878b8d" containerName="istio-proxy"
Jul 31 21:14:31.377898 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377755    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5e5eb07-2321-4f26-83c7-a836dc544139" containerName="istio-proxy"
Jul 31 21:14:31.377898 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377760    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5e5eb07-2321-4f26-83c7-a836dc544139" containerName="istio-proxy"
Jul 31 21:14:31.377898 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377816    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="93b33b24-97c7-4757-b648-667cb43c961b" containerName="main"
Jul 31 21:14:31.377898 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377825    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="47a05b94-ab02-4dd8-b8aa-78666b6f17ad" containerName="payload-processing"
Jul 31 21:14:31.377898 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377831    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5e5eb07-2321-4f26-83c7-a836dc544139" containerName="istio-proxy"
Jul 31 21:14:31.377898 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377836    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="15610e6b-ea8c-402f-95d8-a7c3d39e032f" containerName="payload-pre-processing"
Jul 31 21:14:31.377898 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377843    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5e5eb07-2321-4f26-83c7-a836dc544139" containerName="istio-proxy"
Jul 31 21:14:31.377898 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377849    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="388e6474-987d-4680-94bf-4e85af878b8d" containerName="istio-proxy"
Jul 31 21:14:31.377898 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.377855    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="388e6474-987d-4680-94bf-4e85af878b8d" containerName="istio-proxy"
Jul 31 21:14:31.382050 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.382030    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"
Jul 31 21:14:31.384469 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.384424    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-268e33\""
Jul 31 21:14:31.384612 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.384571    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-268e33-dockercfg-5l7k7\""
Jul 31 21:14:31.391307 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.391276    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"]
Jul 31 21:14:31.424263 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.424231    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"]
Jul 31 21:14:31.427568 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.427551    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"
Jul 31 21:14:31.436105 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.436067    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"]
Jul 31 21:14:31.475704 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.475668    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ebbcf83-7cdd-4b6f-83ca-46f7373bef41-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz\" (UID: \"5ebbcf83-7cdd-4b6f-83ca-46f7373bef41\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"
Jul 31 21:14:31.475886 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.475748    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twkfj\" (UniqueName: \"kubernetes.io/projected/5ebbcf83-7cdd-4b6f-83ca-46f7373bef41-kube-api-access-twkfj\") pod \"payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz\" (UID: \"5ebbcf83-7cdd-4b6f-83ca-46f7373bef41\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"
Jul 31 21:14:31.577065 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.577027    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twkfj\" (UniqueName: \"kubernetes.io/projected/5ebbcf83-7cdd-4b6f-83ca-46f7373bef41-kube-api-access-twkfj\") pod \"payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz\" (UID: \"5ebbcf83-7cdd-4b6f-83ca-46f7373bef41\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"
Jul 31 21:14:31.577253 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.577096    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ebbcf83-7cdd-4b6f-83ca-46f7373bef41-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz\" (UID: \"5ebbcf83-7cdd-4b6f-83ca-46f7373bef41\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"
Jul 31 21:14:31.577253 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.577133    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb9l4\" (UniqueName: \"kubernetes.io/projected/b7514593-4399-494d-b35c-70ad6e826758-kube-api-access-lb9l4\") pod \"payload-processing-e2e-api-a-268e33-75f9955c78-vlttq\" (UID: \"b7514593-4399-494d-b35c-70ad6e826758\") " pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"
Jul 31 21:14:31.577253 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.577195    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7514593-4399-494d-b35c-70ad6e826758-plugins-config-volume\") pod \"payload-processing-e2e-api-a-268e33-75f9955c78-vlttq\" (UID: \"b7514593-4399-494d-b35c-70ad6e826758\") " pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"
Jul 31 21:14:31.577868 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.577843    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ebbcf83-7cdd-4b6f-83ca-46f7373bef41-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz\" (UID: \"5ebbcf83-7cdd-4b6f-83ca-46f7373bef41\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"
Jul 31 21:14:31.585534 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.585510    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twkfj\" (UniqueName: \"kubernetes.io/projected/5ebbcf83-7cdd-4b6f-83ca-46f7373bef41-kube-api-access-twkfj\") pod \"payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz\" (UID: \"5ebbcf83-7cdd-4b6f-83ca-46f7373bef41\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"
Jul 31 21:14:31.658852 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.658765    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"
Jul 31 21:14:31.658852 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.658805    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp" event={"ID":"a5e5eb07-2321-4f26-83c7-a836dc544139","Type":"ContainerDied","Data":"d2f2b9382cdf000f274a9594c50de0ff2ef265f07f87815126b6b1a39bf08e8b"}
Jul 31 21:14:31.659323 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.658867    2566 scope.go:117] "RemoveContainer" containerID="a31adcbcd99ca2142c1e3a4a676553fcccbd8394143853bf08d57d6437e0b4db"
Jul 31 21:14:31.678279 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.678249    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb9l4\" (UniqueName: \"kubernetes.io/projected/b7514593-4399-494d-b35c-70ad6e826758-kube-api-access-lb9l4\") pod \"payload-processing-e2e-api-a-268e33-75f9955c78-vlttq\" (UID: \"b7514593-4399-494d-b35c-70ad6e826758\") " pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"
Jul 31 21:14:31.678414 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.678288    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7514593-4399-494d-b35c-70ad6e826758-plugins-config-volume\") pod \"payload-processing-e2e-api-a-268e33-75f9955c78-vlttq\" (UID: \"b7514593-4399-494d-b35c-70ad6e826758\") " pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"
Jul 31 21:14:31.678914 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.678897    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7514593-4399-494d-b35c-70ad6e826758-plugins-config-volume\") pod \"payload-processing-e2e-api-a-268e33-75f9955c78-vlttq\" (UID: \"b7514593-4399-494d-b35c-70ad6e826758\") " pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"
Jul 31 21:14:31.682599 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.682570    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"]
Jul 31 21:14:31.684953 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.684927    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c8d2ed-openshift-default-5cd5d4497b-l4fwp"]
Jul 31 21:14:31.687829 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.687807    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb9l4\" (UniqueName: \"kubernetes.io/projected/b7514593-4399-494d-b35c-70ad6e826758-kube-api-access-lb9l4\") pod \"payload-processing-e2e-api-a-268e33-75f9955c78-vlttq\" (UID: \"b7514593-4399-494d-b35c-70ad6e826758\") " pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"
Jul 31 21:14:31.692453 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.692433    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"
Jul 31 21:14:31.742816 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.742727    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"
Jul 31 21:14:31.845469 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.845436    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"]
Jul 31 21:14:31.898337 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.898312    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"]
Jul 31 21:14:31.899889 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:14:31.899855    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7514593_4399_494d_b35c_70ad6e826758.slice/crio-d46eba2a24dd7533ac47043e37a38ca7b949348a2168c00cfe58a725cfdd12e2 WatchSource:0}: Error finding container d46eba2a24dd7533ac47043e37a38ca7b949348a2168c00cfe58a725cfdd12e2: Status 404 returned error can't find the container with id d46eba2a24dd7533ac47043e37a38ca7b949348a2168c00cfe58a725cfdd12e2
Jul 31 21:14:31.938698 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:31.938665    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5e5eb07-2321-4f26-83c7-a836dc544139" path="/var/lib/kubelet/pods/a5e5eb07-2321-4f26-83c7-a836dc544139/volumes"
Jul 31 21:14:32.666169 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:32.666102    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq" event={"ID":"b7514593-4399-494d-b35c-70ad6e826758","Type":"ContainerStarted","Data":"8c38e39de0474c4aaa4cfeffbbff2495bbbc1ccffe9dc4e46fbb6599fc48cbc9"}
Jul 31 21:14:32.666665 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:32.666189    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq" event={"ID":"b7514593-4399-494d-b35c-70ad6e826758","Type":"ContainerStarted","Data":"d46eba2a24dd7533ac47043e37a38ca7b949348a2168c00cfe58a725cfdd12e2"}
Jul 31 21:14:32.666665 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:32.666347    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"
Jul 31 21:14:32.669005 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:32.668976    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz" event={"ID":"5ebbcf83-7cdd-4b6f-83ca-46f7373bef41","Type":"ContainerStarted","Data":"2033b10794d60f44a899e4d99a079cacb5b4d5eea41e4111537e3610914dc013"}
Jul 31 21:14:32.669197 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:32.669026    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz" event={"ID":"5ebbcf83-7cdd-4b6f-83ca-46f7373bef41","Type":"ContainerStarted","Data":"7cfd914a3b84720245cf32e0b87a29c0a4b147a8a9efe0d93435c04d8fe35e1d"}
Jul 31 21:14:32.669264 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:32.669226    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"
Jul 31 21:14:32.684471 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:32.684413    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq" podStartSLOduration=1.684396151 podStartE2EDuration="1.684396151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:14:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:14:32.681979572 +0000 UTC m=+2677.287372042" watchObservedRunningTime="2026-07-31 21:14:32.684396151 +0000 UTC m=+2677.289788605"
Jul 31 21:14:32.697053 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:32.697000    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz" podStartSLOduration=1.696983591 podStartE2EDuration="1.696983591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:14:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:14:32.69543821 +0000 UTC m=+2677.300830686" watchObservedRunningTime="2026-07-31 21:14:32.696983591 +0000 UTC m=+2677.302376067"
Jul 31 21:14:43.676564 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:43.676532    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"
Jul 31 21:14:43.677080 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:43.676705    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"
Jul 31 21:14:55.336068 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.335973    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"]
Jul 31 21:14:55.340768 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.340741    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.343039 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.343020    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-9a0b6d-openshift-default-dockercfg-4wk9h\""
Jul 31 21:14:55.351243 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.351215    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"]
Jul 31 21:14:55.370400 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.370353    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-data\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.370606 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.370415    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-podinfo\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.370606 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.370443    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvbsv\" (UniqueName: \"kubernetes.io/projected/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-kube-api-access-fvbsv\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.370606 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.370486    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istiod-ca-cert\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.370606 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.370518    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-credential-socket\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.370606 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.370563    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-workload-socket\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.370606 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.370592    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-workload-certs\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.370971 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.370614    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-token\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.370971 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.370875    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-envoy\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.471424 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.471386    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istiod-ca-cert\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.471424 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.471436    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-credential-socket\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.471711 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.471477    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-workload-socket\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.471711 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.471498    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-workload-certs\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.471711 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.471522    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-token\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.471711 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.471555    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-envoy\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.471711 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.471639    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-data\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.471711 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.471664    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-podinfo\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.471711 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.471692    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvbsv\" (UniqueName: \"kubernetes.io/projected/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-kube-api-access-fvbsv\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.472074 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.471894    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-credential-socket\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.472074 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.472064    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-workload-certs\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.472211 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.472099    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-workload-socket\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.472271 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.472237    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-data\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.472271 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.472252    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istiod-ca-cert\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.474427 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.474402    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-envoy\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.474843 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.474823    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-podinfo\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.484090 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.484054    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvbsv\" (UniqueName: \"kubernetes.io/projected/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-kube-api-access-fvbsv\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.484372 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.484350    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-token\") pod \"e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") " pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.653317 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.653224    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:55.797565 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.797488    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"]
Jul 31 21:14:55.800177 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:14:55.800133    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed69210_abe7_4d1b_adbf_8c49cf7e3bc3.slice/crio-d91137efba457455b49ce89e0c268ff1c2ed5fd01414fe7107c233e76dc8e2cf WatchSource:0}: Error finding container d91137efba457455b49ce89e0c268ff1c2ed5fd01414fe7107c233e76dc8e2cf: Status 404 returned error can't find the container with id d91137efba457455b49ce89e0c268ff1c2ed5fd01414fe7107c233e76dc8e2cf
Jul 31 21:14:55.802643 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.802600    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:14:55.802743 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.802686    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:14:55.802805 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:55.802762    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:14:56.785661 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:56.785624    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw" event={"ID":"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3","Type":"ContainerStarted","Data":"4cb8d366038211170ff3d4dcc123aafc062fe87c115e09dbd2445c1fe1c24c99"}
Jul 31 21:14:56.786055 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:56.785678    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw" event={"ID":"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3","Type":"ContainerStarted","Data":"d91137efba457455b49ce89e0c268ff1c2ed5fd01414fe7107c233e76dc8e2cf"}
Jul 31 21:14:56.804550 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:56.804497    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw" podStartSLOduration=1.804479936 podStartE2EDuration="1.804479936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:14:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:14:56.803370371 +0000 UTC m=+2701.408762856" watchObservedRunningTime="2026-07-31 21:14:56.804479936 +0000 UTC m=+2701.409872481"
Jul 31 21:14:57.654473 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:57.654431    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:57.659917 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:57.659888    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:57.790613 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:57.790583    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:14:57.791606 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:14:57.791590    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:15:00.131639 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.131590    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758875-7zl88"]
Jul 31 21:15:00.137030 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.137004    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-268e33-29758875-wb27s"]
Jul 31 21:15:00.137210 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.137130    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758875-7zl88"
Jul 31 21:15:00.139638 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.139608    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:15:00.140432 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.140409    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88"]
Jul 31 21:15:00.140568 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.140544    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-268e33-29758875-wb27s"
Jul 31 21:15:00.144247 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.144209    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-268e33-29758875-wb27s"]
Jul 31 21:15:00.144386 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.144331    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88"
Jul 31 21:15:00.145212 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.145192    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758875-7zl88"]
Jul 31 21:15:00.147790 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.147467    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88"]
Jul 31 21:15:00.152431 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.152406    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758875-7zl88"
Jul 31 21:15:00.162853 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.162830    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-268e33-29758875-wb27s"
Jul 31 21:15:00.199348 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.199323    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88"
Jul 31 21:15:00.343242 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.343212    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758875-7zl88"]
Jul 31 21:15:00.350096 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:15:00.350042    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be70cfd_f757_423d_bc7d_d52e3ba792de.slice/crio-98029fa6e39199e4ae0f74aa5e480291f6e667c6f311212992acdaba2fc2f333 WatchSource:0}: Error finding container 98029fa6e39199e4ae0f74aa5e480291f6e667c6f311212992acdaba2fc2f333: Status 404 returned error can't find the container with id 98029fa6e39199e4ae0f74aa5e480291f6e667c6f311212992acdaba2fc2f333
Jul 31 21:15:00.492798 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.492758    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"]
Jul 31 21:15:00.497286 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.497259    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"
Jul 31 21:15:00.499761 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.499738    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-9a0b6d\""
Jul 31 21:15:00.500227 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.500210    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-9a0b6d-dockercfg-gpr72\""
Jul 31 21:15:00.507878 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.507850    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"]
Jul 31 21:15:00.521623 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.521583    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a96940a-8e3d-407e-9896-5d3b080dc162-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd\" (UID: \"0a96940a-8e3d-407e-9896-5d3b080dc162\") " pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"
Jul 31 21:15:00.521782 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.521660    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rkgj\" (UniqueName: \"kubernetes.io/projected/0a96940a-8e3d-407e-9896-5d3b080dc162-kube-api-access-5rkgj\") pod \"payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd\" (UID: \"0a96940a-8e3d-407e-9896-5d3b080dc162\") " pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"
Jul 31 21:15:00.576765 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.576674    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-268e33-29758875-wb27s"]
Jul 31 21:15:00.578869 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:15:00.578807    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ddb4f63_84d5_411e_8dfe_f6d287d833ea.slice/crio-b6958bd71c4f59c9c74982a4713bf4f88006a79c163aa85cb50f6190e1b537fe WatchSource:0}: Error finding container b6958bd71c4f59c9c74982a4713bf4f88006a79c163aa85cb50f6190e1b537fe: Status 404 returned error can't find the container with id b6958bd71c4f59c9c74982a4713bf4f88006a79c163aa85cb50f6190e1b537fe
Jul 31 21:15:00.603340 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.603311    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88"]
Jul 31 21:15:00.616786 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:15:00.616757    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6752c72_5948_4a48_bb33_e9f797033674.slice/crio-8e7b5709176d80bc1f9716207d09dc919e8af56c8eaedbc2adffa0dc4c15fbe6 WatchSource:0}: Error finding container 8e7b5709176d80bc1f9716207d09dc919e8af56c8eaedbc2adffa0dc4c15fbe6: Status 404 returned error can't find the container with id 8e7b5709176d80bc1f9716207d09dc919e8af56c8eaedbc2adffa0dc4c15fbe6
Jul 31 21:15:00.622539 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.622513    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a96940a-8e3d-407e-9896-5d3b080dc162-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd\" (UID: \"0a96940a-8e3d-407e-9896-5d3b080dc162\") " pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"
Jul 31 21:15:00.622656 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.622552    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rkgj\" (UniqueName: \"kubernetes.io/projected/0a96940a-8e3d-407e-9896-5d3b080dc162-kube-api-access-5rkgj\") pod \"payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd\" (UID: \"0a96940a-8e3d-407e-9896-5d3b080dc162\") " pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"
Jul 31 21:15:00.623202 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.623180    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a96940a-8e3d-407e-9896-5d3b080dc162-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd\" (UID: \"0a96940a-8e3d-407e-9896-5d3b080dc162\") " pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"
Jul 31 21:15:00.630254 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.630217    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rkgj\" (UniqueName: \"kubernetes.io/projected/0a96940a-8e3d-407e-9896-5d3b080dc162-kube-api-access-5rkgj\") pod \"payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd\" (UID: \"0a96940a-8e3d-407e-9896-5d3b080dc162\") " pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"
Jul 31 21:15:00.807223 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.807177    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88" event={"ID":"d6752c72-5948-4a48-bb33-e9f797033674","Type":"ContainerStarted","Data":"8e7b5709176d80bc1f9716207d09dc919e8af56c8eaedbc2adffa0dc4c15fbe6"}
Jul 31 21:15:00.808339 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.808310    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-268e33-29758875-wb27s" event={"ID":"0ddb4f63-84d5-411e-8dfe-f6d287d833ea","Type":"ContainerStarted","Data":"b6958bd71c4f59c9c74982a4713bf4f88006a79c163aa85cb50f6190e1b537fe"}
Jul 31 21:15:00.809043 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.809009    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"
Jul 31 21:15:00.809777 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.809754    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758875-7zl88" event={"ID":"5be70cfd-f757-423d-bc7d-d52e3ba792de","Type":"ContainerStarted","Data":"2525488f31ef150573f3b739b6f6f3438cabea93dab6daabf8f40d5ed9c4d21e"}
Jul 31 21:15:00.809879 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.809797    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758875-7zl88" event={"ID":"5be70cfd-f757-423d-bc7d-d52e3ba792de","Type":"ContainerStarted","Data":"98029fa6e39199e4ae0f74aa5e480291f6e667c6f311212992acdaba2fc2f333"}
Jul 31 21:15:00.824535 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.824473    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758875-7zl88" podStartSLOduration=0.824453743 podStartE2EDuration="824.453743ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:15:00.822616988 +0000 UTC m=+2705.428009466" watchObservedRunningTime="2026-07-31 21:15:00.824453743 +0000 UTC m=+2705.429846218"
Jul 31 21:15:00.959729 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:00.959702    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"]
Jul 31 21:15:00.961751 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:15:00.961723    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a96940a_8e3d_407e_9896_5d3b080dc162.slice/crio-127b1a628e130c22881672692aec0369fe2482f494f5dfd5ad44d4adf088dfbe WatchSource:0}: Error finding container 127b1a628e130c22881672692aec0369fe2482f494f5dfd5ad44d4adf088dfbe: Status 404 returned error can't find the container with id 127b1a628e130c22881672692aec0369fe2482f494f5dfd5ad44d4adf088dfbe
Jul 31 21:15:01.816333 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:01.816295    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd" event={"ID":"0a96940a-8e3d-407e-9896-5d3b080dc162","Type":"ContainerStarted","Data":"5c3548de50a7930997713ad004e8fd3f4c38f34a233de5db1b64196109a08cbd"}
Jul 31 21:15:01.816805 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:01.816389    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd" event={"ID":"0a96940a-8e3d-407e-9896-5d3b080dc162","Type":"ContainerStarted","Data":"127b1a628e130c22881672692aec0369fe2482f494f5dfd5ad44d4adf088dfbe"}
Jul 31 21:15:01.816805 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:01.816419    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"
Jul 31 21:15:01.817924 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:01.817899    2566 generic.go:356] "Generic (PLEG): container finished" podID="d6752c72-5948-4a48-bb33-e9f797033674" containerID="5a37c8502e438e68bcb82afc8b91d634db204a5e155b3a4e9dbeb5499d7eeb53" exitCode=7
Jul 31 21:15:01.818015 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:01.817986    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88" event={"ID":"d6752c72-5948-4a48-bb33-e9f797033674","Type":"ContainerDied","Data":"5a37c8502e438e68bcb82afc8b91d634db204a5e155b3a4e9dbeb5499d7eeb53"}
Jul 31 21:15:01.818114 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:01.818102    2566 scope.go:117] "RemoveContainer" containerID="5a37c8502e438e68bcb82afc8b91d634db204a5e155b3a4e9dbeb5499d7eeb53"
Jul 31 21:15:01.819453 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:01.819431    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-268e33-29758875-wb27s" event={"ID":"0ddb4f63-84d5-411e-8dfe-f6d287d833ea","Type":"ContainerStarted","Data":"b83ec33d4e3d54d019681713349b2b1cf1b2533a5d4ecd38a8dfba4a5a1e5322"}
Jul 31 21:15:01.820849 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:01.820828    2566 generic.go:356] "Generic (PLEG): container finished" podID="5be70cfd-f757-423d-bc7d-d52e3ba792de" containerID="2525488f31ef150573f3b739b6f6f3438cabea93dab6daabf8f40d5ed9c4d21e" exitCode=0
Jul 31 21:15:01.820931 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:01.820894    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758875-7zl88" event={"ID":"5be70cfd-f757-423d-bc7d-d52e3ba792de","Type":"ContainerDied","Data":"2525488f31ef150573f3b739b6f6f3438cabea93dab6daabf8f40d5ed9c4d21e"}
Jul 31 21:15:01.832809 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:01.832749    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd" podStartSLOduration=1.832728354 podStartE2EDuration="1.832728354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:15:01.831347165 +0000 UTC m=+2706.436739643" watchObservedRunningTime="2026-07-31 21:15:01.832728354 +0000 UTC m=+2706.438120820"
Jul 31 21:15:01.875473 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:01.875413    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-268e33-29758875-wb27s" podStartSLOduration=1.8753954560000001 podStartE2EDuration="1.875395456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:15:01.875000686 +0000 UTC m=+2706.480393153" watchObservedRunningTime="2026-07-31 21:15:01.875395456 +0000 UTC m=+2706.480787926"
Jul 31 21:15:02.829591 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:02.829551    2566 generic.go:356] "Generic (PLEG): container finished" podID="d6752c72-5948-4a48-bb33-e9f797033674" containerID="e7d6efa31e271b9cc9acd0592726146ba8b4585471e7abafa8cb42b0750abecb" exitCode=7
Jul 31 21:15:02.830212 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:02.829632    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88" event={"ID":"d6752c72-5948-4a48-bb33-e9f797033674","Type":"ContainerDied","Data":"e7d6efa31e271b9cc9acd0592726146ba8b4585471e7abafa8cb42b0750abecb"}
Jul 31 21:15:02.830212 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:02.829697    2566 scope.go:117] "RemoveContainer" containerID="5a37c8502e438e68bcb82afc8b91d634db204a5e155b3a4e9dbeb5499d7eeb53"
Jul 31 21:15:02.830212 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:02.829900    2566 scope.go:117] "RemoveContainer" containerID="e7d6efa31e271b9cc9acd0592726146ba8b4585471e7abafa8cb42b0750abecb"
Jul 31 21:15:02.830744 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:15:02.830506    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88_odh-ai-gateway-infra(d6752c72-5948-4a48-bb33-e9f797033674)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88" podUID="d6752c72-5948-4a48-bb33-e9f797033674"
Jul 31 21:15:02.831946 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:02.831924    2566 generic.go:356] "Generic (PLEG): container finished" podID="0ddb4f63-84d5-411e-8dfe-f6d287d833ea" containerID="b83ec33d4e3d54d019681713349b2b1cf1b2533a5d4ecd38a8dfba4a5a1e5322" exitCode=0
Jul 31 21:15:02.832078 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:02.831964    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-268e33-29758875-wb27s" event={"ID":"0ddb4f63-84d5-411e-8dfe-f6d287d833ea","Type":"ContainerDied","Data":"b83ec33d4e3d54d019681713349b2b1cf1b2533a5d4ecd38a8dfba4a5a1e5322"}
Jul 31 21:15:02.986605 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:02.986576    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758875-7zl88"
Jul 31 21:15:03.843029 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:03.842989    2566 scope.go:117] "RemoveContainer" containerID="e7d6efa31e271b9cc9acd0592726146ba8b4585471e7abafa8cb42b0750abecb"
Jul 31 21:15:03.843560 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:15:03.843304    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88_odh-ai-gateway-infra(d6752c72-5948-4a48-bb33-e9f797033674)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88" podUID="d6752c72-5948-4a48-bb33-e9f797033674"
Jul 31 21:15:03.845840 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:03.845811    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758875-7zl88"
Jul 31 21:15:03.848876 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:03.847770    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29758875-7zl88" event={"ID":"5be70cfd-f757-423d-bc7d-d52e3ba792de","Type":"ContainerDied","Data":"98029fa6e39199e4ae0f74aa5e480291f6e667c6f311212992acdaba2fc2f333"}
Jul 31 21:15:03.848876 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:03.848847    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98029fa6e39199e4ae0f74aa5e480291f6e667c6f311212992acdaba2fc2f333"
Jul 31 21:15:04.021420 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:04.021394    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-268e33-29758875-wb27s"
Jul 31 21:15:04.856338 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:04.856298    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-268e33-29758875-wb27s" event={"ID":"0ddb4f63-84d5-411e-8dfe-f6d287d833ea","Type":"ContainerDied","Data":"b6958bd71c4f59c9c74982a4713bf4f88006a79c163aa85cb50f6190e1b537fe"}
Jul 31 21:15:04.856843 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:04.856361    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6958bd71c4f59c9c74982a4713bf4f88006a79c163aa85cb50f6190e1b537fe"
Jul 31 21:15:04.856843 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:04.856430    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-268e33-29758875-wb27s"
Jul 31 21:15:11.894275 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:11.894244    2566 generic.go:356] "Generic (PLEG): container finished" podID="0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" containerID="4cb8d366038211170ff3d4dcc123aafc062fe87c115e09dbd2445c1fe1c24c99" exitCode=0
Jul 31 21:15:11.894692 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:11.894285    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw" event={"ID":"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3","Type":"ContainerDied","Data":"4cb8d366038211170ff3d4dcc123aafc062fe87c115e09dbd2445c1fe1c24c99"}
Jul 31 21:15:11.894692 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:11.894632    2566 scope.go:117] "RemoveContainer" containerID="4cb8d366038211170ff3d4dcc123aafc062fe87c115e09dbd2445c1fe1c24c99"
Jul 31 21:15:11.895620 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:11.895591    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:15:11.895693 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:11.895663    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:15:11.895740 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:11.895693    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:15:12.790618 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:12.790579    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:15:12.843441 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:12.843400    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"
Jul 31 21:15:12.900941 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:12.900908    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw" event={"ID":"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3","Type":"ContainerStarted","Data":"ec748516a068ab8c520cae64e45266ce710958729263d63e15101d799027379b"}
Jul 31 21:15:13.653539 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:13.653500    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:15:13.654770 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:13.654739    2566 patch_prober.go:28] interesting pod/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 31 21:15:13.654906 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:13.654805    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw" podUID="0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 31 21:15:14.654434 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:14.654390    2566 patch_prober.go:28] interesting pod/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 31 21:15:14.655037 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:14.654471    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw" podUID="0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 31 21:15:15.654300 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:15.654262    2566 patch_prober.go:28] interesting pod/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 31 21:15:15.654495 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:15.654335    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw" podUID="0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 31 21:15:16.654132 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:16.654098    2566 patch_prober.go:28] interesting pod/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 31 21:15:16.654357 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:16.654175    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw" podUID="0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 31 21:15:17.653719 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:17.653675    2566 patch_prober.go:28] interesting pod/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 31 21:15:17.654131 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:17.653756    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw" podUID="0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 31 21:15:17.929638 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:17.929547    2566 scope.go:117] "RemoveContainer" containerID="e7d6efa31e271b9cc9acd0592726146ba8b4585471e7abafa8cb42b0750abecb"
Jul 31 21:15:18.657628 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:18.657589    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:15:18.658077 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:18.657862    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:15:18.658567 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:18.658550    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:15:18.932698 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:18.932661    2566 generic.go:356] "Generic (PLEG): container finished" podID="d6752c72-5948-4a48-bb33-e9f797033674" containerID="5ad38b8398a1e727deb4b685a758d412a7b13c42b597b6ff443458eff258f4b9" exitCode=0
Jul 31 21:15:18.932865 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:18.932737    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88" event={"ID":"d6752c72-5948-4a48-bb33-e9f797033674","Type":"ContainerDied","Data":"5ad38b8398a1e727deb4b685a758d412a7b13c42b597b6ff443458eff258f4b9"}
Jul 31 21:15:18.932865 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:18.932807    2566 scope.go:117] "RemoveContainer" containerID="e7d6efa31e271b9cc9acd0592726146ba8b4585471e7abafa8cb42b0750abecb"
Jul 31 21:15:19.961321 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:19.961288    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88"]
Jul 31 21:15:20.083276 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:20.083247    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88"
Jul 31 21:15:20.944510 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:20.944469    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88" event={"ID":"d6752c72-5948-4a48-bb33-e9f797033674","Type":"ContainerDied","Data":"8e7b5709176d80bc1f9716207d09dc919e8af56c8eaedbc2adffa0dc4c15fbe6"}
Jul 31 21:15:20.944510 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:20.944500    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88"
Jul 31 21:15:20.944745 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:20.944528    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e7b5709176d80bc1f9716207d09dc919e8af56c8eaedbc2adffa0dc4c15fbe6"
Jul 31 21:15:20.973337 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:20.973297    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88"]
Jul 31 21:15:20.979039 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:20.979013    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-9a0b6d-29758875-ntd88"]
Jul 31 21:15:21.935653 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:21.935620    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6752c72-5948-4a48-bb33-e9f797033674" path="/var/lib/kubelet/pods/d6752c72-5948-4a48-bb33-e9f797033674/volumes"
Jul 31 21:15:31.816411 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.816363    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-268e33-jlh8g"]
Jul 31 21:15:31.816807 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.816764    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be70cfd-f757-423d-bc7d-d52e3ba792de" containerName="cleanup"
Jul 31 21:15:31.816807 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.816777    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be70cfd-f757-423d-bc7d-d52e3ba792de" containerName="cleanup"
Jul 31 21:15:31.816807 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.816790    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6752c72-5948-4a48-bb33-e9f797033674" containerName="cleanup"
Jul 31 21:15:31.816807 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.816795    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6752c72-5948-4a48-bb33-e9f797033674" containerName="cleanup"
Jul 31 21:15:31.816807 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.816801    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6752c72-5948-4a48-bb33-e9f797033674" containerName="cleanup"
Jul 31 21:15:31.816807 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.816807    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6752c72-5948-4a48-bb33-e9f797033674" containerName="cleanup"
Jul 31 21:15:31.816999 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.816819    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6752c72-5948-4a48-bb33-e9f797033674" containerName="cleanup"
Jul 31 21:15:31.816999 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.816824    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6752c72-5948-4a48-bb33-e9f797033674" containerName="cleanup"
Jul 31 21:15:31.816999 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.816832    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ddb4f63-84d5-411e-8dfe-f6d287d833ea" containerName="cleanup"
Jul 31 21:15:31.816999 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.816837    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ddb4f63-84d5-411e-8dfe-f6d287d833ea" containerName="cleanup"
Jul 31 21:15:31.816999 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.816914    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5be70cfd-f757-423d-bc7d-d52e3ba792de" containerName="cleanup"
Jul 31 21:15:31.816999 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.816921    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6752c72-5948-4a48-bb33-e9f797033674" containerName="cleanup"
Jul 31 21:15:31.816999 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.816927    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6752c72-5948-4a48-bb33-e9f797033674" containerName="cleanup"
Jul 31 21:15:31.816999 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.816933    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ddb4f63-84d5-411e-8dfe-f6d287d833ea" containerName="cleanup"
Jul 31 21:15:31.820098 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.820080    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-268e33-jlh8g"
Jul 31 21:15:31.823978 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.823954    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:15:31.828232 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.828206    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c3ed355-ec1e-41a2-a840-07e92354dd8f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-268e33-jlh8g\" (UID: \"1c3ed355-ec1e-41a2-a840-07e92354dd8f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-268e33-jlh8g"
Jul 31 21:15:31.828521 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.828491    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-268e33-jlh8g"]
Jul 31 21:15:31.929641 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.929595    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c3ed355-ec1e-41a2-a840-07e92354dd8f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-268e33-jlh8g\" (UID: \"1c3ed355-ec1e-41a2-a840-07e92354dd8f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-268e33-jlh8g"
Jul 31 21:15:31.930480 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:31.930447    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c3ed355-ec1e-41a2-a840-07e92354dd8f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-268e33-jlh8g\" (UID: \"1c3ed355-ec1e-41a2-a840-07e92354dd8f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-268e33-jlh8g"
Jul 31 21:15:32.132259 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:32.132174    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-268e33-jlh8g"
Jul 31 21:15:32.271527 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:32.271500    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-268e33-jlh8g"]
Jul 31 21:15:32.273743 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:15:32.273713    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3ed355_ec1e_41a2_a840_07e92354dd8f.slice/crio-71f794b5de0fd6856eb706b00e366bc77587e59dc154b376c48bf6dfb418894b WatchSource:0}: Error finding container 71f794b5de0fd6856eb706b00e366bc77587e59dc154b376c48bf6dfb418894b: Status 404 returned error can't find the container with id 71f794b5de0fd6856eb706b00e366bc77587e59dc154b376c48bf6dfb418894b
Jul 31 21:15:33.005824 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:33.005795    2566 generic.go:356] "Generic (PLEG): container finished" podID="1c3ed355-ec1e-41a2-a840-07e92354dd8f" containerID="db53029a66d45aeec24f732dfaed33117615e1d351c27e2441b133a7143bec8c" exitCode=0
Jul 31 21:15:33.006239 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:33.005884    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-268e33-jlh8g" event={"ID":"1c3ed355-ec1e-41a2-a840-07e92354dd8f","Type":"ContainerDied","Data":"db53029a66d45aeec24f732dfaed33117615e1d351c27e2441b133a7143bec8c"}
Jul 31 21:15:33.006239 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:33.005939    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-268e33-jlh8g" event={"ID":"1c3ed355-ec1e-41a2-a840-07e92354dd8f","Type":"ContainerStarted","Data":"71f794b5de0fd6856eb706b00e366bc77587e59dc154b376c48bf6dfb418894b"}
Jul 31 21:15:34.153082 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:34.153048    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-268e33-jlh8g"
Jul 31 21:15:34.245732 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:34.245697    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c3ed355-ec1e-41a2-a840-07e92354dd8f-maas-api-service-ca\") pod \"1c3ed355-ec1e-41a2-a840-07e92354dd8f\" (UID: \"1c3ed355-ec1e-41a2-a840-07e92354dd8f\") "
Jul 31 21:15:34.246116 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:34.246088    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c3ed355-ec1e-41a2-a840-07e92354dd8f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1c3ed355-ec1e-41a2-a840-07e92354dd8f" (UID: "1c3ed355-ec1e-41a2-a840-07e92354dd8f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:15:34.346987 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:34.346947    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c3ed355-ec1e-41a2-a840-07e92354dd8f-maas-api-service-ca\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:15:35.017167 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:35.017121    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-268e33-jlh8g"
Jul 31 21:15:35.017378 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:35.017178    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-268e33-jlh8g" event={"ID":"1c3ed355-ec1e-41a2-a840-07e92354dd8f","Type":"ContainerDied","Data":"71f794b5de0fd6856eb706b00e366bc77587e59dc154b376c48bf6dfb418894b"}
Jul 31 21:15:35.017378 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:35.017235    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71f794b5de0fd6856eb706b00e366bc77587e59dc154b376c48bf6dfb418894b"
Jul 31 21:15:42.727392 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:42.727353    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-268e33-29758875-wb27s"]
Jul 31 21:15:42.729346 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:42.729319    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-268e33-29758875-wb27s"]
Jul 31 21:15:42.754307 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:42.754270    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"]
Jul 31 21:15:42.754569 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:42.754539    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq" podUID="b7514593-4399-494d-b35c-70ad6e826758" containerName="payload-processing" containerID="cri-o://8c38e39de0474c4aaa4cfeffbbff2495bbbc1ccffe9dc4e46fbb6599fc48cbc9" gracePeriod=30
Jul 31 21:15:42.761667 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:42.761639    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"]
Jul 31 21:15:42.761844 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:42.761824    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz" podUID="5ebbcf83-7cdd-4b6f-83ca-46f7373bef41" containerName="payload-pre-processing" containerID="cri-o://2033b10794d60f44a899e4d99a079cacb5b4d5eea41e4111537e3610914dc013" gracePeriod=30
Jul 31 21:15:43.057865 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.057826    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"
Jul 31 21:15:43.058541 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.058510    2566 generic.go:356] "Generic (PLEG): container finished" podID="5ebbcf83-7cdd-4b6f-83ca-46f7373bef41" containerID="2033b10794d60f44a899e4d99a079cacb5b4d5eea41e4111537e3610914dc013" exitCode=0
Jul 31 21:15:43.058640 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.058556    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz" event={"ID":"5ebbcf83-7cdd-4b6f-83ca-46f7373bef41","Type":"ContainerDied","Data":"2033b10794d60f44a899e4d99a079cacb5b4d5eea41e4111537e3610914dc013"}
Jul 31 21:15:43.058702 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.058643    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz" event={"ID":"5ebbcf83-7cdd-4b6f-83ca-46f7373bef41","Type":"ContainerDied","Data":"7cfd914a3b84720245cf32e0b87a29c0a4b147a8a9efe0d93435c04d8fe35e1d"}
Jul 31 21:15:43.058702 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.058661    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cfd914a3b84720245cf32e0b87a29c0a4b147a8a9efe0d93435c04d8fe35e1d"
Jul 31 21:15:43.059709 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.059687    2566 generic.go:356] "Generic (PLEG): container finished" podID="b7514593-4399-494d-b35c-70ad6e826758" containerID="8c38e39de0474c4aaa4cfeffbbff2495bbbc1ccffe9dc4e46fbb6599fc48cbc9" exitCode=0
Jul 31 21:15:43.059803 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.059723    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq" event={"ID":"b7514593-4399-494d-b35c-70ad6e826758","Type":"ContainerDied","Data":"8c38e39de0474c4aaa4cfeffbbff2495bbbc1ccffe9dc4e46fbb6599fc48cbc9"}
Jul 31 21:15:43.059803 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.059754    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq" event={"ID":"b7514593-4399-494d-b35c-70ad6e826758","Type":"ContainerDied","Data":"d46eba2a24dd7533ac47043e37a38ca7b949348a2168c00cfe58a725cfdd12e2"}
Jul 31 21:15:43.059803 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.059726    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"
Jul 31 21:15:43.059803 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.059775    2566 scope.go:117] "RemoveContainer" containerID="8c38e39de0474c4aaa4cfeffbbff2495bbbc1ccffe9dc4e46fbb6599fc48cbc9"
Jul 31 21:15:43.061244 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.061228    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"
Jul 31 21:15:43.065273 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.065253    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-268e33-jlh8g"]
Jul 31 21:15:43.068050 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.068029    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-268e33-jlh8g"]
Jul 31 21:15:43.069564 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.069551    2566 scope.go:117] "RemoveContainer" containerID="8c38e39de0474c4aaa4cfeffbbff2495bbbc1ccffe9dc4e46fbb6599fc48cbc9"
Jul 31 21:15:43.069820 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:15:43.069799    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c38e39de0474c4aaa4cfeffbbff2495bbbc1ccffe9dc4e46fbb6599fc48cbc9\": container with ID starting with 8c38e39de0474c4aaa4cfeffbbff2495bbbc1ccffe9dc4e46fbb6599fc48cbc9 not found: ID does not exist" containerID="8c38e39de0474c4aaa4cfeffbbff2495bbbc1ccffe9dc4e46fbb6599fc48cbc9"
Jul 31 21:15:43.069900 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.069828    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c38e39de0474c4aaa4cfeffbbff2495bbbc1ccffe9dc4e46fbb6599fc48cbc9"} err="failed to get container status \"8c38e39de0474c4aaa4cfeffbbff2495bbbc1ccffe9dc4e46fbb6599fc48cbc9\": rpc error: code = NotFound desc = could not find container \"8c38e39de0474c4aaa4cfeffbbff2495bbbc1ccffe9dc4e46fbb6599fc48cbc9\": container with ID starting with 8c38e39de0474c4aaa4cfeffbbff2495bbbc1ccffe9dc4e46fbb6599fc48cbc9 not found: ID does not exist"
Jul 31 21:15:43.123490 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.123456    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7514593-4399-494d-b35c-70ad6e826758-plugins-config-volume\") pod \"b7514593-4399-494d-b35c-70ad6e826758\" (UID: \"b7514593-4399-494d-b35c-70ad6e826758\") "
Jul 31 21:15:43.123664 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.123594    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ebbcf83-7cdd-4b6f-83ca-46f7373bef41-plugins-config-volume\") pod \"5ebbcf83-7cdd-4b6f-83ca-46f7373bef41\" (UID: \"5ebbcf83-7cdd-4b6f-83ca-46f7373bef41\") "
Jul 31 21:15:43.123664 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.123628    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twkfj\" (UniqueName: \"kubernetes.io/projected/5ebbcf83-7cdd-4b6f-83ca-46f7373bef41-kube-api-access-twkfj\") pod \"5ebbcf83-7cdd-4b6f-83ca-46f7373bef41\" (UID: \"5ebbcf83-7cdd-4b6f-83ca-46f7373bef41\") "
Jul 31 21:15:43.123790 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.123679    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lb9l4\" (UniqueName: \"kubernetes.io/projected/b7514593-4399-494d-b35c-70ad6e826758-kube-api-access-lb9l4\") pod \"b7514593-4399-494d-b35c-70ad6e826758\" (UID: \"b7514593-4399-494d-b35c-70ad6e826758\") "
Jul 31 21:15:43.123982 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.123954    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7514593-4399-494d-b35c-70ad6e826758-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b7514593-4399-494d-b35c-70ad6e826758" (UID: "b7514593-4399-494d-b35c-70ad6e826758"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:15:43.124085 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.123992    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ebbcf83-7cdd-4b6f-83ca-46f7373bef41-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5ebbcf83-7cdd-4b6f-83ca-46f7373bef41" (UID: "5ebbcf83-7cdd-4b6f-83ca-46f7373bef41"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:15:43.125972 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.125947    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7514593-4399-494d-b35c-70ad6e826758-kube-api-access-lb9l4" (OuterVolumeSpecName: "kube-api-access-lb9l4") pod "b7514593-4399-494d-b35c-70ad6e826758" (UID: "b7514593-4399-494d-b35c-70ad6e826758"). InnerVolumeSpecName "kube-api-access-lb9l4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:15:43.126053 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.125983    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ebbcf83-7cdd-4b6f-83ca-46f7373bef41-kube-api-access-twkfj" (OuterVolumeSpecName: "kube-api-access-twkfj") pod "5ebbcf83-7cdd-4b6f-83ca-46f7373bef41" (UID: "5ebbcf83-7cdd-4b6f-83ca-46f7373bef41"). InnerVolumeSpecName "kube-api-access-twkfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:15:43.224429 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.224387    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lb9l4\" (UniqueName: \"kubernetes.io/projected/b7514593-4399-494d-b35c-70ad6e826758-kube-api-access-lb9l4\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:15:43.224429 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.224420    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7514593-4399-494d-b35c-70ad6e826758-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:15:43.224429 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.224429    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ebbcf83-7cdd-4b6f-83ca-46f7373bef41-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:15:43.224429 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.224437    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twkfj\" (UniqueName: \"kubernetes.io/projected/5ebbcf83-7cdd-4b6f-83ca-46f7373bef41-kube-api-access-twkfj\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:15:43.380727 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.380692    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"]
Jul 31 21:15:43.386648 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.386620    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-268e33-75f9955c78-vlttq"]
Jul 31 21:15:43.935688 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.935649    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ddb4f63-84d5-411e-8dfe-f6d287d833ea" path="/var/lib/kubelet/pods/0ddb4f63-84d5-411e-8dfe-f6d287d833ea/volumes"
Jul 31 21:15:43.936196 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.935940    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c3ed355-ec1e-41a2-a840-07e92354dd8f" path="/var/lib/kubelet/pods/1c3ed355-ec1e-41a2-a840-07e92354dd8f/volumes"
Jul 31 21:15:43.936260 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:43.936252    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7514593-4399-494d-b35c-70ad6e826758" path="/var/lib/kubelet/pods/b7514593-4399-494d-b35c-70ad6e826758/volumes"
Jul 31 21:15:44.066424 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:44.066398    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"
Jul 31 21:15:44.082453 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:44.082420    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"]
Jul 31 21:15:44.085378 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:44.085343    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-268e33-6d7f6c69c6-z2vbz"]
Jul 31 21:15:45.936850 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:45.936817    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ebbcf83-7cdd-4b6f-83ca-46f7373bef41" path="/var/lib/kubelet/pods/5ebbcf83-7cdd-4b6f-83ca-46f7373bef41/volumes"
Jul 31 21:15:50.052473 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.052441    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86"]
Jul 31 21:15:50.052888 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.052800    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ebbcf83-7cdd-4b6f-83ca-46f7373bef41" containerName="payload-pre-processing"
Jul 31 21:15:50.052888 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.052813    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ebbcf83-7cdd-4b6f-83ca-46f7373bef41" containerName="payload-pre-processing"
Jul 31 21:15:50.052888 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.052822    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7514593-4399-494d-b35c-70ad6e826758" containerName="payload-processing"
Jul 31 21:15:50.052888 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.052828    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7514593-4399-494d-b35c-70ad6e826758" containerName="payload-processing"
Jul 31 21:15:50.052888 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.052849    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3ed355-ec1e-41a2-a840-07e92354dd8f" containerName="revoke-keys"
Jul 31 21:15:50.052888 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.052856    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3ed355-ec1e-41a2-a840-07e92354dd8f" containerName="revoke-keys"
Jul 31 21:15:50.053086 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.052912    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7514593-4399-494d-b35c-70ad6e826758" containerName="payload-processing"
Jul 31 21:15:50.053086 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.052921    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c3ed355-ec1e-41a2-a840-07e92354dd8f" containerName="revoke-keys"
Jul 31 21:15:50.053086 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.052928    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6752c72-5948-4a48-bb33-e9f797033674" containerName="cleanup"
Jul 31 21:15:50.053086 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.052935    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ebbcf83-7cdd-4b6f-83ca-46f7373bef41" containerName="payload-pre-processing"
Jul 31 21:15:50.057377 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.057355    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86"
Jul 31 21:15:50.060013 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.059982    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:15:50.062135 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.062107    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86"]
Jul 31 21:15:50.186816 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.186767    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cdb300a-1f95-464f-bcf4-56139590fb41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86\" (UID: \"7cdb300a-1f95-464f-bcf4-56139590fb41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86"
Jul 31 21:15:50.288059 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.288015    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cdb300a-1f95-464f-bcf4-56139590fb41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86\" (UID: \"7cdb300a-1f95-464f-bcf4-56139590fb41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86"
Jul 31 21:15:50.288685 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.288655    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cdb300a-1f95-464f-bcf4-56139590fb41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86\" (UID: \"7cdb300a-1f95-464f-bcf4-56139590fb41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86"
Jul 31 21:15:50.370300 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.370206    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86"
Jul 31 21:15:50.506819 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:50.506794    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86"]
Jul 31 21:15:50.509223 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:15:50.509192    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cdb300a_1f95_464f_bcf4_56139590fb41.slice/crio-1a828126b455018e914f2596cfac791fd1f983c2d4b4e07257e8d391dd364864 WatchSource:0}: Error finding container 1a828126b455018e914f2596cfac791fd1f983c2d4b4e07257e8d391dd364864: Status 404 returned error can't find the container with id 1a828126b455018e914f2596cfac791fd1f983c2d4b4e07257e8d391dd364864
Jul 31 21:15:51.103902 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:51.103864    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86" event={"ID":"7cdb300a-1f95-464f-bcf4-56139590fb41","Type":"ContainerStarted","Data":"0c4e1f4690740b46d78345d602310ad0f56e89f580f9002977a8e35d5d6f2f59"}
Jul 31 21:15:51.104421 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:51.103925    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86" event={"ID":"7cdb300a-1f95-464f-bcf4-56139590fb41","Type":"ContainerStarted","Data":"1a828126b455018e914f2596cfac791fd1f983c2d4b4e07257e8d391dd364864"}
Jul 31 21:15:51.119494 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:51.119442    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86" podStartSLOduration=1.119427353 podStartE2EDuration="1.119427353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:15:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:15:51.117045811 +0000 UTC m=+2755.722438289" watchObservedRunningTime="2026-07-31 21:15:51.119427353 +0000 UTC m=+2755.724819829"
Jul 31 21:15:52.110171 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:52.110110    2566 generic.go:356] "Generic (PLEG): container finished" podID="7cdb300a-1f95-464f-bcf4-56139590fb41" containerID="0c4e1f4690740b46d78345d602310ad0f56e89f580f9002977a8e35d5d6f2f59" exitCode=0
Jul 31 21:15:52.110630 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:52.110199    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86" event={"ID":"7cdb300a-1f95-464f-bcf4-56139590fb41","Type":"ContainerDied","Data":"0c4e1f4690740b46d78345d602310ad0f56e89f580f9002977a8e35d5d6f2f59"}
Jul 31 21:15:53.252619 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:53.252588    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86"
Jul 31 21:15:53.313388 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:53.313349    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cdb300a-1f95-464f-bcf4-56139590fb41-maas-api-service-ca\") pod \"7cdb300a-1f95-464f-bcf4-56139590fb41\" (UID: \"7cdb300a-1f95-464f-bcf4-56139590fb41\") "
Jul 31 21:15:53.313709 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:53.313683    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cdb300a-1f95-464f-bcf4-56139590fb41-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7cdb300a-1f95-464f-bcf4-56139590fb41" (UID: "7cdb300a-1f95-464f-bcf4-56139590fb41"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:15:53.414648 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:53.414558    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cdb300a-1f95-464f-bcf4-56139590fb41-maas-api-service-ca\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:15:54.121567 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:54.121537    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86"
Jul 31 21:15:54.121715 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:54.121542    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86" event={"ID":"7cdb300a-1f95-464f-bcf4-56139590fb41","Type":"ContainerDied","Data":"1a828126b455018e914f2596cfac791fd1f983c2d4b4e07257e8d391dd364864"}
Jul 31 21:15:54.121715 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:15:54.121651    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a828126b455018e914f2596cfac791fd1f983c2d4b4e07257e8d391dd364864"
Jul 31 21:16:00.953750 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:00.953708    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"]
Jul 31 21:16:00.954243 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:00.953985    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd" podUID="0a96940a-8e3d-407e-9896-5d3b080dc162" containerName="payload-processing" containerID="cri-o://5c3548de50a7930997713ad004e8fd3f4c38f34a233de5db1b64196109a08cbd" gracePeriod=30
Jul 31 21:16:01.124488 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:01.124442    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86"]
Jul 31 21:16:01.127133 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:01.127085    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9a0b6d-rtc86"]
Jul 31 21:16:01.164872 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:01.164650    2566 generic.go:356] "Generic (PLEG): container finished" podID="0a96940a-8e3d-407e-9896-5d3b080dc162" containerID="5c3548de50a7930997713ad004e8fd3f4c38f34a233de5db1b64196109a08cbd" exitCode=0
Jul 31 21:16:01.164872 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:01.164796    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd" event={"ID":"0a96940a-8e3d-407e-9896-5d3b080dc162","Type":"ContainerDied","Data":"5c3548de50a7930997713ad004e8fd3f4c38f34a233de5db1b64196109a08cbd"}
Jul 31 21:16:01.227898 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:01.227871    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"
Jul 31 21:16:01.280269 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:01.280239    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a96940a-8e3d-407e-9896-5d3b080dc162-plugins-config-volume\") pod \"0a96940a-8e3d-407e-9896-5d3b080dc162\" (UID: \"0a96940a-8e3d-407e-9896-5d3b080dc162\") "
Jul 31 21:16:01.280269 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:01.280276    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rkgj\" (UniqueName: \"kubernetes.io/projected/0a96940a-8e3d-407e-9896-5d3b080dc162-kube-api-access-5rkgj\") pod \"0a96940a-8e3d-407e-9896-5d3b080dc162\" (UID: \"0a96940a-8e3d-407e-9896-5d3b080dc162\") "
Jul 31 21:16:01.280710 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:01.280675    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a96940a-8e3d-407e-9896-5d3b080dc162-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0a96940a-8e3d-407e-9896-5d3b080dc162" (UID: "0a96940a-8e3d-407e-9896-5d3b080dc162"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:16:01.282828 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:01.282785    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a96940a-8e3d-407e-9896-5d3b080dc162-kube-api-access-5rkgj" (OuterVolumeSpecName: "kube-api-access-5rkgj") pod "0a96940a-8e3d-407e-9896-5d3b080dc162" (UID: "0a96940a-8e3d-407e-9896-5d3b080dc162"). InnerVolumeSpecName "kube-api-access-5rkgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:16:01.381070 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:01.381025    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a96940a-8e3d-407e-9896-5d3b080dc162-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:16:01.381070 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:01.381062    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rkgj\" (UniqueName: \"kubernetes.io/projected/0a96940a-8e3d-407e-9896-5d3b080dc162-kube-api-access-5rkgj\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:16:01.935483 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:01.935450    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cdb300a-1f95-464f-bcf4-56139590fb41" path="/var/lib/kubelet/pods/7cdb300a-1f95-464f-bcf4-56139590fb41/volumes"
Jul 31 21:16:02.171276 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:02.171240    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"
Jul 31 21:16:02.171729 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:02.171289    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd" event={"ID":"0a96940a-8e3d-407e-9896-5d3b080dc162","Type":"ContainerDied","Data":"127b1a628e130c22881672692aec0369fe2482f494f5dfd5ad44d4adf088dfbe"}
Jul 31 21:16:02.171729 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:02.171356    2566 scope.go:117] "RemoveContainer" containerID="5c3548de50a7930997713ad004e8fd3f4c38f34a233de5db1b64196109a08cbd"
Jul 31 21:16:02.187392 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:02.187302    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"]
Jul 31 21:16:02.189013 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:02.188991    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9a0b6d-74c4958c4-j99sd"]
Jul 31 21:16:03.936199 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:03.936136    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a96940a-8e3d-407e-9896-5d3b080dc162" path="/var/lib/kubelet/pods/0a96940a-8e3d-407e-9896-5d3b080dc162/volumes"
Jul 31 21:16:07.528328 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:07.528290    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"]
Jul 31 21:16:07.528784 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:07.528587    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw" podUID="0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" containerName="istio-proxy" containerID="cri-o://ec748516a068ab8c520cae64e45266ce710958729263d63e15101d799027379b" gracePeriod=30
Jul 31 21:16:12.784690 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.784656    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:16:12.862430 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.862323    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"]
Jul 31 21:16:12.862771 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.862753    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cdb300a-1f95-464f-bcf4-56139590fb41" containerName="revoke-keys"
Jul 31 21:16:12.862857 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.862774    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cdb300a-1f95-464f-bcf4-56139590fb41" containerName="revoke-keys"
Jul 31 21:16:12.862857 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.862794    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" containerName="istio-proxy"
Jul 31 21:16:12.862857 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.862803    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" containerName="istio-proxy"
Jul 31 21:16:12.862857 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.862811    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a96940a-8e3d-407e-9896-5d3b080dc162" containerName="payload-processing"
Jul 31 21:16:12.862857 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.862820    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a96940a-8e3d-407e-9896-5d3b080dc162" containerName="payload-processing"
Jul 31 21:16:12.862857 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.862851    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" containerName="istio-proxy"
Jul 31 21:16:12.863176 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.862860    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" containerName="istio-proxy"
Jul 31 21:16:12.863176 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.862938    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cdb300a-1f95-464f-bcf4-56139590fb41" containerName="revoke-keys"
Jul 31 21:16:12.863176 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.862950    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a96940a-8e3d-407e-9896-5d3b080dc162" containerName="payload-processing"
Jul 31 21:16:12.863176 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.862961    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" containerName="istio-proxy"
Jul 31 21:16:12.863176 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.862973    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" containerName="istio-proxy"
Jul 31 21:16:12.867748 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.867721    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"
Jul 31 21:16:12.868499 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.868475    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"]
Jul 31 21:16:12.870277 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.870251    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-8de79c\""
Jul 31 21:16:12.884358 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.884330    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvbsv\" (UniqueName: \"kubernetes.io/projected/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-kube-api-access-fvbsv\") pod \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") "
Jul 31 21:16:12.884522 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.884382    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-token\") pod \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") "
Jul 31 21:16:12.884522 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.884402    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-workload-certs\") pod \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") "
Jul 31 21:16:12.884522 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.884425    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-workload-socket\") pod \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") "
Jul 31 21:16:12.884522 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.884467    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-podinfo\") pod \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") "
Jul 31 21:16:12.884522 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.884510    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istiod-ca-cert\") pod \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") "
Jul 31 21:16:12.884798 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.884545    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-envoy\") pod \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") "
Jul 31 21:16:12.884798 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.884585    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-data\") pod \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") "
Jul 31 21:16:12.884798 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.884618    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-credential-socket\") pod \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\" (UID: \"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3\") "
Jul 31 21:16:12.884798 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.884723    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" (UID: "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:16:12.884798 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.884762    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" (UID: "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:16:12.885060 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.884914    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-workload-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:16:12.885060 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.884933    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-workload-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:16:12.885060 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.884920    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" (UID: "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:16:12.885261 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.885102    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" (UID: "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:16:12.885322 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.885245    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-data" (OuterVolumeSpecName: "istio-data") pod "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" (UID: "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:16:12.887621 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.887598    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-token" (OuterVolumeSpecName: "istio-token") pod "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" (UID: "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:16:12.887765 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.887623    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" (UID: "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:16:12.887765 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.887641    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" (UID: "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 21:16:12.887946 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.887891    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-kube-api-access-fvbsv" (OuterVolumeSpecName: "kube-api-access-fvbsv") pod "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" (UID: "0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3"). InnerVolumeSpecName "kube-api-access-fvbsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:16:12.896900 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.896878    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"]
Jul 31 21:16:12.900697 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.900680    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"
Jul 31 21:16:12.903007 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.902989    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-8de79c-dockercfg-j44q7\""
Jul 31 21:16:12.909802 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.909770    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"]
Jul 31 21:16:12.985549 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.985512    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce123754-fc78-47d6-ae81-ba787e9ef2fc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84\" (UID: \"ce123754-fc78-47d6-ae81-ba787e9ef2fc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"
Jul 31 21:16:12.985549 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.985552    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tk5c\" (UniqueName: \"kubernetes.io/projected/ce123754-fc78-47d6-ae81-ba787e9ef2fc-kube-api-access-9tk5c\") pod \"payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84\" (UID: \"ce123754-fc78-47d6-ae81-ba787e9ef2fc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"
Jul 31 21:16:12.985816 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.985616    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp8l7\" (UniqueName: \"kubernetes.io/projected/427b47d3-43b8-4bc0-8298-17888c5a0e6d-kube-api-access-dp8l7\") pod \"payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk\" (UID: \"427b47d3-43b8-4bc0-8298-17888c5a0e6d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"
Jul 31 21:16:12.985816 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.985743    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/427b47d3-43b8-4bc0-8298-17888c5a0e6d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk\" (UID: \"427b47d3-43b8-4bc0-8298-17888c5a0e6d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"
Jul 31 21:16:12.985816 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.985790    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvbsv\" (UniqueName: \"kubernetes.io/projected/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-kube-api-access-fvbsv\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:16:12.985816 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.985807    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-token\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:16:12.985974 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.985821    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-podinfo\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:16:12.985974 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.985833    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istiod-ca-cert\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:16:12.985974 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.985846    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-envoy\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:16:12.985974 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.985858    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-istio-data\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:16:12.985974 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:12.985870    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3-credential-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:16:13.086793 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.086754    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/427b47d3-43b8-4bc0-8298-17888c5a0e6d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk\" (UID: \"427b47d3-43b8-4bc0-8298-17888c5a0e6d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"
Jul 31 21:16:13.086999 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.086809    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce123754-fc78-47d6-ae81-ba787e9ef2fc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84\" (UID: \"ce123754-fc78-47d6-ae81-ba787e9ef2fc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"
Jul 31 21:16:13.086999 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.086838    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tk5c\" (UniqueName: \"kubernetes.io/projected/ce123754-fc78-47d6-ae81-ba787e9ef2fc-kube-api-access-9tk5c\") pod \"payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84\" (UID: \"ce123754-fc78-47d6-ae81-ba787e9ef2fc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"
Jul 31 21:16:13.087128 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.087023    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp8l7\" (UniqueName: \"kubernetes.io/projected/427b47d3-43b8-4bc0-8298-17888c5a0e6d-kube-api-access-dp8l7\") pod \"payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk\" (UID: \"427b47d3-43b8-4bc0-8298-17888c5a0e6d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"
Jul 31 21:16:13.087607 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.087588    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/427b47d3-43b8-4bc0-8298-17888c5a0e6d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk\" (UID: \"427b47d3-43b8-4bc0-8298-17888c5a0e6d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"
Jul 31 21:16:13.087658 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.087615    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce123754-fc78-47d6-ae81-ba787e9ef2fc-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84\" (UID: \"ce123754-fc78-47d6-ae81-ba787e9ef2fc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"
Jul 31 21:16:13.096111 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.096084    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tk5c\" (UniqueName: \"kubernetes.io/projected/ce123754-fc78-47d6-ae81-ba787e9ef2fc-kube-api-access-9tk5c\") pod \"payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84\" (UID: \"ce123754-fc78-47d6-ae81-ba787e9ef2fc\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"
Jul 31 21:16:13.096233 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.096131    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp8l7\" (UniqueName: \"kubernetes.io/projected/427b47d3-43b8-4bc0-8298-17888c5a0e6d-kube-api-access-dp8l7\") pod \"payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk\" (UID: \"427b47d3-43b8-4bc0-8298-17888c5a0e6d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"
Jul 31 21:16:13.179399 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.179304    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"
Jul 31 21:16:13.211679 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.211638    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"
Jul 31 21:16:13.241822 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.241654    2566 generic.go:356] "Generic (PLEG): container finished" podID="0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" containerID="ec748516a068ab8c520cae64e45266ce710958729263d63e15101d799027379b" exitCode=0
Jul 31 21:16:13.242843 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.241728    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw" event={"ID":"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3","Type":"ContainerDied","Data":"ec748516a068ab8c520cae64e45266ce710958729263d63e15101d799027379b"}
Jul 31 21:16:13.242843 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.242139    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw" event={"ID":"0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3","Type":"ContainerDied","Data":"d91137efba457455b49ce89e0c268ff1c2ed5fd01414fe7107c233e76dc8e2cf"}
Jul 31 21:16:13.242843 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.242221    2566 scope.go:117] "RemoveContainer" containerID="ec748516a068ab8c520cae64e45266ce710958729263d63e15101d799027379b"
Jul 31 21:16:13.242843 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.241788    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"
Jul 31 21:16:13.258048 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.258030    2566 scope.go:117] "RemoveContainer" containerID="4cb8d366038211170ff3d4dcc123aafc062fe87c115e09dbd2445c1fe1c24c99"
Jul 31 21:16:13.272167 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.272124    2566 scope.go:117] "RemoveContainer" containerID="ec748516a068ab8c520cae64e45266ce710958729263d63e15101d799027379b"
Jul 31 21:16:13.272512 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:16:13.272481    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec748516a068ab8c520cae64e45266ce710958729263d63e15101d799027379b\": container with ID starting with ec748516a068ab8c520cae64e45266ce710958729263d63e15101d799027379b not found: ID does not exist" containerID="ec748516a068ab8c520cae64e45266ce710958729263d63e15101d799027379b"
Jul 31 21:16:13.272614 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.272527    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec748516a068ab8c520cae64e45266ce710958729263d63e15101d799027379b"} err="failed to get container status \"ec748516a068ab8c520cae64e45266ce710958729263d63e15101d799027379b\": rpc error: code = NotFound desc = could not find container \"ec748516a068ab8c520cae64e45266ce710958729263d63e15101d799027379b\": container with ID starting with ec748516a068ab8c520cae64e45266ce710958729263d63e15101d799027379b not found: ID does not exist"
Jul 31 21:16:13.272614 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.272556    2566 scope.go:117] "RemoveContainer" containerID="4cb8d366038211170ff3d4dcc123aafc062fe87c115e09dbd2445c1fe1c24c99"
Jul 31 21:16:13.272830 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:16:13.272809    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cb8d366038211170ff3d4dcc123aafc062fe87c115e09dbd2445c1fe1c24c99\": container with ID starting with 4cb8d366038211170ff3d4dcc123aafc062fe87c115e09dbd2445c1fe1c24c99 not found: ID does not exist" containerID="4cb8d366038211170ff3d4dcc123aafc062fe87c115e09dbd2445c1fe1c24c99"
Jul 31 21:16:13.272878 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.272839    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cb8d366038211170ff3d4dcc123aafc062fe87c115e09dbd2445c1fe1c24c99"} err="failed to get container status \"4cb8d366038211170ff3d4dcc123aafc062fe87c115e09dbd2445c1fe1c24c99\": rpc error: code = NotFound desc = could not find container \"4cb8d366038211170ff3d4dcc123aafc062fe87c115e09dbd2445c1fe1c24c99\": container with ID starting with 4cb8d366038211170ff3d4dcc123aafc062fe87c115e09dbd2445c1fe1c24c99 not found: ID does not exist"
Jul 31 21:16:13.281165 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.281115    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"]
Jul 31 21:16:13.285022 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.284205    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-9a0b6d-openshift-default-8666969fdb-zr9lw"]
Jul 31 21:16:13.334227 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.334198    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"]
Jul 31 21:16:13.335816 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:16:13.335771    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce123754_fc78_47d6_ae81_ba787e9ef2fc.slice/crio-a964e00008e5ff2fbc60f590793ac6ae0fc53dbefdbe817c2fc6342def46542a WatchSource:0}: Error finding container a964e00008e5ff2fbc60f590793ac6ae0fc53dbefdbe817c2fc6342def46542a: Status 404 returned error can't find the container with id a964e00008e5ff2fbc60f590793ac6ae0fc53dbefdbe817c2fc6342def46542a
Jul 31 21:16:13.380379 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.380351    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"]
Jul 31 21:16:13.383562 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:16:13.383536    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427b47d3_43b8_4bc0_8298_17888c5a0e6d.slice/crio-03ca39565ae1068e2185a3c1dfd487fe84f0041cc2963f8af0ecde9bc8998019 WatchSource:0}: Error finding container 03ca39565ae1068e2185a3c1dfd487fe84f0041cc2963f8af0ecde9bc8998019: Status 404 returned error can't find the container with id 03ca39565ae1068e2185a3c1dfd487fe84f0041cc2963f8af0ecde9bc8998019
Jul 31 21:16:13.937711 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:13.937669    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3" path="/var/lib/kubelet/pods/0ed69210-abe7-4d1b-adbf-8c49cf7e3bc3/volumes"
Jul 31 21:16:14.252915 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:14.252800    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84" event={"ID":"ce123754-fc78-47d6-ae81-ba787e9ef2fc","Type":"ContainerStarted","Data":"5671c73c67595f310942432cbc47ed330d607cba03fc7a53d9bcf699ca1d6475"}
Jul 31 21:16:14.252915 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:14.252865    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84" event={"ID":"ce123754-fc78-47d6-ae81-ba787e9ef2fc","Type":"ContainerStarted","Data":"a964e00008e5ff2fbc60f590793ac6ae0fc53dbefdbe817c2fc6342def46542a"}
Jul 31 21:16:14.253167 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:14.252920    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"
Jul 31 21:16:14.255248 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:14.255226    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk" event={"ID":"427b47d3-43b8-4bc0-8298-17888c5a0e6d","Type":"ContainerStarted","Data":"5533c388c8f9977d7a8828355b28b2814b4154dedc26b82bb9c43a190f8ae753"}
Jul 31 21:16:14.255359 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:14.255267    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk" event={"ID":"427b47d3-43b8-4bc0-8298-17888c5a0e6d","Type":"ContainerStarted","Data":"03ca39565ae1068e2185a3c1dfd487fe84f0041cc2963f8af0ecde9bc8998019"}
Jul 31 21:16:14.255421 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:14.255366    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"
Jul 31 21:16:14.270243 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:14.270197    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84" podStartSLOduration=2.270182456 podStartE2EDuration="2.270182456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:16:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:16:14.269124434 +0000 UTC m=+2778.874516912" watchObservedRunningTime="2026-07-31 21:16:14.270182456 +0000 UTC m=+2778.875574965"
Jul 31 21:16:14.287222 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:14.287171    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk" podStartSLOduration=2.287128368 podStartE2EDuration="2.287128368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:16:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:16:14.286835057 +0000 UTC m=+2778.892227533" watchObservedRunningTime="2026-07-31 21:16:14.287128368 +0000 UTC m=+2778.892520845"
Jul 31 21:16:25.262944 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:25.262852    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"
Jul 31 21:16:25.263461 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:25.262945    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"
Jul 31 21:16:36.755750 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.755705    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"]
Jul 31 21:16:36.759344 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.759322    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.761853 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.761829    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-6938c5-openshift-default-dockercfg-z4tzx\""
Jul 31 21:16:36.771129 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.771101    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"]
Jul 31 21:16:36.801275 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.801239    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-workload-certs\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.801275 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.801280    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-workload-socket\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.801559 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.801309    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-envoy\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.801559 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.801328    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-credential-socket\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.801559 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.801355    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-data\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.801559 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.801378    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-token\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.801559 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.801423    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istiod-ca-cert\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.801559 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.801443    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-724tx\" (UniqueName: \"kubernetes.io/projected/1d5e532b-4c49-42a7-9e07-72435dd81bb6-kube-api-access-724tx\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.801559 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.801485    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-podinfo\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.902243 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.902203    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-workload-socket\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.902462 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.902250    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-envoy\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.902462 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.902385    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-credential-socket\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.902462 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.902455    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-data\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.902638 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.902491    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-token\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.902638 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.902554    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istiod-ca-cert\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.902638 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.902594    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-724tx\" (UniqueName: \"kubernetes.io/projected/1d5e532b-4c49-42a7-9e07-72435dd81bb6-kube-api-access-724tx\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.902810 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.902653    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-podinfo\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.902810 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.902725    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-workload-certs\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.902810 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.902730    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-workload-socket\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.903015 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.902992    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-credential-socket\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.903137 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.903067    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-data\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.903441 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.903419    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-workload-certs\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.903730 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.903697    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istiod-ca-cert\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.904880 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.904858    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-envoy\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.905521 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.905498    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-podinfo\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.911049 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.911018    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-token\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:36.911160 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:36.911079    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-724tx\" (UniqueName: \"kubernetes.io/projected/1d5e532b-4c49-42a7-9e07-72435dd81bb6-kube-api-access-724tx\") pod \"e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") " pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:37.071796 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:37.071758    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:37.243849 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:37.243814    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"]
Jul 31 21:16:37.247519 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:16:37.247486    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5e532b_4c49_42a7_9e07_72435dd81bb6.slice/crio-aa231da63f97caf5c373b175b3a938aa9a5a764037e3197d918c11f321c77433 WatchSource:0}: Error finding container aa231da63f97caf5c373b175b3a938aa9a5a764037e3197d918c11f321c77433: Status 404 returned error can't find the container with id aa231da63f97caf5c373b175b3a938aa9a5a764037e3197d918c11f321c77433
Jul 31 21:16:37.249850 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:37.249811    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:16:37.249951 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:37.249935    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:16:37.249996 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:37.249981    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:16:37.384135 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:37.384026    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r" event={"ID":"1d5e532b-4c49-42a7-9e07-72435dd81bb6","Type":"ContainerStarted","Data":"ba9dedc33bdc5e8504c2bca104f4419a7da53afa93f47a5253b2e9eb102ca310"}
Jul 31 21:16:37.384135 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:37.384094    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r" event={"ID":"1d5e532b-4c49-42a7-9e07-72435dd81bb6","Type":"ContainerStarted","Data":"aa231da63f97caf5c373b175b3a938aa9a5a764037e3197d918c11f321c77433"}
Jul 31 21:16:37.403302 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:37.403250    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r" podStartSLOduration=1.403233918 podStartE2EDuration="1.403233918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:16:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:16:37.401073647 +0000 UTC m=+2802.006466123" watchObservedRunningTime="2026-07-31 21:16:37.403233918 +0000 UTC m=+2802.008626395"
Jul 31 21:16:38.072623 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:38.072583    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:38.077979 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:38.077949    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:38.389756 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:38.389667    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:38.390612 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:38.390585    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:41.045349 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.045314    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"]
Jul 31 21:16:41.048973 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.048949    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"
Jul 31 21:16:41.051619 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.051588    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-6938c5\""
Jul 31 21:16:41.051773 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.051664    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-6938c5-dockercfg-r9rnl\""
Jul 31 21:16:41.058173 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.058129    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"]
Jul 31 21:16:41.070455 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.070414    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"]
Jul 31 21:16:41.073825 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.073799    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"
Jul 31 21:16:41.089972 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.089940    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"]
Jul 31 21:16:41.143005 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.142949    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpmls\" (UniqueName: \"kubernetes.io/projected/6efcbbfe-c75d-41be-900e-acdc27a1e048-kube-api-access-hpmls\") pod \"payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs\" (UID: \"6efcbbfe-c75d-41be-900e-acdc27a1e048\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"
Jul 31 21:16:41.143318 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.143020    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22njv\" (UniqueName: \"kubernetes.io/projected/2dea4458-0475-4a69-b7f2-fc4f016758fe-kube-api-access-22njv\") pod \"payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt\" (UID: \"2dea4458-0475-4a69-b7f2-fc4f016758fe\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"
Jul 31 21:16:41.143318 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.143131    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6efcbbfe-c75d-41be-900e-acdc27a1e048-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs\" (UID: \"6efcbbfe-c75d-41be-900e-acdc27a1e048\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"
Jul 31 21:16:41.143318 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.143178    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dea4458-0475-4a69-b7f2-fc4f016758fe-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt\" (UID: \"2dea4458-0475-4a69-b7f2-fc4f016758fe\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"
Jul 31 21:16:41.244258 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.244215    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpmls\" (UniqueName: \"kubernetes.io/projected/6efcbbfe-c75d-41be-900e-acdc27a1e048-kube-api-access-hpmls\") pod \"payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs\" (UID: \"6efcbbfe-c75d-41be-900e-acdc27a1e048\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"
Jul 31 21:16:41.244466 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.244268    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22njv\" (UniqueName: \"kubernetes.io/projected/2dea4458-0475-4a69-b7f2-fc4f016758fe-kube-api-access-22njv\") pod \"payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt\" (UID: \"2dea4458-0475-4a69-b7f2-fc4f016758fe\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"
Jul 31 21:16:41.244466 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.244305    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6efcbbfe-c75d-41be-900e-acdc27a1e048-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs\" (UID: \"6efcbbfe-c75d-41be-900e-acdc27a1e048\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"
Jul 31 21:16:41.244466 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.244325    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dea4458-0475-4a69-b7f2-fc4f016758fe-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt\" (UID: \"2dea4458-0475-4a69-b7f2-fc4f016758fe\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"
Jul 31 21:16:41.245058 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.245038    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dea4458-0475-4a69-b7f2-fc4f016758fe-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt\" (UID: \"2dea4458-0475-4a69-b7f2-fc4f016758fe\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"
Jul 31 21:16:41.245128 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.245079    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6efcbbfe-c75d-41be-900e-acdc27a1e048-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs\" (UID: \"6efcbbfe-c75d-41be-900e-acdc27a1e048\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"
Jul 31 21:16:41.253523 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.253492    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22njv\" (UniqueName: \"kubernetes.io/projected/2dea4458-0475-4a69-b7f2-fc4f016758fe-kube-api-access-22njv\") pod \"payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt\" (UID: \"2dea4458-0475-4a69-b7f2-fc4f016758fe\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"
Jul 31 21:16:41.253707 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.253561    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpmls\" (UniqueName: \"kubernetes.io/projected/6efcbbfe-c75d-41be-900e-acdc27a1e048-kube-api-access-hpmls\") pod \"payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs\" (UID: \"6efcbbfe-c75d-41be-900e-acdc27a1e048\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"
Jul 31 21:16:41.362038 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.361943    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"
Jul 31 21:16:41.386941 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.386905    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"
Jul 31 21:16:41.519442 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.519417    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"]
Jul 31 21:16:41.521803 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:16:41.521769    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6efcbbfe_c75d_41be_900e_acdc27a1e048.slice/crio-f948dc6d4bf27839bdf50d0900604f2691f1b66263ac13cc86432fded6cfb983 WatchSource:0}: Error finding container f948dc6d4bf27839bdf50d0900604f2691f1b66263ac13cc86432fded6cfb983: Status 404 returned error can't find the container with id f948dc6d4bf27839bdf50d0900604f2691f1b66263ac13cc86432fded6cfb983
Jul 31 21:16:41.556607 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:41.556578    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"]
Jul 31 21:16:41.560295 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:16:41.560269    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dea4458_0475_4a69_b7f2_fc4f016758fe.slice/crio-9bd2c9ddb3a65a83cbbf121014fd551d91d444c271f26508ab4dc3770818a8bd WatchSource:0}: Error finding container 9bd2c9ddb3a65a83cbbf121014fd551d91d444c271f26508ab4dc3770818a8bd: Status 404 returned error can't find the container with id 9bd2c9ddb3a65a83cbbf121014fd551d91d444c271f26508ab4dc3770818a8bd
Jul 31 21:16:42.415668 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:42.415633    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt" event={"ID":"2dea4458-0475-4a69-b7f2-fc4f016758fe","Type":"ContainerStarted","Data":"68d9fc9b69bae1d70a12959dd4ca4e3b9db8493ee9f8c03da7d8a7d84050ecc9"}
Jul 31 21:16:42.416109 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:42.415688    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt" event={"ID":"2dea4458-0475-4a69-b7f2-fc4f016758fe","Type":"ContainerStarted","Data":"9bd2c9ddb3a65a83cbbf121014fd551d91d444c271f26508ab4dc3770818a8bd"}
Jul 31 21:16:42.416109 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:42.415748    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"
Jul 31 21:16:42.417433 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:42.417407    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs" event={"ID":"6efcbbfe-c75d-41be-900e-acdc27a1e048","Type":"ContainerStarted","Data":"77cc2e128f04ab982289934d428e6b43b9bd606979ab11637df737a0a3ee8a18"}
Jul 31 21:16:42.417560 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:42.417461    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"
Jul 31 21:16:42.417560 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:42.417486    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs" event={"ID":"6efcbbfe-c75d-41be-900e-acdc27a1e048","Type":"ContainerStarted","Data":"f948dc6d4bf27839bdf50d0900604f2691f1b66263ac13cc86432fded6cfb983"}
Jul 31 21:16:42.431564 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:42.431504    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt" podStartSLOduration=1.431484967 podStartE2EDuration="1.431484967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:16:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:16:42.430455377 +0000 UTC m=+2807.035847881" watchObservedRunningTime="2026-07-31 21:16:42.431484967 +0000 UTC m=+2807.036877442"
Jul 31 21:16:42.448263 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:42.448204    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs" podStartSLOduration=1.4481874129999999 podStartE2EDuration="1.448187413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:16:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:16:42.446185908 +0000 UTC m=+2807.051578386" watchObservedRunningTime="2026-07-31 21:16:42.448187413 +0000 UTC m=+2807.053579888"
Jul 31 21:16:53.425490 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:53.425445    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"
Jul 31 21:16:53.425914 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:53.425647    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"
Jul 31 21:16:53.627332 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:53.627135    2566 patch_prober.go:28] interesting pod/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": read tcp 10.133.0.2:48456->10.133.0.81:15021: read: connection reset by peer" start-of-body=
Jul 31 21:16:53.627506 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:53.627369    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r" podUID="1d5e532b-4c49-42a7-9e07-72435dd81bb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": read tcp 10.133.0.2:48456->10.133.0.81:15021: read: connection reset by peer"
Jul 31 21:16:53.640906 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:16:53.640734    2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@8-30497-0.service\": RecentStats: unable to find data in memory cache]"
Jul 31 21:16:54.496437 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:54.496399    2566 generic.go:356] "Generic (PLEG): container finished" podID="1d5e532b-4c49-42a7-9e07-72435dd81bb6" containerID="ba9dedc33bdc5e8504c2bca104f4419a7da53afa93f47a5253b2e9eb102ca310" exitCode=0
Jul 31 21:16:54.496850 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:54.496450    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r" event={"ID":"1d5e532b-4c49-42a7-9e07-72435dd81bb6","Type":"ContainerDied","Data":"ba9dedc33bdc5e8504c2bca104f4419a7da53afa93f47a5253b2e9eb102ca310"}
Jul 31 21:16:54.496850 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:54.496848    2566 scope.go:117] "RemoveContainer" containerID="ba9dedc33bdc5e8504c2bca104f4419a7da53afa93f47a5253b2e9eb102ca310"
Jul 31 21:16:54.497907 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:54.497878    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:16:54.497982 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:54.497968    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:16:54.498025 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:54.498009    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:16:55.503447 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:55.503406    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r" event={"ID":"1d5e532b-4c49-42a7-9e07-72435dd81bb6","Type":"ContainerStarted","Data":"b9daa8f66e22ef66111757f7c8c0b97b47e9839c7834df261e46731349dffcee"}
Jul 31 21:16:56.072572 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:56.072535    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:16:56.072813 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:56.072786    2566 patch_prober.go:28] interesting pod/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Jul 31 21:16:56.072897 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:56.072847    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r" podUID="1d5e532b-4c49-42a7-9e07-72435dd81bb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Jul 31 21:16:57.073226 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:57.073188    2566 patch_prober.go:28] interesting pod/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Jul 31 21:16:57.073707 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:57.073245    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r" podUID="1d5e532b-4c49-42a7-9e07-72435dd81bb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Jul 31 21:16:58.072480 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:58.072444    2566 patch_prober.go:28] interesting pod/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Jul 31 21:16:58.072667 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:58.072503    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r" podUID="1d5e532b-4c49-42a7-9e07-72435dd81bb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Jul 31 21:16:59.073256 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:59.073218    2566 patch_prober.go:28] interesting pod/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Jul 31 21:16:59.073670 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:16:59.073278    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r" podUID="1d5e532b-4c49-42a7-9e07-72435dd81bb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Jul 31 21:17:00.072427 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:00.072385    2566 patch_prober.go:28] interesting pod/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Jul 31 21:17:00.072618 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:00.072452    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r" podUID="1d5e532b-4c49-42a7-9e07-72435dd81bb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Jul 31 21:17:01.076633 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:01.076601    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:17:01.077072 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:01.077000    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:17:01.077672 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:01.077652    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:17:10.886525 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:10.886488    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"]
Jul 31 21:17:10.890184 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:10.890137    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:10.893644 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:10.893616    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8de79c\"/\"openshift-service-ca.crt\""
Jul 31 21:17:10.893781 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:10.893646    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8de79c\"/\"kube-root-ca.crt\""
Jul 31 21:17:10.893781 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:10.893621    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8de79c\"/\"auth-test-model-8de79c-kserve-self-signed-certs\""
Jul 31 21:17:10.893781 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:10.893622    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8de79c\"/\"default-dockercfg-79vh2\""
Jul 31 21:17:10.899915 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:10.899890    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"]
Jul 31 21:17:11.030703 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.030660    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58btd\" (UniqueName: \"kubernetes.io/projected/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-kube-api-access-58btd\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.030901 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.030717    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-home\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.030901 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.030796    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-tmp-dir\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.030901 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.030837    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-tls-certs\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.031034 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.030924    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-dshm\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.031034 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.030966    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-model-cache\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.132133 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.132088    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-tmp-dir\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.132133 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.132134    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-tls-certs\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.132423 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.132197    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-dshm\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.132423 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.132226    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-model-cache\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.132423 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.132280    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58btd\" (UniqueName: \"kubernetes.io/projected/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-kube-api-access-58btd\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.132423 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.132315    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-home\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.132651 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.132630    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-tmp-dir\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.132935 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.132885    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-model-cache\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.132935 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.132912    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-home\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.134697 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.134675    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-dshm\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.135220 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.135199    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-tls-certs\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.141346 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.141286    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58btd\" (UniqueName: \"kubernetes.io/projected/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-kube-api-access-58btd\") pod \"auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") " pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.202374 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.202336    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:11.348746 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.348720    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"]
Jul 31 21:17:11.350811 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:17:11.350778    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda982221c_21fa_4ac3_9bde_42afa0cfaa8b.slice/crio-18fde101ec7e18302b92e1b8aeba2456f9f584f766c338a6d4f4a633e6b51919 WatchSource:0}: Error finding container 18fde101ec7e18302b92e1b8aeba2456f9f584f766c338a6d4f4a633e6b51919: Status 404 returned error can't find the container with id 18fde101ec7e18302b92e1b8aeba2456f9f584f766c338a6d4f4a633e6b51919
Jul 31 21:17:11.589118 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.589079    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6" event={"ID":"a982221c-21fa-4ac3-9bde-42afa0cfaa8b","Type":"ContainerStarted","Data":"0b952b06228d9f4d51df01374ce6539b1e465c56306b6255f6d4c031caaa0038"}
Jul 31 21:17:11.589118 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.589121    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6" event={"ID":"a982221c-21fa-4ac3-9bde-42afa0cfaa8b","Type":"ContainerStarted","Data":"18fde101ec7e18302b92e1b8aeba2456f9f584f766c338a6d4f4a633e6b51919"}
Jul 31 21:17:11.605750 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:11.605695    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6" podStartSLOduration=1.605676332 podStartE2EDuration="1.605676332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:17:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:17:11.604196868 +0000 UTC m=+2836.209589347" watchObservedRunningTime="2026-07-31 21:17:11.605676332 +0000 UTC m=+2836.211068808"
Jul 31 21:17:21.203135 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:21.203084    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:21.203573 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:21.203168    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:21.216255 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:21.216227    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:17:21.652116 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:17:21.652088    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:20:52.422340 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:52.422250    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"]
Jul 31 21:20:56.352663 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:56.352633    2566 scope.go:117] "RemoveContainer" containerID="2033b10794d60f44a899e4d99a079cacb5b4d5eea41e4111537e3610914dc013"
Jul 31 21:20:59.597539 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.597503    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"]
Jul 31 21:20:59.602610 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.602585    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.605013 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.604986    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8de79c\"/\"sub-test-model-8de79c-kserve-self-signed-certs\""
Jul 31 21:20:59.613925 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.613896    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"]
Jul 31 21:20:59.687797 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.687750    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-model-cache\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.687797 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.687794    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vt8t\" (UniqueName: \"kubernetes.io/projected/b6dcc6d6-a02b-4402-9311-7d08b89c5725-kube-api-access-7vt8t\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.688072 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.687819    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-home\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.688072 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.687844    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6dcc6d6-a02b-4402-9311-7d08b89c5725-tls-certs\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.688072 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.687994    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-tmp-dir\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.688253 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.688234    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-dshm\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.789520 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.789475    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-model-cache\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.789520 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.789521    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vt8t\" (UniqueName: \"kubernetes.io/projected/b6dcc6d6-a02b-4402-9311-7d08b89c5725-kube-api-access-7vt8t\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.789789 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.789548    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-home\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.789789 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.789589    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6dcc6d6-a02b-4402-9311-7d08b89c5725-tls-certs\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.789789 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.789633    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-tmp-dir\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.789789 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.789688    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-dshm\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.790005 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.789983    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-model-cache\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.790068 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.790003    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-home\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.790068 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.790025    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-tmp-dir\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.792135 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.792110    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-dshm\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.792400 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.792383    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6dcc6d6-a02b-4402-9311-7d08b89c5725-tls-certs\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.798135 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.798111    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vt8t\" (UniqueName: \"kubernetes.io/projected/b6dcc6d6-a02b-4402-9311-7d08b89c5725-kube-api-access-7vt8t\") pod \"sub-test-model-8de79c-kserve-6bd7b5986c-l49xr\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") " pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:20:59.918469 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:20:59.918377    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:21:00.062651 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:00.062621    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"]
Jul 31 21:21:00.064876 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:21:00.064846    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6dcc6d6_a02b_4402_9311_7d08b89c5725.slice/crio-4e4e3dc96dabe1bdb36f686e236f55c034a26e6e1b8ae52119283140a39d5a3c WatchSource:0}: Error finding container 4e4e3dc96dabe1bdb36f686e236f55c034a26e6e1b8ae52119283140a39d5a3c: Status 404 returned error can't find the container with id 4e4e3dc96dabe1bdb36f686e236f55c034a26e6e1b8ae52119283140a39d5a3c
Jul 31 21:21:00.816768 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:00.816727    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr" event={"ID":"b6dcc6d6-a02b-4402-9311-7d08b89c5725","Type":"ContainerStarted","Data":"f70f1289676cef43a6102f23b8d0025bc766cf67e5f6fad114cb23633a5bea7e"}
Jul 31 21:21:00.817199 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:00.816778    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr" event={"ID":"b6dcc6d6-a02b-4402-9311-7d08b89c5725","Type":"ContainerStarted","Data":"4e4e3dc96dabe1bdb36f686e236f55c034a26e6e1b8ae52119283140a39d5a3c"}
Jul 31 21:21:00.833683 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:00.833616    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr" podStartSLOduration=1.8335890030000002 podStartE2EDuration="1.833589003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:20:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:21:00.832492021 +0000 UTC m=+3065.437884499" watchObservedRunningTime="2026-07-31 21:21:00.833589003 +0000 UTC m=+3065.438981481"
Jul 31 21:21:07.446269 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.446217    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6" podUID="a982221c-21fa-4ac3-9bde-42afa0cfaa8b" containerName="main" containerID="cri-o://0b952b06228d9f4d51df01374ce6539b1e465c56306b6255f6d4c031caaa0038" gracePeriod=45
Jul 31 21:21:07.712226 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.711422    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:21:07.766076 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.766044    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-tmp-dir\") pod \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") "
Jul 31 21:21:07.766273 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.766086    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-home\") pod \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") "
Jul 31 21:21:07.766273 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.766183    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58btd\" (UniqueName: \"kubernetes.io/projected/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-kube-api-access-58btd\") pod \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") "
Jul 31 21:21:07.766273 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.766206    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-model-cache\") pod \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") "
Jul 31 21:21:07.766273 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.766234    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-tls-certs\") pod \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") "
Jul 31 21:21:07.766273 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.766250    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-dshm\") pod \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\" (UID: \"a982221c-21fa-4ac3-9bde-42afa0cfaa8b\") "
Jul 31 21:21:07.766639 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.766385    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a982221c-21fa-4ac3-9bde-42afa0cfaa8b" (UID: "a982221c-21fa-4ac3-9bde-42afa0cfaa8b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:21:07.766639 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.766401    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-home" (OuterVolumeSpecName: "home") pod "a982221c-21fa-4ac3-9bde-42afa0cfaa8b" (UID: "a982221c-21fa-4ac3-9bde-42afa0cfaa8b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:21:07.766639 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.766477    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-model-cache" (OuterVolumeSpecName: "model-cache") pod "a982221c-21fa-4ac3-9bde-42afa0cfaa8b" (UID: "a982221c-21fa-4ac3-9bde-42afa0cfaa8b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:21:07.766639 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.766548    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-model-cache\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:21:07.766639 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.766564    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-tmp-dir\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:21:07.766639 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.766573    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-home\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:21:07.768593 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.768567    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-dshm" (OuterVolumeSpecName: "dshm") pod "a982221c-21fa-4ac3-9bde-42afa0cfaa8b" (UID: "a982221c-21fa-4ac3-9bde-42afa0cfaa8b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:21:07.768668 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.768655    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a982221c-21fa-4ac3-9bde-42afa0cfaa8b" (UID: "a982221c-21fa-4ac3-9bde-42afa0cfaa8b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:21:07.768724 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.768657    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-kube-api-access-58btd" (OuterVolumeSpecName: "kube-api-access-58btd") pod "a982221c-21fa-4ac3-9bde-42afa0cfaa8b" (UID: "a982221c-21fa-4ac3-9bde-42afa0cfaa8b"). InnerVolumeSpecName "kube-api-access-58btd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:21:07.855985 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.855943    2566 generic.go:356] "Generic (PLEG): container finished" podID="a982221c-21fa-4ac3-9bde-42afa0cfaa8b" containerID="0b952b06228d9f4d51df01374ce6539b1e465c56306b6255f6d4c031caaa0038" exitCode=0
Jul 31 21:21:07.856176 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.856004    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"
Jul 31 21:21:07.856176 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.856039    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6" event={"ID":"a982221c-21fa-4ac3-9bde-42afa0cfaa8b","Type":"ContainerDied","Data":"0b952b06228d9f4d51df01374ce6539b1e465c56306b6255f6d4c031caaa0038"}
Jul 31 21:21:07.856176 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.856085    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6" event={"ID":"a982221c-21fa-4ac3-9bde-42afa0cfaa8b","Type":"ContainerDied","Data":"18fde101ec7e18302b92e1b8aeba2456f9f584f766c338a6d4f4a633e6b51919"}
Jul 31 21:21:07.856176 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.856105    2566 scope.go:117] "RemoveContainer" containerID="0b952b06228d9f4d51df01374ce6539b1e465c56306b6255f6d4c031caaa0038"
Jul 31 21:21:07.865621 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.865600    2566 scope.go:117] "RemoveContainer" containerID="0b952b06228d9f4d51df01374ce6539b1e465c56306b6255f6d4c031caaa0038"
Jul 31 21:21:07.865908 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:21:07.865887    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b952b06228d9f4d51df01374ce6539b1e465c56306b6255f6d4c031caaa0038\": container with ID starting with 0b952b06228d9f4d51df01374ce6539b1e465c56306b6255f6d4c031caaa0038 not found: ID does not exist" containerID="0b952b06228d9f4d51df01374ce6539b1e465c56306b6255f6d4c031caaa0038"
Jul 31 21:21:07.865973 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.865922    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b952b06228d9f4d51df01374ce6539b1e465c56306b6255f6d4c031caaa0038"} err="failed to get container status \"0b952b06228d9f4d51df01374ce6539b1e465c56306b6255f6d4c031caaa0038\": rpc error: code = NotFound desc = could not find container \"0b952b06228d9f4d51df01374ce6539b1e465c56306b6255f6d4c031caaa0038\": container with ID starting with 0b952b06228d9f4d51df01374ce6539b1e465c56306b6255f6d4c031caaa0038 not found: ID does not exist"
Jul 31 21:21:07.867259 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.867241    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58btd\" (UniqueName: \"kubernetes.io/projected/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-kube-api-access-58btd\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:21:07.867336 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.867262    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-tls-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:21:07.867336 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.867278    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a982221c-21fa-4ac3-9bde-42afa0cfaa8b-dshm\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:21:07.876282 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.876259    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"]
Jul 31 21:21:07.880032 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.880006    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8de79c/auth-test-model-8de79c-kserve-84bb6ccd4c-59cx6"]
Jul 31 21:21:07.937126 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:07.937083    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a982221c-21fa-4ac3-9bde-42afa0cfaa8b" path="/var/lib/kubelet/pods/a982221c-21fa-4ac3-9bde-42afa0cfaa8b/volumes"
Jul 31 21:21:09.919207 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:09.919135    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:21:09.919620 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:09.919225    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:21:09.935616 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:09.935587    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:21:10.884710 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:10.884663    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:21:17.173945 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.173903    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"]
Jul 31 21:21:17.174491 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.174471    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a982221c-21fa-4ac3-9bde-42afa0cfaa8b" containerName="main"
Jul 31 21:21:17.174581 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.174494    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a982221c-21fa-4ac3-9bde-42afa0cfaa8b" containerName="main"
Jul 31 21:21:17.174672 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.174658    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a982221c-21fa-4ac3-9bde-42afa0cfaa8b" containerName="main"
Jul 31 21:21:17.179307 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.179283    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.181995 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.181972    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6938c5\"/\"openshift-service-ca.crt\""
Jul 31 21:21:17.183064 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.183043    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6938c5\"/\"kube-root-ca.crt\""
Jul 31 21:21:17.183186 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.183071    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6938c5\"/\"default-dockercfg-pxlj4\""
Jul 31 21:21:17.183186 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.183093    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6938c5\"/\"sub-test-model-6938c5-kserve-self-signed-certs\""
Jul 31 21:21:17.187506 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.187484    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"]
Jul 31 21:21:17.255162 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.255115    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-model-cache\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.255364 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.255250    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88823295-6184-4847-a86d-5d55f8725a9c-tls-certs\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.255364 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.255300    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-dshm\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.255549 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.255359    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww62j\" (UniqueName: \"kubernetes.io/projected/88823295-6184-4847-a86d-5d55f8725a9c-kube-api-access-ww62j\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.255549 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.255408    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-tmp-dir\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.255549 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.255467    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-home\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.356255 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.356218    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-home\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.356430 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.356284    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-model-cache\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.356430 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.356341    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88823295-6184-4847-a86d-5d55f8725a9c-tls-certs\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.356430 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.356368    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-dshm\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.356430 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.356390    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww62j\" (UniqueName: \"kubernetes.io/projected/88823295-6184-4847-a86d-5d55f8725a9c-kube-api-access-ww62j\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.356430 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.356420    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-tmp-dir\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.356732 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.356693    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-home\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.356795 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.356736    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-tmp-dir\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.356795 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.356703    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-model-cache\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.359004 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.358977    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-dshm\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.359185 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.359090    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88823295-6184-4847-a86d-5d55f8725a9c-tls-certs\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.365302 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.365272    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww62j\" (UniqueName: \"kubernetes.io/projected/88823295-6184-4847-a86d-5d55f8725a9c-kube-api-access-ww62j\") pod \"sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") " pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.490130 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.490036    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:17.630250 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.630216    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"]
Jul 31 21:21:17.631742 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:21:17.631710    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88823295_6184_4847_a86d_5d55f8725a9c.slice/crio-fafc64748b9d077c0942c71868c6bd411fe94494ea95f1624c71a450296b61d4 WatchSource:0}: Error finding container fafc64748b9d077c0942c71868c6bd411fe94494ea95f1624c71a450296b61d4: Status 404 returned error can't find the container with id fafc64748b9d077c0942c71868c6bd411fe94494ea95f1624c71a450296b61d4
Jul 31 21:21:17.919208 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.919170    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv" event={"ID":"88823295-6184-4847-a86d-5d55f8725a9c","Type":"ContainerStarted","Data":"2b5f16962c7e00eb57f127cceaa68e615e21bbb0ebfb218e361d9be72179e61c"}
Jul 31 21:21:17.919429 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.919219    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv" event={"ID":"88823295-6184-4847-a86d-5d55f8725a9c","Type":"ContainerStarted","Data":"fafc64748b9d077c0942c71868c6bd411fe94494ea95f1624c71a450296b61d4"}
Jul 31 21:21:17.936314 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:17.936256    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv" podStartSLOduration=0.936239823 podStartE2EDuration="936.239823ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:21:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:21:17.935111047 +0000 UTC m=+3082.540503525" watchObservedRunningTime="2026-07-31 21:21:17.936239823 +0000 UTC m=+3082.541632299"
Jul 31 21:21:27.490629 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:27.490587    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:27.490629 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:27.490641    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:27.503577 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:27.503552    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:27.984078 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:27.984041    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:21:56.373779 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:56.373743    2566 scope.go:117] "RemoveContainer" containerID="db53029a66d45aeec24f732dfaed33117615e1d351c27e2441b133a7143bec8c"
Jul 31 21:21:56.385538 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:56.385514    2566 scope.go:117] "RemoveContainer" containerID="b83ec33d4e3d54d019681713349b2b1cf1b2533a5d4ecd38a8dfba4a5a1e5322"
Jul 31 21:21:56.393407 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:56.393383    2566 scope.go:117] "RemoveContainer" containerID="0c4e1f4690740b46d78345d602310ad0f56e89f580f9002977a8e35d5d6f2f59"
Jul 31 21:21:56.401187 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:21:56.401169    2566 scope.go:117] "RemoveContainer" containerID="5ad38b8398a1e727deb4b685a758d412a7b13c42b597b6ff443458eff258f4b9"
Jul 31 21:22:44.363912 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:44.363812    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"]
Jul 31 21:22:45.195261 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:45.195229    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"]
Jul 31 21:22:59.384399 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.384333    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr" podUID="b6dcc6d6-a02b-4402-9311-7d08b89c5725" containerName="main" containerID="cri-o://f70f1289676cef43a6102f23b8d0025bc766cf67e5f6fad114cb23633a5bea7e" gracePeriod=45
Jul 31 21:22:59.643576 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.643495    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:22:59.799460 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.799426    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-model-cache\") pod \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") "
Jul 31 21:22:59.799460 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.799471    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vt8t\" (UniqueName: \"kubernetes.io/projected/b6dcc6d6-a02b-4402-9311-7d08b89c5725-kube-api-access-7vt8t\") pod \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") "
Jul 31 21:22:59.799714 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.799528    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-tmp-dir\") pod \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") "
Jul 31 21:22:59.799714 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.799551    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6dcc6d6-a02b-4402-9311-7d08b89c5725-tls-certs\") pod \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") "
Jul 31 21:22:59.799714 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.799620    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-dshm\") pod \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") "
Jul 31 21:22:59.799714 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.799642    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-home\") pod \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\" (UID: \"b6dcc6d6-a02b-4402-9311-7d08b89c5725\") "
Jul 31 21:22:59.799933 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.799713    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-model-cache" (OuterVolumeSpecName: "model-cache") pod "b6dcc6d6-a02b-4402-9311-7d08b89c5725" (UID: "b6dcc6d6-a02b-4402-9311-7d08b89c5725"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:22:59.799933 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.799837    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b6dcc6d6-a02b-4402-9311-7d08b89c5725" (UID: "b6dcc6d6-a02b-4402-9311-7d08b89c5725"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:22:59.799933 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.799910    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-model-cache\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:22:59.799933 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.799910    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-home" (OuterVolumeSpecName: "home") pod "b6dcc6d6-a02b-4402-9311-7d08b89c5725" (UID: "b6dcc6d6-a02b-4402-9311-7d08b89c5725"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:22:59.801936 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.801904    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-dshm" (OuterVolumeSpecName: "dshm") pod "b6dcc6d6-a02b-4402-9311-7d08b89c5725" (UID: "b6dcc6d6-a02b-4402-9311-7d08b89c5725"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:22:59.802042 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.801947    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6dcc6d6-a02b-4402-9311-7d08b89c5725-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b6dcc6d6-a02b-4402-9311-7d08b89c5725" (UID: "b6dcc6d6-a02b-4402-9311-7d08b89c5725"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:22:59.802042 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.801964    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6dcc6d6-a02b-4402-9311-7d08b89c5725-kube-api-access-7vt8t" (OuterVolumeSpecName: "kube-api-access-7vt8t") pod "b6dcc6d6-a02b-4402-9311-7d08b89c5725" (UID: "b6dcc6d6-a02b-4402-9311-7d08b89c5725"). InnerVolumeSpecName "kube-api-access-7vt8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:22:59.901024 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.900922    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-dshm\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:22:59.901024 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.900957    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-home\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:22:59.901024 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.900969    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vt8t\" (UniqueName: \"kubernetes.io/projected/b6dcc6d6-a02b-4402-9311-7d08b89c5725-kube-api-access-7vt8t\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:22:59.901024 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.900980    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6dcc6d6-a02b-4402-9311-7d08b89c5725-tmp-dir\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:22:59.901024 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:22:59.900994    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6dcc6d6-a02b-4402-9311-7d08b89c5725-tls-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:23:00.215605 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.215501    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv" podUID="88823295-6184-4847-a86d-5d55f8725a9c" containerName="main" containerID="cri-o://2b5f16962c7e00eb57f127cceaa68e615e21bbb0ebfb218e361d9be72179e61c" gracePeriod=45
Jul 31 21:23:00.456926 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.456897    2566 generic.go:356] "Generic (PLEG): container finished" podID="b6dcc6d6-a02b-4402-9311-7d08b89c5725" containerID="f70f1289676cef43a6102f23b8d0025bc766cf67e5f6fad114cb23633a5bea7e" exitCode=0
Jul 31 21:23:00.457327 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.456973    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"
Jul 31 21:23:00.457327 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.456973    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr" event={"ID":"b6dcc6d6-a02b-4402-9311-7d08b89c5725","Type":"ContainerDied","Data":"f70f1289676cef43a6102f23b8d0025bc766cf67e5f6fad114cb23633a5bea7e"}
Jul 31 21:23:00.457327 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.457091    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr" event={"ID":"b6dcc6d6-a02b-4402-9311-7d08b89c5725","Type":"ContainerDied","Data":"4e4e3dc96dabe1bdb36f686e236f55c034a26e6e1b8ae52119283140a39d5a3c"}
Jul 31 21:23:00.457327 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.457116    2566 scope.go:117] "RemoveContainer" containerID="f70f1289676cef43a6102f23b8d0025bc766cf67e5f6fad114cb23633a5bea7e"
Jul 31 21:23:00.458485 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.458463    2566 generic.go:356] "Generic (PLEG): container finished" podID="88823295-6184-4847-a86d-5d55f8725a9c" containerID="2b5f16962c7e00eb57f127cceaa68e615e21bbb0ebfb218e361d9be72179e61c" exitCode=0
Jul 31 21:23:00.458586 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.458504    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv" event={"ID":"88823295-6184-4847-a86d-5d55f8725a9c","Type":"ContainerDied","Data":"2b5f16962c7e00eb57f127cceaa68e615e21bbb0ebfb218e361d9be72179e61c"}
Jul 31 21:23:00.479785 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.479762    2566 scope.go:117] "RemoveContainer" containerID="f70f1289676cef43a6102f23b8d0025bc766cf67e5f6fad114cb23633a5bea7e"
Jul 31 21:23:00.480090 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:23:00.480067    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f70f1289676cef43a6102f23b8d0025bc766cf67e5f6fad114cb23633a5bea7e\": container with ID starting with f70f1289676cef43a6102f23b8d0025bc766cf67e5f6fad114cb23633a5bea7e not found: ID does not exist" containerID="f70f1289676cef43a6102f23b8d0025bc766cf67e5f6fad114cb23633a5bea7e"
Jul 31 21:23:00.480191 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.480099    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f70f1289676cef43a6102f23b8d0025bc766cf67e5f6fad114cb23633a5bea7e"} err="failed to get container status \"f70f1289676cef43a6102f23b8d0025bc766cf67e5f6fad114cb23633a5bea7e\": rpc error: code = NotFound desc = could not find container \"f70f1289676cef43a6102f23b8d0025bc766cf67e5f6fad114cb23633a5bea7e\": container with ID starting with f70f1289676cef43a6102f23b8d0025bc766cf67e5f6fad114cb23633a5bea7e not found: ID does not exist"
Jul 31 21:23:00.484073 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.484047    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:23:00.490154 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.490115    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"]
Jul 31 21:23:00.495223 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.495195    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8de79c/sub-test-model-8de79c-kserve-6bd7b5986c-l49xr"]
Jul 31 21:23:00.606031 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.605998    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88823295-6184-4847-a86d-5d55f8725a9c-tls-certs\") pod \"88823295-6184-4847-a86d-5d55f8725a9c\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") "
Jul 31 21:23:00.606261 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.606063    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-home\") pod \"88823295-6184-4847-a86d-5d55f8725a9c\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") "
Jul 31 21:23:00.606261 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.606096    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-model-cache\") pod \"88823295-6184-4847-a86d-5d55f8725a9c\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") "
Jul 31 21:23:00.606261 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.606119    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-dshm\") pod \"88823295-6184-4847-a86d-5d55f8725a9c\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") "
Jul 31 21:23:00.606261 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.606199    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-tmp-dir\") pod \"88823295-6184-4847-a86d-5d55f8725a9c\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") "
Jul 31 21:23:00.606261 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.606232    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ww62j\" (UniqueName: \"kubernetes.io/projected/88823295-6184-4847-a86d-5d55f8725a9c-kube-api-access-ww62j\") pod \"88823295-6184-4847-a86d-5d55f8725a9c\" (UID: \"88823295-6184-4847-a86d-5d55f8725a9c\") "
Jul 31 21:23:00.606586 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.606393    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-model-cache" (OuterVolumeSpecName: "model-cache") pod "88823295-6184-4847-a86d-5d55f8725a9c" (UID: "88823295-6184-4847-a86d-5d55f8725a9c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:23:00.606586 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.606408    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-home" (OuterVolumeSpecName: "home") pod "88823295-6184-4847-a86d-5d55f8725a9c" (UID: "88823295-6184-4847-a86d-5d55f8725a9c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:23:00.606586 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.606494    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "88823295-6184-4847-a86d-5d55f8725a9c" (UID: "88823295-6184-4847-a86d-5d55f8725a9c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:23:00.608489 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.608467    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-dshm" (OuterVolumeSpecName: "dshm") pod "88823295-6184-4847-a86d-5d55f8725a9c" (UID: "88823295-6184-4847-a86d-5d55f8725a9c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:23:00.608590 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.608487    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88823295-6184-4847-a86d-5d55f8725a9c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "88823295-6184-4847-a86d-5d55f8725a9c" (UID: "88823295-6184-4847-a86d-5d55f8725a9c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:23:00.608590 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.608518    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88823295-6184-4847-a86d-5d55f8725a9c-kube-api-access-ww62j" (OuterVolumeSpecName: "kube-api-access-ww62j") pod "88823295-6184-4847-a86d-5d55f8725a9c" (UID: "88823295-6184-4847-a86d-5d55f8725a9c"). InnerVolumeSpecName "kube-api-access-ww62j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:23:00.707117 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.707079    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-tmp-dir\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:23:00.707117 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.707109    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ww62j\" (UniqueName: \"kubernetes.io/projected/88823295-6184-4847-a86d-5d55f8725a9c-kube-api-access-ww62j\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:23:00.707117 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.707120    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88823295-6184-4847-a86d-5d55f8725a9c-tls-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:23:00.707117 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.707128    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-home\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:23:00.707428 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.707137    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-model-cache\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:23:00.707428 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:00.707169    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88823295-6184-4847-a86d-5d55f8725a9c-dshm\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:23:01.465377 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:01.465340    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"
Jul 31 21:23:01.465377 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:01.465364    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv" event={"ID":"88823295-6184-4847-a86d-5d55f8725a9c","Type":"ContainerDied","Data":"fafc64748b9d077c0942c71868c6bd411fe94494ea95f1624c71a450296b61d4"}
Jul 31 21:23:01.465922 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:01.465431    2566 scope.go:117] "RemoveContainer" containerID="2b5f16962c7e00eb57f127cceaa68e615e21bbb0ebfb218e361d9be72179e61c"
Jul 31 21:23:01.486292 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:01.486261    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"]
Jul 31 21:23:01.489877 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:01.489852    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6938c5/sub-test-model-6938c5-kserve-7c4f7b7d59-bzlgv"]
Jul 31 21:23:01.936867 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:01.936835    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88823295-6184-4847-a86d-5d55f8725a9c" path="/var/lib/kubelet/pods/88823295-6184-4847-a86d-5d55f8725a9c/volumes"
Jul 31 21:23:01.937255 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:01.937237    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6dcc6d6-a02b-4402-9311-7d08b89c5725" path="/var/lib/kubelet/pods/b6dcc6d6-a02b-4402-9311-7d08b89c5725/volumes"
Jul 31 21:23:25.185107 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.185065    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"]
Jul 31 21:23:25.185735 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.185715    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6dcc6d6-a02b-4402-9311-7d08b89c5725" containerName="main"
Jul 31 21:23:25.185793 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.185739    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6dcc6d6-a02b-4402-9311-7d08b89c5725" containerName="main"
Jul 31 21:23:25.185793 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.185765    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88823295-6184-4847-a86d-5d55f8725a9c" containerName="main"
Jul 31 21:23:25.185793 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.185775    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="88823295-6184-4847-a86d-5d55f8725a9c" containerName="main"
Jul 31 21:23:25.185894 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.185881    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="88823295-6184-4847-a86d-5d55f8725a9c" containerName="main"
Jul 31 21:23:25.185929 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.185897    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6dcc6d6-a02b-4402-9311-7d08b89c5725" containerName="main"
Jul 31 21:23:25.188883 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.188868    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.191494 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.191468    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6938c5\"/\"kube-root-ca.crt\""
Jul 31 21:23:25.192527 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.192505    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6938c5\"/\"openshift-service-ca.crt\""
Jul 31 21:23:25.192722 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.192705    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6938c5\"/\"rate-test-model-6938c5-kserve-self-signed-certs\""
Jul 31 21:23:25.192804 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.192759    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6938c5\"/\"default-dockercfg-pxlj4\""
Jul 31 21:23:25.199462 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.199435    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"]
Jul 31 21:23:25.214325 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.214293    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-home\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.214525 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.214341    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-model-cache\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.214525 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.214365    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-tls-certs\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.214525 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.214394    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-dshm\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.214525 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.214434    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7z48\" (UniqueName: \"kubernetes.io/projected/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-kube-api-access-f7z48\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.214525 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.214457    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-tmp-dir\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.315197 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.315127    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-home\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.315400 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.315225    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-model-cache\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.315400 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.315257    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-tls-certs\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.315400 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.315302    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-dshm\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.315400 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.315332    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7z48\" (UniqueName: \"kubernetes.io/projected/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-kube-api-access-f7z48\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.315400 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.315368    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-tmp-dir\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.315680 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.315528    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-home\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.315680 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.315615    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-model-cache\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.315793 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.315746    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-tmp-dir\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.317809 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.317786    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-dshm\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.318050 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.318033    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-tls-certs\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.323691 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.323667    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7z48\" (UniqueName: \"kubernetes.io/projected/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-kube-api-access-f7z48\") pod \"rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") " pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.501840 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.501741    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:25.641806 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:25.641776    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"]
Jul 31 21:23:25.644192 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:23:25.644140    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd3afed7_265f_4f22_bf49_a2b3675d6e9e.slice/crio-2a7df544573f430f817230a783bc022ab474e18093a53e556cc187c340ebff1c WatchSource:0}: Error finding container 2a7df544573f430f817230a783bc022ab474e18093a53e556cc187c340ebff1c: Status 404 returned error can't find the container with id 2a7df544573f430f817230a783bc022ab474e18093a53e556cc187c340ebff1c
Jul 31 21:23:26.589612 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:26.589570    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k" event={"ID":"dd3afed7-265f-4f22-bf49-a2b3675d6e9e","Type":"ContainerStarted","Data":"5367435b52ddc6b3f3ce76bfc90285e7774adfc0855d1ffadeaf7c78f9048e7b"}
Jul 31 21:23:26.589612 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:26.589622    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k" event={"ID":"dd3afed7-265f-4f22-bf49-a2b3675d6e9e","Type":"ContainerStarted","Data":"2a7df544573f430f817230a783bc022ab474e18093a53e556cc187c340ebff1c"}
Jul 31 21:23:26.604945 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:26.604898    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k" podStartSLOduration=1.604883791 podStartE2EDuration="1.604883791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:23:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:23:26.604373394 +0000 UTC m=+3211.209765872" watchObservedRunningTime="2026-07-31 21:23:26.604883791 +0000 UTC m=+3211.210276267"
Jul 31 21:23:35.502244 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:35.502206    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:35.502244 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:35.502254    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:35.515482 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:35.515452    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:23:35.647189 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:23:35.647141    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:24:33.408660 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:33.408623    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"]
Jul 31 21:24:34.399828 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:34.399798    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7674-139768272566576"]
Jul 31 21:24:34.403032 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:34.403014    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7674-139768272566576"
Jul 31 21:24:34.405550 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:34.405522    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-plrtc\""
Jul 31 21:24:34.408552 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:34.408523    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7674-139768272566576"]
Jul 31 21:24:34.555896 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:34.555852    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qndjt\" (UniqueName: \"kubernetes.io/projected/6ff062b8-7b11-422e-a443-267d6ffaed18-kube-api-access-qndjt\") pod \"test-curl-7674-139768272566576\" (UID: \"6ff062b8-7b11-422e-a443-267d6ffaed18\") " pod="opendatahub/test-curl-7674-139768272566576"
Jul 31 21:24:34.657409 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:34.657307    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qndjt\" (UniqueName: \"kubernetes.io/projected/6ff062b8-7b11-422e-a443-267d6ffaed18-kube-api-access-qndjt\") pod \"test-curl-7674-139768272566576\" (UID: \"6ff062b8-7b11-422e-a443-267d6ffaed18\") " pod="opendatahub/test-curl-7674-139768272566576"
Jul 31 21:24:34.666122 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:34.666095    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qndjt\" (UniqueName: \"kubernetes.io/projected/6ff062b8-7b11-422e-a443-267d6ffaed18-kube-api-access-qndjt\") pod \"test-curl-7674-139768272566576\" (UID: \"6ff062b8-7b11-422e-a443-267d6ffaed18\") " pod="opendatahub/test-curl-7674-139768272566576"
Jul 31 21:24:34.713247 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:34.713215    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7674-139768272566576"
Jul 31 21:24:34.860188 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:34.860157    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7674-139768272566576"]
Jul 31 21:24:34.862244 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:24:34.862207    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ff062b8_7b11_422e_a443_267d6ffaed18.slice/crio-b047267984d8e420cd49e75be7dc5f4afb37423c92a1d77b09236e42a06b9c86 WatchSource:0}: Error finding container b047267984d8e420cd49e75be7dc5f4afb37423c92a1d77b09236e42a06b9c86: Status 404 returned error can't find the container with id b047267984d8e420cd49e75be7dc5f4afb37423c92a1d77b09236e42a06b9c86
Jul 31 21:24:34.863509 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:34.863492    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 21:24:34.935473 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:34.935383    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7674-139768272566576" event={"ID":"6ff062b8-7b11-422e-a443-267d6ffaed18","Type":"ContainerStarted","Data":"b047267984d8e420cd49e75be7dc5f4afb37423c92a1d77b09236e42a06b9c86"}
Jul 31 21:24:35.941649 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:35.941562    2566 generic.go:356] "Generic (PLEG): container finished" podID="6ff062b8-7b11-422e-a443-267d6ffaed18" containerID="6d78bdd69bcbb8d030a0176b232c2f6efc323af9c71ac53343c344c2b95f5e43" exitCode=0
Jul 31 21:24:35.941649 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:35.941628    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7674-139768272566576" event={"ID":"6ff062b8-7b11-422e-a443-267d6ffaed18","Type":"ContainerDied","Data":"6d78bdd69bcbb8d030a0176b232c2f6efc323af9c71ac53343c344c2b95f5e43"}
Jul 31 21:24:37.095236 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.095210    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7674-139768272566576"
Jul 31 21:24:37.127849 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.127814    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7674-139768272566576_6ff062b8-7b11-422e-a443-267d6ffaed18/test-curl-7674-139768272566576/0.log"
Jul 31 21:24:37.147198 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.147156    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7674-139768272566576"]
Jul 31 21:24:37.149176 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.149155    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7674-139768272566576"]
Jul 31 21:24:37.179591 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.179556    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qndjt\" (UniqueName: \"kubernetes.io/projected/6ff062b8-7b11-422e-a443-267d6ffaed18-kube-api-access-qndjt\") pod \"6ff062b8-7b11-422e-a443-267d6ffaed18\" (UID: \"6ff062b8-7b11-422e-a443-267d6ffaed18\") "
Jul 31 21:24:37.181934 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.181898    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ff062b8-7b11-422e-a443-267d6ffaed18-kube-api-access-qndjt" (OuterVolumeSpecName: "kube-api-access-qndjt") pod "6ff062b8-7b11-422e-a443-267d6ffaed18" (UID: "6ff062b8-7b11-422e-a443-267d6ffaed18"). InnerVolumeSpecName "kube-api-access-qndjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:24:37.270701 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.270603    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7674-139768272597680"]
Jul 31 21:24:37.271040 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.271026    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff062b8-7b11-422e-a443-267d6ffaed18" containerName="test-curl-7674-139768272566576"
Jul 31 21:24:37.271040 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.271040    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff062b8-7b11-422e-a443-267d6ffaed18" containerName="test-curl-7674-139768272566576"
Jul 31 21:24:37.271119 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.271097    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff062b8-7b11-422e-a443-267d6ffaed18" containerName="test-curl-7674-139768272566576"
Jul 31 21:24:37.274215 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.274197    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7674-139768272597680"
Jul 31 21:24:37.279319 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.279289    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7674-139768272597680"]
Jul 31 21:24:37.280509 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.280481    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qndjt\" (UniqueName: \"kubernetes.io/projected/6ff062b8-7b11-422e-a443-267d6ffaed18-kube-api-access-qndjt\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:24:37.381773 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.381737    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87kpv\" (UniqueName: \"kubernetes.io/projected/4bd1b622-92e9-43d8-969d-d4a2c981e2a0-kube-api-access-87kpv\") pod \"test-curl-7674-139768272597680\" (UID: \"4bd1b622-92e9-43d8-969d-d4a2c981e2a0\") " pod="opendatahub/test-curl-7674-139768272597680"
Jul 31 21:24:37.483056 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.483004    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87kpv\" (UniqueName: \"kubernetes.io/projected/4bd1b622-92e9-43d8-969d-d4a2c981e2a0-kube-api-access-87kpv\") pod \"test-curl-7674-139768272597680\" (UID: \"4bd1b622-92e9-43d8-969d-d4a2c981e2a0\") " pod="opendatahub/test-curl-7674-139768272597680"
Jul 31 21:24:37.491099 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.491058    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87kpv\" (UniqueName: \"kubernetes.io/projected/4bd1b622-92e9-43d8-969d-d4a2c981e2a0-kube-api-access-87kpv\") pod \"test-curl-7674-139768272597680\" (UID: \"4bd1b622-92e9-43d8-969d-d4a2c981e2a0\") " pod="opendatahub/test-curl-7674-139768272597680"
Jul 31 21:24:37.584484 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.584443    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7674-139768272597680"
Jul 31 21:24:37.722679 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.722650    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7674-139768272597680"]
Jul 31 21:24:37.724329 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:24:37.724303    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bd1b622_92e9_43d8_969d_d4a2c981e2a0.slice/crio-7e491fdb04100e510840aef0aa80e96c4e6733599aa2c203a93f895639c804aa WatchSource:0}: Error finding container 7e491fdb04100e510840aef0aa80e96c4e6733599aa2c203a93f895639c804aa: Status 404 returned error can't find the container with id 7e491fdb04100e510840aef0aa80e96c4e6733599aa2c203a93f895639c804aa
Jul 31 21:24:37.937597 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.937503    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ff062b8-7b11-422e-a443-267d6ffaed18" path="/var/lib/kubelet/pods/6ff062b8-7b11-422e-a443-267d6ffaed18/volumes"
Jul 31 21:24:37.953322 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.953294    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7674-139768272566576"
Jul 31 21:24:37.953462 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.953347    2566 scope.go:117] "RemoveContainer" containerID="6d78bdd69bcbb8d030a0176b232c2f6efc323af9c71ac53343c344c2b95f5e43"
Jul 31 21:24:37.954641 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:37.954443    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7674-139768272597680" event={"ID":"4bd1b622-92e9-43d8-969d-d4a2c981e2a0","Type":"ContainerStarted","Data":"7e491fdb04100e510840aef0aa80e96c4e6733599aa2c203a93f895639c804aa"}
Jul 31 21:24:38.961676 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:38.961638    2566 generic.go:356] "Generic (PLEG): container finished" podID="4bd1b622-92e9-43d8-969d-d4a2c981e2a0" containerID="e6fa274b8c7dca262dc3d468f5801d5de0ef3e3d97c9be0bc0b3a84ad9e43370" exitCode=0
Jul 31 21:24:38.962110 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:38.961677    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7674-139768272597680" event={"ID":"4bd1b622-92e9-43d8-969d-d4a2c981e2a0","Type":"ContainerDied","Data":"e6fa274b8c7dca262dc3d468f5801d5de0ef3e3d97c9be0bc0b3a84ad9e43370"}
Jul 31 21:24:40.115998 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:40.115968    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7674-139768272597680"
Jul 31 21:24:40.135541 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:40.135507    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7674-139768272597680_4bd1b622-92e9-43d8-969d-d4a2c981e2a0/test-curl-7674-139768272597680/0.log"
Jul 31 21:24:40.158346 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:40.158311    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7674-139768272597680"]
Jul 31 21:24:40.162160 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:40.162113    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7674-139768272597680"]
Jul 31 21:24:40.209740 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:40.209707    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87kpv\" (UniqueName: \"kubernetes.io/projected/4bd1b622-92e9-43d8-969d-d4a2c981e2a0-kube-api-access-87kpv\") pod \"4bd1b622-92e9-43d8-969d-d4a2c981e2a0\" (UID: \"4bd1b622-92e9-43d8-969d-d4a2c981e2a0\") "
Jul 31 21:24:40.211918 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:40.211883    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bd1b622-92e9-43d8-969d-d4a2c981e2a0-kube-api-access-87kpv" (OuterVolumeSpecName: "kube-api-access-87kpv") pod "4bd1b622-92e9-43d8-969d-d4a2c981e2a0" (UID: "4bd1b622-92e9-43d8-969d-d4a2c981e2a0"). InnerVolumeSpecName "kube-api-access-87kpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:24:40.311137 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:40.311104    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87kpv\" (UniqueName: \"kubernetes.io/projected/4bd1b622-92e9-43d8-969d-d4a2c981e2a0-kube-api-access-87kpv\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:24:40.973995 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:40.973962    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7674-139768272597680"
Jul 31 21:24:40.973995 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:40.973984    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e491fdb04100e510840aef0aa80e96c4e6733599aa2c203a93f895639c804aa"
Jul 31 21:24:40.983946 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:24:40.983911    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7674-139768272597680\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="4bd1b622-92e9-43d8-969d-d4a2c981e2a0" pod="opendatahub/test-curl-7674-139768272597680"
Jul 31 21:24:41.935479 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:41.935450    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bd1b622-92e9-43d8-969d-d4a2c981e2a0" path="/var/lib/kubelet/pods/4bd1b622-92e9-43d8-969d-d4a2c981e2a0/volumes"
Jul 31 21:24:48.428737 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.428681    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k" podUID="dd3afed7-265f-4f22-bf49-a2b3675d6e9e" containerName="main" containerID="cri-o://5367435b52ddc6b3f3ce76bfc90285e7774adfc0855d1ffadeaf7c78f9048e7b" gracePeriod=45
Jul 31 21:24:48.685254 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.685189    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:24:48.693270 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.693242    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-tmp-dir\") pod \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") "
Jul 31 21:24:48.693446 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.693277    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-dshm\") pod \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") "
Jul 31 21:24:48.693446 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.693306    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-model-cache\") pod \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") "
Jul 31 21:24:48.693446 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.693338    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-tls-certs\") pod \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") "
Jul 31 21:24:48.693446 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.693366    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7z48\" (UniqueName: \"kubernetes.io/projected/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-kube-api-access-f7z48\") pod \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") "
Jul 31 21:24:48.693446 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.693401    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-home\") pod \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\" (UID: \"dd3afed7-265f-4f22-bf49-a2b3675d6e9e\") "
Jul 31 21:24:48.693719 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.693547    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dd3afed7-265f-4f22-bf49-a2b3675d6e9e" (UID: "dd3afed7-265f-4f22-bf49-a2b3675d6e9e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:24:48.693719 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.693661    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-model-cache" (OuterVolumeSpecName: "model-cache") pod "dd3afed7-265f-4f22-bf49-a2b3675d6e9e" (UID: "dd3afed7-265f-4f22-bf49-a2b3675d6e9e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:24:48.693719 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.693701    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-tmp-dir\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:24:48.693825 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.693730    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-home" (OuterVolumeSpecName: "home") pod "dd3afed7-265f-4f22-bf49-a2b3675d6e9e" (UID: "dd3afed7-265f-4f22-bf49-a2b3675d6e9e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:24:48.695568 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.695544    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-dshm" (OuterVolumeSpecName: "dshm") pod "dd3afed7-265f-4f22-bf49-a2b3675d6e9e" (UID: "dd3afed7-265f-4f22-bf49-a2b3675d6e9e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:24:48.695665 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.695649    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-kube-api-access-f7z48" (OuterVolumeSpecName: "kube-api-access-f7z48") pod "dd3afed7-265f-4f22-bf49-a2b3675d6e9e" (UID: "dd3afed7-265f-4f22-bf49-a2b3675d6e9e"). InnerVolumeSpecName "kube-api-access-f7z48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:24:48.695741 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.695704    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dd3afed7-265f-4f22-bf49-a2b3675d6e9e" (UID: "dd3afed7-265f-4f22-bf49-a2b3675d6e9e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 31 21:24:48.794564 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.794520    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-home\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:24:48.794564 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.794555    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-dshm\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:24:48.794564 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.794563    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-model-cache\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:24:48.794564 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.794573    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-tls-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:24:48.794842 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:48.794582    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7z48\" (UniqueName: \"kubernetes.io/projected/dd3afed7-265f-4f22-bf49-a2b3675d6e9e-kube-api-access-f7z48\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:24:49.017219 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.017106    2566 generic.go:356] "Generic (PLEG): container finished" podID="dd3afed7-265f-4f22-bf49-a2b3675d6e9e" containerID="5367435b52ddc6b3f3ce76bfc90285e7774adfc0855d1ffadeaf7c78f9048e7b" exitCode=0
Jul 31 21:24:49.017219 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.017167    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"
Jul 31 21:24:49.017219 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.017194    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k" event={"ID":"dd3afed7-265f-4f22-bf49-a2b3675d6e9e","Type":"ContainerDied","Data":"5367435b52ddc6b3f3ce76bfc90285e7774adfc0855d1ffadeaf7c78f9048e7b"}
Jul 31 21:24:49.017508 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.017244    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k" event={"ID":"dd3afed7-265f-4f22-bf49-a2b3675d6e9e","Type":"ContainerDied","Data":"2a7df544573f430f817230a783bc022ab474e18093a53e556cc187c340ebff1c"}
Jul 31 21:24:49.017508 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.017267    2566 scope.go:117] "RemoveContainer" containerID="5367435b52ddc6b3f3ce76bfc90285e7774adfc0855d1ffadeaf7c78f9048e7b"
Jul 31 21:24:49.034119 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.034097    2566 scope.go:117] "RemoveContainer" containerID="5367435b52ddc6b3f3ce76bfc90285e7774adfc0855d1ffadeaf7c78f9048e7b"
Jul 31 21:24:49.034473 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:24:49.034451    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5367435b52ddc6b3f3ce76bfc90285e7774adfc0855d1ffadeaf7c78f9048e7b\": container with ID starting with 5367435b52ddc6b3f3ce76bfc90285e7774adfc0855d1ffadeaf7c78f9048e7b not found: ID does not exist" containerID="5367435b52ddc6b3f3ce76bfc90285e7774adfc0855d1ffadeaf7c78f9048e7b"
Jul 31 21:24:49.034589 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.034485    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5367435b52ddc6b3f3ce76bfc90285e7774adfc0855d1ffadeaf7c78f9048e7b"} err="failed to get container status \"5367435b52ddc6b3f3ce76bfc90285e7774adfc0855d1ffadeaf7c78f9048e7b\": rpc error: code = NotFound desc = could not find container \"5367435b52ddc6b3f3ce76bfc90285e7774adfc0855d1ffadeaf7c78f9048e7b\": container with ID starting with 5367435b52ddc6b3f3ce76bfc90285e7774adfc0855d1ffadeaf7c78f9048e7b not found: ID does not exist"
Jul 31 21:24:49.043576 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.043547    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"]
Jul 31 21:24:49.047272 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.047244    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6938c5/rate-test-model-6938c5-kserve-6db8b8c64c-xtv8k"]
Jul 31 21:24:49.587736 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.587702    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7674-139768272482352"]
Jul 31 21:24:49.588132 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.588119    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd1b622-92e9-43d8-969d-d4a2c981e2a0" containerName="test-curl-7674-139768272597680"
Jul 31 21:24:49.588194 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.588133    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd1b622-92e9-43d8-969d-d4a2c981e2a0" containerName="test-curl-7674-139768272597680"
Jul 31 21:24:49.588194 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.588156    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd3afed7-265f-4f22-bf49-a2b3675d6e9e" containerName="main"
Jul 31 21:24:49.588194 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.588164    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd3afed7-265f-4f22-bf49-a2b3675d6e9e" containerName="main"
Jul 31 21:24:49.588302 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.588238    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd3afed7-265f-4f22-bf49-a2b3675d6e9e" containerName="main"
Jul 31 21:24:49.588302 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.588255    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bd1b622-92e9-43d8-969d-d4a2c981e2a0" containerName="test-curl-7674-139768272597680"
Jul 31 21:24:49.592770 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.592753    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7674-139768272482352"
Jul 31 21:24:49.595318 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.595291    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-plrtc\""
Jul 31 21:24:49.596052 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.596030    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7674-139768272482352"]
Jul 31 21:24:49.601525 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.601500    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wd2s\" (UniqueName: \"kubernetes.io/projected/a070dbc1-66be-433d-b657-6f70deca5988-kube-api-access-2wd2s\") pod \"test-curl-7674-139768272482352\" (UID: \"a070dbc1-66be-433d-b657-6f70deca5988\") " pod="opendatahub/test-curl-7674-139768272482352"
Jul 31 21:24:49.702495 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.702453    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wd2s\" (UniqueName: \"kubernetes.io/projected/a070dbc1-66be-433d-b657-6f70deca5988-kube-api-access-2wd2s\") pod \"test-curl-7674-139768272482352\" (UID: \"a070dbc1-66be-433d-b657-6f70deca5988\") " pod="opendatahub/test-curl-7674-139768272482352"
Jul 31 21:24:49.711450 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.711421    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wd2s\" (UniqueName: \"kubernetes.io/projected/a070dbc1-66be-433d-b657-6f70deca5988-kube-api-access-2wd2s\") pod \"test-curl-7674-139768272482352\" (UID: \"a070dbc1-66be-433d-b657-6f70deca5988\") " pod="opendatahub/test-curl-7674-139768272482352"
Jul 31 21:24:49.903869 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.903768    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7674-139768272482352"
Jul 31 21:24:49.935856 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:49.935825    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd3afed7-265f-4f22-bf49-a2b3675d6e9e" path="/var/lib/kubelet/pods/dd3afed7-265f-4f22-bf49-a2b3675d6e9e/volumes"
Jul 31 21:24:50.045364 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:50.045333    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7674-139768272482352"]
Jul 31 21:24:50.047255 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:24:50.047230    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda070dbc1_66be_433d_b657_6f70deca5988.slice/crio-9acdb72f30f1d6aa5aa5ee9977edb0e27f3f4d9542609ad739824dab631a5461 WatchSource:0}: Error finding container 9acdb72f30f1d6aa5aa5ee9977edb0e27f3f4d9542609ad739824dab631a5461: Status 404 returned error can't find the container with id 9acdb72f30f1d6aa5aa5ee9977edb0e27f3f4d9542609ad739824dab631a5461
Jul 31 21:24:51.031673 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:51.031585    2566 generic.go:356] "Generic (PLEG): container finished" podID="a070dbc1-66be-433d-b657-6f70deca5988" containerID="a00f3fad61f561b9540c4caa9d994ce3211ab8f6a14e88ff5d994cdeb4b9e97c" exitCode=0
Jul 31 21:24:51.032037 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:51.031676    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7674-139768272482352" event={"ID":"a070dbc1-66be-433d-b657-6f70deca5988","Type":"ContainerDied","Data":"a00f3fad61f561b9540c4caa9d994ce3211ab8f6a14e88ff5d994cdeb4b9e97c"}
Jul 31 21:24:51.032037 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:51.031716    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7674-139768272482352" event={"ID":"a070dbc1-66be-433d-b657-6f70deca5988","Type":"ContainerStarted","Data":"9acdb72f30f1d6aa5aa5ee9977edb0e27f3f4d9542609ad739824dab631a5461"}
Jul 31 21:24:52.174196 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:52.174170    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7674-139768272482352"
Jul 31 21:24:52.193778 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:52.193751    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7674-139768272482352_a070dbc1-66be-433d-b657-6f70deca5988/test-curl-7674-139768272482352/0.log"
Jul 31 21:24:52.214771 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:52.214734    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7674-139768272482352"]
Jul 31 21:24:52.219431 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:52.219396    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7674-139768272482352"]
Jul 31 21:24:52.223571 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:52.223546    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wd2s\" (UniqueName: \"kubernetes.io/projected/a070dbc1-66be-433d-b657-6f70deca5988-kube-api-access-2wd2s\") pod \"a070dbc1-66be-433d-b657-6f70deca5988\" (UID: \"a070dbc1-66be-433d-b657-6f70deca5988\") "
Jul 31 21:24:52.225839 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:52.225814    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a070dbc1-66be-433d-b657-6f70deca5988-kube-api-access-2wd2s" (OuterVolumeSpecName: "kube-api-access-2wd2s") pod "a070dbc1-66be-433d-b657-6f70deca5988" (UID: "a070dbc1-66be-433d-b657-6f70deca5988"). InnerVolumeSpecName "kube-api-access-2wd2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:24:52.324508 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:52.324473    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wd2s\" (UniqueName: \"kubernetes.io/projected/a070dbc1-66be-433d-b657-6f70deca5988-kube-api-access-2wd2s\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:24:53.043700 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.043674    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7674-139768272482352"
Jul 31 21:24:53.043859 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.043716    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9acdb72f30f1d6aa5aa5ee9977edb0e27f3f4d9542609ad739824dab631a5461"
Jul 31 21:24:53.053413 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:24:53.053383    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7674-139768272482352\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="a070dbc1-66be-433d-b657-6f70deca5988" pod="opendatahub/test-curl-7674-139768272482352"
Jul 31 21:24:53.100583 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.100542    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"]
Jul 31 21:24:53.100932 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.100919    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a070dbc1-66be-433d-b657-6f70deca5988" containerName="test-curl-7674-139768272482352"
Jul 31 21:24:53.100984 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.100934    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a070dbc1-66be-433d-b657-6f70deca5988" containerName="test-curl-7674-139768272482352"
Jul 31 21:24:53.101031 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.101000    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a070dbc1-66be-433d-b657-6f70deca5988" containerName="test-curl-7674-139768272482352"
Jul 31 21:24:53.104140 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.104118    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.106604 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:24:53.106562    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7674-139768272482352\" is forbidden: User \"system:node:ip-10-0-132-89.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-89.ec2.internal' and this object" podUID="a070dbc1-66be-433d-b657-6f70deca5988" pod="opendatahub/test-curl-7674-139768272482352"
Jul 31 21:24:53.106763 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.106634    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-b4cb74-openshift-default-dockercfg-p4k7m\""
Jul 31 21:24:53.117789 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.117759    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"]
Jul 31 21:24:53.132744 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.132704    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-credential-socket\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.132744 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.132756    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-workload-socket\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.132959 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.132855    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-workload-certs\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.132959 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.132897    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv7q2\" (UniqueName: \"kubernetes.io/projected/0ceffcde-7db0-43b4-948d-6fb1ace834dd-kube-api-access-rv7q2\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.132959 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.132937    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-token\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.133061 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.133021    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-envoy\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.133103 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.133084    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-podinfo\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.133174 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.133137    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-data\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.133222 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.133190    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istiod-ca-cert\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.234737 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.234704    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-envoy\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.235230 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.234758    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-podinfo\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.235230 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.234801    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-data\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.235230 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.234826    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istiod-ca-cert\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.235230 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.234914    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-credential-socket\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.235230 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.234944    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-workload-socket\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.235230 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.234991    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-workload-certs\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.235230 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.235016    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv7q2\" (UniqueName: \"kubernetes.io/projected/0ceffcde-7db0-43b4-948d-6fb1ace834dd-kube-api-access-rv7q2\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.235230 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.235053    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-token\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.235649 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.235254    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-data\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.235649 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.235339    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-workload-socket\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.235649 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.235462    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-workload-certs\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.235929 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.235897    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istiod-ca-cert\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.236065 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.236004    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-credential-socket\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.237340 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.237308    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-envoy\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.237659 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.237643    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-podinfo\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.243180 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.243134    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-token\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.243317 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.243297    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv7q2\" (UniqueName: \"kubernetes.io/projected/0ceffcde-7db0-43b4-948d-6fb1ace834dd-kube-api-access-rv7q2\") pod \"e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") " pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.415416 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.415317    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:53.562514 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.562488    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"]
Jul 31 21:24:53.564079 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:24:53.564053    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ceffcde_7db0_43b4_948d_6fb1ace834dd.slice/crio-f59c7e81d4e62fb2512019c62f832bb5db3e64b7ddac59a697d8f2efe1a666ad WatchSource:0}: Error finding container f59c7e81d4e62fb2512019c62f832bb5db3e64b7ddac59a697d8f2efe1a666ad: Status 404 returned error can't find the container with id f59c7e81d4e62fb2512019c62f832bb5db3e64b7ddac59a697d8f2efe1a666ad
Jul 31 21:24:53.566600 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.566568    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:24:53.566710 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.566634    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:24:53.566710 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.566662    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:24:53.936548 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:53.936517    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a070dbc1-66be-433d-b657-6f70deca5988" path="/var/lib/kubelet/pods/a070dbc1-66be-433d-b657-6f70deca5988/volumes"
Jul 31 21:24:54.050863 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:54.050825    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s" event={"ID":"0ceffcde-7db0-43b4-948d-6fb1ace834dd","Type":"ContainerStarted","Data":"d8d8777072052d259cc9d5f1185111f626ba29d033a7e2d06e830d1bdda50621"}
Jul 31 21:24:54.051013 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:54.050881    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s" event={"ID":"0ceffcde-7db0-43b4-948d-6fb1ace834dd","Type":"ContainerStarted","Data":"f59c7e81d4e62fb2512019c62f832bb5db3e64b7ddac59a697d8f2efe1a666ad"}
Jul 31 21:24:54.072236 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:54.072185    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s" podStartSLOduration=1.072165381 podStartE2EDuration="1.072165381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:24:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:24:54.069189807 +0000 UTC m=+3298.674582282" watchObservedRunningTime="2026-07-31 21:24:54.072165381 +0000 UTC m=+3298.677557853"
Jul 31 21:24:54.415920 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:54.415882    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:54.421324 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:54.421297    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:55.055945 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:55.055911    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:24:55.057049 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:24:55.057027    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:25:10.385224 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:10.384071    2566 patch_prober.go:28] interesting pod/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": read tcp 10.133.0.2:59732->10.133.0.91:15021: read: connection reset by peer" start-of-body=
Jul 31 21:25:10.385224 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:10.384175    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s" podUID="0ceffcde-7db0-43b4-948d-6fb1ace834dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": read tcp 10.133.0.2:59732->10.133.0.91:15021: read: connection reset by peer"
Jul 31 21:25:11.141000 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:11.140966    2566 generic.go:356] "Generic (PLEG): container finished" podID="0ceffcde-7db0-43b4-948d-6fb1ace834dd" containerID="d8d8777072052d259cc9d5f1185111f626ba29d033a7e2d06e830d1bdda50621" exitCode=0
Jul 31 21:25:11.141204 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:11.141040    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s" event={"ID":"0ceffcde-7db0-43b4-948d-6fb1ace834dd","Type":"ContainerDied","Data":"d8d8777072052d259cc9d5f1185111f626ba29d033a7e2d06e830d1bdda50621"}
Jul 31 21:25:11.141481 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:11.141468    2566 scope.go:117] "RemoveContainer" containerID="d8d8777072052d259cc9d5f1185111f626ba29d033a7e2d06e830d1bdda50621"
Jul 31 21:25:11.142463 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:11.142439    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:25:11.142531 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:11.142512    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:25:11.142571 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:11.142544    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:25:12.151720 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:12.151662    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s" event={"ID":"0ceffcde-7db0-43b4-948d-6fb1ace834dd","Type":"ContainerStarted","Data":"3171f2fd65db43e586fb8f4182f5838a34bd2396f7d8f27bbb3a9f768a11a8ab"}
Jul 31 21:25:12.415945 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:12.415852    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:25:12.416130 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:12.416107    2566 patch_prober.go:28] interesting pod/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Jul 31 21:25:12.416241 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:12.416202    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s" podUID="0ceffcde-7db0-43b4-948d-6fb1ace834dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Jul 31 21:25:13.416683 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:13.416638    2566 patch_prober.go:28] interesting pod/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Jul 31 21:25:13.417113 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:13.416705    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s" podUID="0ceffcde-7db0-43b4-948d-6fb1ace834dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Jul 31 21:25:14.416614 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:14.416577    2566 patch_prober.go:28] interesting pod/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Jul 31 21:25:14.416815 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:14.416632    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s" podUID="0ceffcde-7db0-43b4-948d-6fb1ace834dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Jul 31 21:25:15.416628 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:15.416587    2566 patch_prober.go:28] interesting pod/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Jul 31 21:25:15.417116 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:15.416652    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s" podUID="0ceffcde-7db0-43b4-948d-6fb1ace834dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Jul 31 21:25:16.416334 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:16.416295    2566 patch_prober.go:28] interesting pod/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Jul 31 21:25:16.416556 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:16.416361    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s" podUID="0ceffcde-7db0-43b4-948d-6fb1ace834dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Jul 31 21:25:17.419455 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:17.419378    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:25:17.419836 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:17.419651    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:25:17.420453 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:17.420437    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:25:21.993621 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:21.993583    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"]
Jul 31 21:25:21.998270 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:21.998245    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.001063 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.001041    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-5c3fd2-openshift-default-dockercfg-qkr5d\""
Jul 31 21:25:22.007967 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.007940    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"]
Jul 31 21:25:22.111445 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.111399    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-podinfo\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.111634 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.111484    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-data\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.111634 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.111535    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-workload-certs\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.111634 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.111565    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-workload-socket\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.111634 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.111588    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-token\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.111634 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.111615    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-credential-socket\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.111911 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.111696    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-envoy\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.111911 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.111761    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e4d378-615e-46d4-8d96-b8f89e50f102-istiod-ca-cert\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.111911 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.111794    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs4j6\" (UniqueName: \"kubernetes.io/projected/e5e4d378-615e-46d4-8d96-b8f89e50f102-kube-api-access-cs4j6\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.213275 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.213233    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-data\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.213484 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.213317    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-workload-certs\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.213484 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.213345    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-workload-socket\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.213484 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.213369    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-token\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.213484 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.213396    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-credential-socket\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.213484 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.213427    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-envoy\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.213484 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.213477    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e4d378-615e-46d4-8d96-b8f89e50f102-istiod-ca-cert\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.213817 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.213503    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs4j6\" (UniqueName: \"kubernetes.io/projected/e5e4d378-615e-46d4-8d96-b8f89e50f102-kube-api-access-cs4j6\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.213817 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.213567    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-podinfo\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.213817 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.213707    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-data\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.213983 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.213962    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-workload-certs\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.214040 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.214003    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-workload-socket\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.214113 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.214091    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-credential-socket\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.214293 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.214269    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e4d378-615e-46d4-8d96-b8f89e50f102-istiod-ca-cert\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.216040 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.216014    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-envoy\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.216440 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.216419    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-podinfo\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.221604 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.221576    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-token\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.221714 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.221657    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs4j6\" (UniqueName: \"kubernetes.io/projected/e5e4d378-615e-46d4-8d96-b8f89e50f102-kube-api-access-cs4j6\") pod \"e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") " pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.311718 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.311682    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:22.466842 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.466810    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"]
Jul 31 21:25:22.469254 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:25:22.469198    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e4d378_615e_46d4_8d96_b8f89e50f102.slice/crio-3a669de203ede2893636eadd22c66798ab561de00ded1bf6e7561aa74e5c7bf5 WatchSource:0}: Error finding container 3a669de203ede2893636eadd22c66798ab561de00ded1bf6e7561aa74e5c7bf5: Status 404 returned error can't find the container with id 3a669de203ede2893636eadd22c66798ab561de00ded1bf6e7561aa74e5c7bf5
Jul 31 21:25:22.471639 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.471605    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:25:22.471719 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.471676    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:25:22.471719 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:22.471706    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:25:23.212369 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:23.212327    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs" event={"ID":"e5e4d378-615e-46d4-8d96-b8f89e50f102","Type":"ContainerStarted","Data":"c1b035a45cd50f90b82797a9ab752e4cfed8c189a3d3892819ff2744590ef15f"}
Jul 31 21:25:23.212806 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:23.212398    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs" event={"ID":"e5e4d378-615e-46d4-8d96-b8f89e50f102","Type":"ContainerStarted","Data":"3a669de203ede2893636eadd22c66798ab561de00ded1bf6e7561aa74e5c7bf5"}
Jul 31 21:25:23.233022 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:23.232956    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs" podStartSLOduration=2.232938331 podStartE2EDuration="2.232938331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:25:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:25:23.232218141 +0000 UTC m=+3327.837610618" watchObservedRunningTime="2026-07-31 21:25:23.232938331 +0000 UTC m=+3327.838330808"
Jul 31 21:25:23.312757 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:23.312712    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:23.317868 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:23.317841    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:24.217439 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:24.217408    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:24.218556 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:24.218538    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:39.219389 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:39.219350    2566 patch_prober.go:28] interesting pod/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Jul 31 21:25:39.219792 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:39.219447    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs" podUID="e5e4d378-615e-46d4-8d96-b8f89e50f102" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Jul 31 21:25:39.302472 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:39.302440    2566 generic.go:356] "Generic (PLEG): container finished" podID="e5e4d378-615e-46d4-8d96-b8f89e50f102" containerID="c1b035a45cd50f90b82797a9ab752e4cfed8c189a3d3892819ff2744590ef15f" exitCode=0
Jul 31 21:25:39.302648 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:39.302514    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs" event={"ID":"e5e4d378-615e-46d4-8d96-b8f89e50f102","Type":"ContainerDied","Data":"c1b035a45cd50f90b82797a9ab752e4cfed8c189a3d3892819ff2744590ef15f"}
Jul 31 21:25:39.302954 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:39.302940    2566 scope.go:117] "RemoveContainer" containerID="c1b035a45cd50f90b82797a9ab752e4cfed8c189a3d3892819ff2744590ef15f"
Jul 31 21:25:39.303993 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:39.303969    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:25:39.304039 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:39.304030    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:25:39.304075 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:39.304062    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:25:40.309348 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:40.309307    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs" event={"ID":"e5e4d378-615e-46d4-8d96-b8f89e50f102","Type":"ContainerStarted","Data":"8f279cf8314fc9da371a5ab8aca5757ffa004cb182307f60d17eed0c618096e8"}
Jul 31 21:25:40.312678 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:40.312648    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:40.312901 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:40.312881    2566 patch_prober.go:28] interesting pod/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Jul 31 21:25:40.312949 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:40.312928    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs" podUID="e5e4d378-615e-46d4-8d96-b8f89e50f102" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Jul 31 21:25:41.312539 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:41.312502    2566 patch_prober.go:28] interesting pod/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Jul 31 21:25:41.312973 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:41.312557    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs" podUID="e5e4d378-615e-46d4-8d96-b8f89e50f102" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Jul 31 21:25:42.313085 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:42.313039    2566 patch_prober.go:28] interesting pod/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Jul 31 21:25:42.313539 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:42.313107    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs" podUID="e5e4d378-615e-46d4-8d96-b8f89e50f102" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Jul 31 21:25:43.313008 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:43.312970    2566 patch_prober.go:28] interesting pod/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Jul 31 21:25:43.313227 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:43.313026    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs" podUID="e5e4d378-615e-46d4-8d96-b8f89e50f102" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Jul 31 21:25:44.313169 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:44.313103    2566 patch_prober.go:28] interesting pod/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused" start-of-body=
Jul 31 21:25:44.313390 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:44.313198    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs" podUID="e5e4d378-615e-46d4-8d96-b8f89e50f102" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.92:15021/healthz/ready\": dial tcp 10.133.0.92:15021: connect: connection refused"
Jul 31 21:25:45.318230 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:45.318198    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:45.318699 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:45.318569    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:45.319475 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:45.319457    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:25:57.114317 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:25:57.114281    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-4vj9m_5436fd36-6c95-4225-8260-8d7ca57f80c3/payload-processing/0.log"
Jul 31 21:26:42.167018 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:42.166983    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-4vj9m_5436fd36-6c95-4225-8260-8d7ca57f80c3/payload-processing/0.log"
Jul 31 21:26:42.862769 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:42.862732    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"]
Jul 31 21:26:42.866556 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:42.866530    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:42.869395 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:42.869369    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-69e90d-openshift-default-dockercfg-k6r2d\""
Jul 31 21:26:42.878553 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:42.878345    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"]
Jul 31 21:26:42.987032 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:42.986993    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-podinfo\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:42.987032 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:42.987046    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-workload-certs\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:42.987367 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:42.987158    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7d67e65-1986-408e-84ea-b3f19edc0458-istiod-ca-cert\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:42.987367 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:42.987227    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-envoy\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:42.987367 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:42.987344    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-data\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:42.987566 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:42.987379    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-credential-socket\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:42.987566 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:42.987407    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b6s2\" (UniqueName: \"kubernetes.io/projected/e7d67e65-1986-408e-84ea-b3f19edc0458-kube-api-access-7b6s2\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:42.987566 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:42.987465    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-workload-socket\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:42.987566 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:42.987505    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-token\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.088993 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.088946    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-data\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.088993 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.088994    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-credential-socket\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.089286 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.089013    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b6s2\" (UniqueName: \"kubernetes.io/projected/e7d67e65-1986-408e-84ea-b3f19edc0458-kube-api-access-7b6s2\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.089286 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.089054    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-workload-socket\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.089286 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.089082    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-token\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.089286 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.089105    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-podinfo\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.089286 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.089132    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-workload-certs\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.089286 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.089205    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7d67e65-1986-408e-84ea-b3f19edc0458-istiod-ca-cert\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.089286 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.089280    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-envoy\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.090119 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.089452    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-data\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.090119 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.089503    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-credential-socket\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.090119 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.089739    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-workload-certs\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.090119 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.090023    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-workload-socket\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.090302 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.090122    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7d67e65-1986-408e-84ea-b3f19edc0458-istiod-ca-cert\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.091818 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.091797    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-envoy\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.092029 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.092011    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-podinfo\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.097376 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.097350    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-token\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.097376 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.097371    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b6s2\" (UniqueName: \"kubernetes.io/projected/e7d67e65-1986-408e-84ea-b3f19edc0458-kube-api-access-7b6s2\") pod \"e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") " pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.180045 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.179945    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:43.328305 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.328192    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"]
Jul 31 21:26:43.329849 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:26:43.329816    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d67e65_1986_408e_84ea_b3f19edc0458.slice/crio-2118cbaa53dfd410db0fc9fb65c267f4ee97bfc962cb65fa49e79b36b5f5df95 WatchSource:0}: Error finding container 2118cbaa53dfd410db0fc9fb65c267f4ee97bfc962cb65fa49e79b36b5f5df95: Status 404 returned error can't find the container with id 2118cbaa53dfd410db0fc9fb65c267f4ee97bfc962cb65fa49e79b36b5f5df95
Jul 31 21:26:43.332914 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.332874    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:26:43.333026 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.332960    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:26:43.333026 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.333001    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:26:43.642221 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.642187    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn" event={"ID":"e7d67e65-1986-408e-84ea-b3f19edc0458","Type":"ContainerStarted","Data":"5008b35b9283fb414fa5b60228521a934ce33db762b1ec4f7a928aaa089459f3"}
Jul 31 21:26:43.642417 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.642246    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn" event={"ID":"e7d67e65-1986-408e-84ea-b3f19edc0458","Type":"ContainerStarted","Data":"2118cbaa53dfd410db0fc9fb65c267f4ee97bfc962cb65fa49e79b36b5f5df95"}
Jul 31 21:26:43.661984 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:43.661920    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn" podStartSLOduration=1.661901037 podStartE2EDuration="1.661901037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:26:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:43.659580637 +0000 UTC m=+3408.264973112" watchObservedRunningTime="2026-07-31 21:26:43.661901037 +0000 UTC m=+3408.267293514"
Jul 31 21:26:44.180207 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:44.180135    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:44.185846 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:44.185822    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:44.648550 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:44.648510    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:26:44.649571 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:26:44.649550    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:27:00.690324 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:00.690282    2566 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 31 21:27:00.690771 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:00.690350    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn" podUID="e7d67e65-1986-408e-84ea-b3f19edc0458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 31 21:27:02.748623 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:02.748519    2566 generic.go:356] "Generic (PLEG): container finished" podID="e7d67e65-1986-408e-84ea-b3f19edc0458" containerID="5008b35b9283fb414fa5b60228521a934ce33db762b1ec4f7a928aaa089459f3" exitCode=0
Jul 31 21:27:02.748623 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:02.748562    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn" event={"ID":"e7d67e65-1986-408e-84ea-b3f19edc0458","Type":"ContainerDied","Data":"5008b35b9283fb414fa5b60228521a934ce33db762b1ec4f7a928aaa089459f3"}
Jul 31 21:27:02.749260 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:02.749091    2566 scope.go:117] "RemoveContainer" containerID="5008b35b9283fb414fa5b60228521a934ce33db762b1ec4f7a928aaa089459f3"
Jul 31 21:27:02.750268 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:02.750237    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:27:02.750353 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:02.750306    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:27:02.750353 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:02.750336    2566 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 31 21:27:03.758685 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:03.758648    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn" event={"ID":"e7d67e65-1986-408e-84ea-b3f19edc0458","Type":"ContainerStarted","Data":"3aed85353b28efaffc0b517f9d9b173b2733a5299e44e8c52ee2fda91e4202a0"}
Jul 31 21:27:04.180263 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:04.180222    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:27:04.180486 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:04.180465    2566 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Jul 31 21:27:04.180533 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:04.180511    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn" podUID="e7d67e65-1986-408e-84ea-b3f19edc0458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Jul 31 21:27:05.181498 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:05.181456    2566 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Jul 31 21:27:05.181926 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:05.181519    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn" podUID="e7d67e65-1986-408e-84ea-b3f19edc0458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Jul 31 21:27:06.180809 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:06.180771    2566 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Jul 31 21:27:06.180990 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:06.180827    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn" podUID="e7d67e65-1986-408e-84ea-b3f19edc0458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Jul 31 21:27:07.181299 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:07.181259    2566 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Jul 31 21:27:07.181718 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:07.181324    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn" podUID="e7d67e65-1986-408e-84ea-b3f19edc0458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Jul 31 21:27:08.181233 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:08.181196    2566 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Jul 31 21:27:08.181420 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:08.181254    2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn" podUID="e7d67e65-1986-408e-84ea-b3f19edc0458" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Jul 31 21:27:09.185237 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:09.185201    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:27:09.185682 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:09.185566    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:27:09.186270 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:09.186253    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:27:11.293300 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:11.293268    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h"]
Jul 31 21:27:11.296704 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:11.296684    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h"
Jul 31 21:27:11.299060 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:11.299042    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:27:11.303605 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:11.303578    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h"]
Jul 31 21:27:11.396608 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:11.396565    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h\" (UID: \"af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h"
Jul 31 21:27:11.497938 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:11.497894    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h\" (UID: \"af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h"
Jul 31 21:27:11.498591 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:11.498570    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h\" (UID: \"af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h"
Jul 31 21:27:11.610102 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:11.610007    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h"
Jul 31 21:27:11.750764 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:11.750728    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h"]
Jul 31 21:27:11.753085 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:27:11.753058    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf8d0d0b_1e02_4ff9_8d16_2f800c4cb59b.slice/crio-6b7ef5263ff6ba49c9f45e569bd06e7dd4a10e0a216f57a5cbae41b33657aacd WatchSource:0}: Error finding container 6b7ef5263ff6ba49c9f45e569bd06e7dd4a10e0a216f57a5cbae41b33657aacd: Status 404 returned error can't find the container with id 6b7ef5263ff6ba49c9f45e569bd06e7dd4a10e0a216f57a5cbae41b33657aacd
Jul 31 21:27:11.802745 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:11.802706    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h" event={"ID":"af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b","Type":"ContainerStarted","Data":"6b7ef5263ff6ba49c9f45e569bd06e7dd4a10e0a216f57a5cbae41b33657aacd"}
Jul 31 21:27:12.817689 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:12.817649    2566 generic.go:356] "Generic (PLEG): container finished" podID="af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b" containerID="15cced233875b81eb9650283a1419144d3745ff0bbd44826247a2655cbb7b3f0" exitCode=0
Jul 31 21:27:12.818486 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:12.818456    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h" event={"ID":"af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b","Type":"ContainerDied","Data":"15cced233875b81eb9650283a1419144d3745ff0bbd44826247a2655cbb7b3f0"}
Jul 31 21:27:13.963648 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:13.963622    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h"
Jul 31 21:27:14.025182 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:14.025126    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b-maas-api-service-ca\") pod \"af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b\" (UID: \"af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b\") "
Jul 31 21:27:14.025479 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:14.025455    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b" (UID: "af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:27:14.126595 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:14.126508    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b-maas-api-service-ca\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:27:14.830331 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:14.830298    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h"
Jul 31 21:27:14.830515 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:14.830337    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h" event={"ID":"af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b","Type":"ContainerDied","Data":"6b7ef5263ff6ba49c9f45e569bd06e7dd4a10e0a216f57a5cbae41b33657aacd"}
Jul 31 21:27:14.830515 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:14.830384    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b7ef5263ff6ba49c9f45e569bd06e7dd4a10e0a216f57a5cbae41b33657aacd"
Jul 31 21:27:17.314653 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:17.314609    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h"]
Jul 31 21:27:17.317395 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:17.317371    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-69e90d-djb2h"]
Jul 31 21:27:17.937155 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:17.937120    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b" path="/var/lib/kubelet/pods/af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b/volumes"
Jul 31 21:27:23.787463 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:23.787426    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"]
Jul 31 21:27:23.787875 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:23.787689    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn" podUID="e7d67e65-1986-408e-84ea-b3f19edc0458" containerName="istio-proxy" containerID="cri-o://3aed85353b28efaffc0b517f9d9b173b2733a5299e44e8c52ee2fda91e4202a0" gracePeriod=30
Jul 31 21:27:24.187793 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:24.187756    2566 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 31 21:27:24.187978 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:24.187821    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn" podUID="e7d67e65-1986-408e-84ea-b3f19edc0458" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 21:27:28.905738 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:28.905703    2566 generic.go:356] "Generic (PLEG): container finished" podID="e7d67e65-1986-408e-84ea-b3f19edc0458" containerID="3aed85353b28efaffc0b517f9d9b173b2733a5299e44e8c52ee2fda91e4202a0" exitCode=0
Jul 31 21:27:28.906217 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:28.905777    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn" event={"ID":"e7d67e65-1986-408e-84ea-b3f19edc0458","Type":"ContainerDied","Data":"3aed85353b28efaffc0b517f9d9b173b2733a5299e44e8c52ee2fda91e4202a0"}
Jul 31 21:27:28.906217 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:28.905858    2566 scope.go:117] "RemoveContainer" containerID="5008b35b9283fb414fa5b60228521a934ce33db762b1ec4f7a928aaa089459f3"
Jul 31 21:27:29.054446 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.054380    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:27:29.178923 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.178879    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-workload-certs\") pod \"e7d67e65-1986-408e-84ea-b3f19edc0458\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") "
Jul 31 21:27:29.178923 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.178920    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-token\") pod \"e7d67e65-1986-408e-84ea-b3f19edc0458\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") "
Jul 31 21:27:29.179186 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.178950    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-credential-socket\") pod \"e7d67e65-1986-408e-84ea-b3f19edc0458\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") "
Jul 31 21:27:29.179186 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.178994    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7d67e65-1986-408e-84ea-b3f19edc0458-istiod-ca-cert\") pod \"e7d67e65-1986-408e-84ea-b3f19edc0458\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") "
Jul 31 21:27:29.179186 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.179016    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-workload-socket\") pod \"e7d67e65-1986-408e-84ea-b3f19edc0458\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") "
Jul 31 21:27:29.179186 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.179090    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-envoy\") pod \"e7d67e65-1986-408e-84ea-b3f19edc0458\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") "
Jul 31 21:27:29.179186 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.179120    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-data\") pod \"e7d67e65-1986-408e-84ea-b3f19edc0458\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") "
Jul 31 21:27:29.179454 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.179264    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e7d67e65-1986-408e-84ea-b3f19edc0458" (UID: "e7d67e65-1986-408e-84ea-b3f19edc0458"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:27:29.179454 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.179290    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e7d67e65-1986-408e-84ea-b3f19edc0458" (UID: "e7d67e65-1986-408e-84ea-b3f19edc0458"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:27:29.179454 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.179181    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b6s2\" (UniqueName: \"kubernetes.io/projected/e7d67e65-1986-408e-84ea-b3f19edc0458-kube-api-access-7b6s2\") pod \"e7d67e65-1986-408e-84ea-b3f19edc0458\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") "
Jul 31 21:27:29.179454 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.179402    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-podinfo\") pod \"e7d67e65-1986-408e-84ea-b3f19edc0458\" (UID: \"e7d67e65-1986-408e-84ea-b3f19edc0458\") "
Jul 31 21:27:29.179454 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.179420    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-data" (OuterVolumeSpecName: "istio-data") pod "e7d67e65-1986-408e-84ea-b3f19edc0458" (UID: "e7d67e65-1986-408e-84ea-b3f19edc0458"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:27:29.179454 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.179437    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e7d67e65-1986-408e-84ea-b3f19edc0458" (UID: "e7d67e65-1986-408e-84ea-b3f19edc0458"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:27:29.179770 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.179724    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-workload-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:27:29.179770 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.179744    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-data\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:27:29.179770 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.179758    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-workload-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:27:29.179896 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.179767    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7d67e65-1986-408e-84ea-b3f19edc0458-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e7d67e65-1986-408e-84ea-b3f19edc0458" (UID: "e7d67e65-1986-408e-84ea-b3f19edc0458"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:27:29.179896 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.179773    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-credential-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:27:29.181431 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.181404    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7d67e65-1986-408e-84ea-b3f19edc0458" (UID: "e7d67e65-1986-408e-84ea-b3f19edc0458"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:27:29.181662 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.181633    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e7d67e65-1986-408e-84ea-b3f19edc0458" (UID: "e7d67e65-1986-408e-84ea-b3f19edc0458"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 21:27:29.181956 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.181935    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e7d67e65-1986-408e-84ea-b3f19edc0458" (UID: "e7d67e65-1986-408e-84ea-b3f19edc0458"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:27:29.181956 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.181947    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7d67e65-1986-408e-84ea-b3f19edc0458-kube-api-access-7b6s2" (OuterVolumeSpecName: "kube-api-access-7b6s2") pod "e7d67e65-1986-408e-84ea-b3f19edc0458" (UID: "e7d67e65-1986-408e-84ea-b3f19edc0458"). InnerVolumeSpecName "kube-api-access-7b6s2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:27:29.280704 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.280667    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-token\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:27:29.280704 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.280698    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7d67e65-1986-408e-84ea-b3f19edc0458-istiod-ca-cert\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:27:29.280704 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.280707    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-envoy\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:27:29.280956 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.280715    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b6s2\" (UniqueName: \"kubernetes.io/projected/e7d67e65-1986-408e-84ea-b3f19edc0458-kube-api-access-7b6s2\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:27:29.280956 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.280726    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7d67e65-1986-408e-84ea-b3f19edc0458-istio-podinfo\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:27:29.912995 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.912960    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn" event={"ID":"e7d67e65-1986-408e-84ea-b3f19edc0458","Type":"ContainerDied","Data":"2118cbaa53dfd410db0fc9fb65c267f4ee97bfc962cb65fa49e79b36b5f5df95"}
Jul 31 21:27:29.913549 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.912998    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"
Jul 31 21:27:29.913549 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.913051    2566 scope.go:117] "RemoveContainer" containerID="3aed85353b28efaffc0b517f9d9b173b2733a5299e44e8c52ee2fda91e4202a0"
Jul 31 21:27:29.935650 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.935621    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"]
Jul 31 21:27:29.938767 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:29.938741    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-69e90d-openshift-default-68f84678d6-2llnn"]
Jul 31 21:27:31.935766 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:27:31.935733    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7d67e65-1986-408e-84ea-b3f19edc0458" path="/var/lib/kubelet/pods/e7d67e65-1986-408e-84ea-b3f19edc0458/volumes"
Jul 31 21:29:13.754658 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:13.754618    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"]
Jul 31 21:29:13.755269 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:13.754943    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s" podUID="0ceffcde-7db0-43b4-948d-6fb1ace834dd" containerName="istio-proxy" containerID="cri-o://3171f2fd65db43e586fb8f4182f5838a34bd2396f7d8f27bbb3a9f768a11a8ab" gracePeriod=30
Jul 31 21:29:17.422841 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:17.422808    2566 patch_prober.go:28] interesting pod/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 31 21:29:17.423265 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:17.422875    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s" podUID="0ceffcde-7db0-43b4-948d-6fb1ace834dd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 31 21:29:19.014427 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.014360    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:29:19.099930 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.099895    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istiod-ca-cert\") pod \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") "
Jul 31 21:29:19.100174 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.099950    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv7q2\" (UniqueName: \"kubernetes.io/projected/0ceffcde-7db0-43b4-948d-6fb1ace834dd-kube-api-access-rv7q2\") pod \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") "
Jul 31 21:29:19.100174 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.099971    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-data\") pod \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") "
Jul 31 21:29:19.100174 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.099999    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-workload-certs\") pod \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") "
Jul 31 21:29:19.100174 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.100038    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-credential-socket\") pod \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") "
Jul 31 21:29:19.100174 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.100065    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-envoy\") pod \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") "
Jul 31 21:29:19.100174 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.100137    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-workload-socket\") pod \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") "
Jul 31 21:29:19.100497 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.100190    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-podinfo\") pod \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") "
Jul 31 21:29:19.100497 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.100226    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-token\") pod \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\" (UID: \"0ceffcde-7db0-43b4-948d-6fb1ace834dd\") "
Jul 31 21:29:19.100497 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.100335    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-data" (OuterVolumeSpecName: "istio-data") pod "0ceffcde-7db0-43b4-948d-6fb1ace834dd" (UID: "0ceffcde-7db0-43b4-948d-6fb1ace834dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:29:19.100497 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.100454    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0ceffcde-7db0-43b4-948d-6fb1ace834dd" (UID: "0ceffcde-7db0-43b4-948d-6fb1ace834dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:29:19.100497 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.100471    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0ceffcde-7db0-43b4-948d-6fb1ace834dd" (UID: "0ceffcde-7db0-43b4-948d-6fb1ace834dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:29:19.100497 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.100489    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0ceffcde-7db0-43b4-948d-6fb1ace834dd" (UID: "0ceffcde-7db0-43b4-948d-6fb1ace834dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:29:19.100866 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.100494    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0ceffcde-7db0-43b4-948d-6fb1ace834dd" (UID: "0ceffcde-7db0-43b4-948d-6fb1ace834dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:29:19.100866 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.100580    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-workload-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:19.100866 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.100598    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istiod-ca-cert\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:19.100866 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.100612    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-data\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:19.100866 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.100625    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-workload-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:19.100866 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.100637    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-credential-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:19.102635 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.102611    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0ceffcde-7db0-43b4-948d-6fb1ace834dd" (UID: "0ceffcde-7db0-43b4-948d-6fb1ace834dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 21:29:19.102751 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.102653    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-token" (OuterVolumeSpecName: "istio-token") pod "0ceffcde-7db0-43b4-948d-6fb1ace834dd" (UID: "0ceffcde-7db0-43b4-948d-6fb1ace834dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:29:19.102751 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.102714    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0ceffcde-7db0-43b4-948d-6fb1ace834dd" (UID: "0ceffcde-7db0-43b4-948d-6fb1ace834dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:29:19.102751 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.102738    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ceffcde-7db0-43b4-948d-6fb1ace834dd-kube-api-access-rv7q2" (OuterVolumeSpecName: "kube-api-access-rv7q2") pod "0ceffcde-7db0-43b4-948d-6fb1ace834dd" (UID: "0ceffcde-7db0-43b4-948d-6fb1ace834dd"). InnerVolumeSpecName "kube-api-access-rv7q2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:29:19.201092 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.201055    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-podinfo\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:19.201092 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.201088    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-token\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:19.201092 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.201097    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv7q2\" (UniqueName: \"kubernetes.io/projected/0ceffcde-7db0-43b4-948d-6fb1ace834dd-kube-api-access-rv7q2\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:19.201381 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.201106    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ceffcde-7db0-43b4-948d-6fb1ace834dd-istio-envoy\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:19.501059 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.501024    2566 generic.go:356] "Generic (PLEG): container finished" podID="0ceffcde-7db0-43b4-948d-6fb1ace834dd" containerID="3171f2fd65db43e586fb8f4182f5838a34bd2396f7d8f27bbb3a9f768a11a8ab" exitCode=0
Jul 31 21:29:19.501276 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.501076    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"
Jul 31 21:29:19.501276 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.501082    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s" event={"ID":"0ceffcde-7db0-43b4-948d-6fb1ace834dd","Type":"ContainerDied","Data":"3171f2fd65db43e586fb8f4182f5838a34bd2396f7d8f27bbb3a9f768a11a8ab"}
Jul 31 21:29:19.501276 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.501220    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s" event={"ID":"0ceffcde-7db0-43b4-948d-6fb1ace834dd","Type":"ContainerDied","Data":"f59c7e81d4e62fb2512019c62f832bb5db3e64b7ddac59a697d8f2efe1a666ad"}
Jul 31 21:29:19.501276 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.501243    2566 scope.go:117] "RemoveContainer" containerID="3171f2fd65db43e586fb8f4182f5838a34bd2396f7d8f27bbb3a9f768a11a8ab"
Jul 31 21:29:19.511435 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.511415    2566 scope.go:117] "RemoveContainer" containerID="d8d8777072052d259cc9d5f1185111f626ba29d033a7e2d06e830d1bdda50621"
Jul 31 21:29:19.520065 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.520042    2566 scope.go:117] "RemoveContainer" containerID="3171f2fd65db43e586fb8f4182f5838a34bd2396f7d8f27bbb3a9f768a11a8ab"
Jul 31 21:29:19.520360 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:29:19.520340    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3171f2fd65db43e586fb8f4182f5838a34bd2396f7d8f27bbb3a9f768a11a8ab\": container with ID starting with 3171f2fd65db43e586fb8f4182f5838a34bd2396f7d8f27bbb3a9f768a11a8ab not found: ID does not exist" containerID="3171f2fd65db43e586fb8f4182f5838a34bd2396f7d8f27bbb3a9f768a11a8ab"
Jul 31 21:29:19.520406 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.520371    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3171f2fd65db43e586fb8f4182f5838a34bd2396f7d8f27bbb3a9f768a11a8ab"} err="failed to get container status \"3171f2fd65db43e586fb8f4182f5838a34bd2396f7d8f27bbb3a9f768a11a8ab\": rpc error: code = NotFound desc = could not find container \"3171f2fd65db43e586fb8f4182f5838a34bd2396f7d8f27bbb3a9f768a11a8ab\": container with ID starting with 3171f2fd65db43e586fb8f4182f5838a34bd2396f7d8f27bbb3a9f768a11a8ab not found: ID does not exist"
Jul 31 21:29:19.520406 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.520390    2566 scope.go:117] "RemoveContainer" containerID="d8d8777072052d259cc9d5f1185111f626ba29d033a7e2d06e830d1bdda50621"
Jul 31 21:29:19.520641 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:29:19.520627    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8d8777072052d259cc9d5f1185111f626ba29d033a7e2d06e830d1bdda50621\": container with ID starting with d8d8777072052d259cc9d5f1185111f626ba29d033a7e2d06e830d1bdda50621 not found: ID does not exist" containerID="d8d8777072052d259cc9d5f1185111f626ba29d033a7e2d06e830d1bdda50621"
Jul 31 21:29:19.520726 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.520645    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8d8777072052d259cc9d5f1185111f626ba29d033a7e2d06e830d1bdda50621"} err="failed to get container status \"d8d8777072052d259cc9d5f1185111f626ba29d033a7e2d06e830d1bdda50621\": rpc error: code = NotFound desc = could not find container \"d8d8777072052d259cc9d5f1185111f626ba29d033a7e2d06e830d1bdda50621\": container with ID starting with d8d8777072052d259cc9d5f1185111f626ba29d033a7e2d06e830d1bdda50621 not found: ID does not exist"
Jul 31 21:29:19.524607 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.524582    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"]
Jul 31 21:29:19.528705 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.528678    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-b4cb74-openshift-default-6748f45458-ggd5s"]
Jul 31 21:29:19.937191 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:19.937133    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ceffcde-7db0-43b4-948d-6fb1ace834dd" path="/var/lib/kubelet/pods/0ceffcde-7db0-43b4-948d-6fb1ace834dd/volumes"
Jul 31 21:29:31.221869 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:31.221824    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"]
Jul 31 21:29:31.222381 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:31.222186    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs" podUID="e5e4d378-615e-46d4-8d96-b8f89e50f102" containerName="istio-proxy" containerID="cri-o://8f279cf8314fc9da371a5ab8aca5757ffa004cb182307f60d17eed0c618096e8" gracePeriod=30
Jul 31 21:29:36.491013 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.490952    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:29:36.564196 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.564139    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-podinfo\") pod \"e5e4d378-615e-46d4-8d96-b8f89e50f102\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") "
Jul 31 21:29:36.564196 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.564202    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-token\") pod \"e5e4d378-615e-46d4-8d96-b8f89e50f102\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") "
Jul 31 21:29:36.564456 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.564228    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs4j6\" (UniqueName: \"kubernetes.io/projected/e5e4d378-615e-46d4-8d96-b8f89e50f102-kube-api-access-cs4j6\") pod \"e5e4d378-615e-46d4-8d96-b8f89e50f102\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") "
Jul 31 21:29:36.564456 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.564280    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-envoy\") pod \"e5e4d378-615e-46d4-8d96-b8f89e50f102\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") "
Jul 31 21:29:36.564456 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.564300    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e4d378-615e-46d4-8d96-b8f89e50f102-istiod-ca-cert\") pod \"e5e4d378-615e-46d4-8d96-b8f89e50f102\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") "
Jul 31 21:29:36.564456 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.564357    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-data\") pod \"e5e4d378-615e-46d4-8d96-b8f89e50f102\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") "
Jul 31 21:29:36.564456 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.564373    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-workload-certs\") pod \"e5e4d378-615e-46d4-8d96-b8f89e50f102\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") "
Jul 31 21:29:36.564456 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.564407    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-workload-socket\") pod \"e5e4d378-615e-46d4-8d96-b8f89e50f102\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") "
Jul 31 21:29:36.564456 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.564430    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-credential-socket\") pod \"e5e4d378-615e-46d4-8d96-b8f89e50f102\" (UID: \"e5e4d378-615e-46d4-8d96-b8f89e50f102\") "
Jul 31 21:29:36.564828 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.564703    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-data" (OuterVolumeSpecName: "istio-data") pod "e5e4d378-615e-46d4-8d96-b8f89e50f102" (UID: "e5e4d378-615e-46d4-8d96-b8f89e50f102"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:29:36.564828 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.564800    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5e4d378-615e-46d4-8d96-b8f89e50f102-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e5e4d378-615e-46d4-8d96-b8f89e50f102" (UID: "e5e4d378-615e-46d4-8d96-b8f89e50f102"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:29:36.564938 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.564860    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e5e4d378-615e-46d4-8d96-b8f89e50f102" (UID: "e5e4d378-615e-46d4-8d96-b8f89e50f102"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:29:36.564938 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.564898    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e5e4d378-615e-46d4-8d96-b8f89e50f102" (UID: "e5e4d378-615e-46d4-8d96-b8f89e50f102"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:29:36.565247 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.564945    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e5e4d378-615e-46d4-8d96-b8f89e50f102" (UID: "e5e4d378-615e-46d4-8d96-b8f89e50f102"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:29:36.566721 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.566695    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e5e4d378-615e-46d4-8d96-b8f89e50f102" (UID: "e5e4d378-615e-46d4-8d96-b8f89e50f102"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 21:29:36.566838 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.566727    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5e4d378-615e-46d4-8d96-b8f89e50f102-kube-api-access-cs4j6" (OuterVolumeSpecName: "kube-api-access-cs4j6") pod "e5e4d378-615e-46d4-8d96-b8f89e50f102" (UID: "e5e4d378-615e-46d4-8d96-b8f89e50f102"). InnerVolumeSpecName "kube-api-access-cs4j6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:29:36.566838 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.566740    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-token" (OuterVolumeSpecName: "istio-token") pod "e5e4d378-615e-46d4-8d96-b8f89e50f102" (UID: "e5e4d378-615e-46d4-8d96-b8f89e50f102"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:29:36.566970 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.566946    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e5e4d378-615e-46d4-8d96-b8f89e50f102" (UID: "e5e4d378-615e-46d4-8d96-b8f89e50f102"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:29:36.592470 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.592439    2566 generic.go:356] "Generic (PLEG): container finished" podID="e5e4d378-615e-46d4-8d96-b8f89e50f102" containerID="8f279cf8314fc9da371a5ab8aca5757ffa004cb182307f60d17eed0c618096e8" exitCode=0
Jul 31 21:29:36.592633 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.592488    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"
Jul 31 21:29:36.592633 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.592525    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs" event={"ID":"e5e4d378-615e-46d4-8d96-b8f89e50f102","Type":"ContainerDied","Data":"8f279cf8314fc9da371a5ab8aca5757ffa004cb182307f60d17eed0c618096e8"}
Jul 31 21:29:36.592633 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.592588    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs" event={"ID":"e5e4d378-615e-46d4-8d96-b8f89e50f102","Type":"ContainerDied","Data":"3a669de203ede2893636eadd22c66798ab561de00ded1bf6e7561aa74e5c7bf5"}
Jul 31 21:29:36.592633 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.592617    2566 scope.go:117] "RemoveContainer" containerID="8f279cf8314fc9da371a5ab8aca5757ffa004cb182307f60d17eed0c618096e8"
Jul 31 21:29:36.602393 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.602374    2566 scope.go:117] "RemoveContainer" containerID="c1b035a45cd50f90b82797a9ab752e4cfed8c189a3d3892819ff2744590ef15f"
Jul 31 21:29:36.610770 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.610746    2566 scope.go:117] "RemoveContainer" containerID="8f279cf8314fc9da371a5ab8aca5757ffa004cb182307f60d17eed0c618096e8"
Jul 31 21:29:36.611043 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:29:36.611023    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f279cf8314fc9da371a5ab8aca5757ffa004cb182307f60d17eed0c618096e8\": container with ID starting with 8f279cf8314fc9da371a5ab8aca5757ffa004cb182307f60d17eed0c618096e8 not found: ID does not exist" containerID="8f279cf8314fc9da371a5ab8aca5757ffa004cb182307f60d17eed0c618096e8"
Jul 31 21:29:36.611096 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.611053    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f279cf8314fc9da371a5ab8aca5757ffa004cb182307f60d17eed0c618096e8"} err="failed to get container status \"8f279cf8314fc9da371a5ab8aca5757ffa004cb182307f60d17eed0c618096e8\": rpc error: code = NotFound desc = could not find container \"8f279cf8314fc9da371a5ab8aca5757ffa004cb182307f60d17eed0c618096e8\": container with ID starting with 8f279cf8314fc9da371a5ab8aca5757ffa004cb182307f60d17eed0c618096e8 not found: ID does not exist"
Jul 31 21:29:36.611096 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.611072    2566 scope.go:117] "RemoveContainer" containerID="c1b035a45cd50f90b82797a9ab752e4cfed8c189a3d3892819ff2744590ef15f"
Jul 31 21:29:36.611336 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:29:36.611320    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1b035a45cd50f90b82797a9ab752e4cfed8c189a3d3892819ff2744590ef15f\": container with ID starting with c1b035a45cd50f90b82797a9ab752e4cfed8c189a3d3892819ff2744590ef15f not found: ID does not exist" containerID="c1b035a45cd50f90b82797a9ab752e4cfed8c189a3d3892819ff2744590ef15f"
Jul 31 21:29:36.611380 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.611343    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1b035a45cd50f90b82797a9ab752e4cfed8c189a3d3892819ff2744590ef15f"} err="failed to get container status \"c1b035a45cd50f90b82797a9ab752e4cfed8c189a3d3892819ff2744590ef15f\": rpc error: code = NotFound desc = could not find container \"c1b035a45cd50f90b82797a9ab752e4cfed8c189a3d3892819ff2744590ef15f\": container with ID starting with c1b035a45cd50f90b82797a9ab752e4cfed8c189a3d3892819ff2744590ef15f not found: ID does not exist"
Jul 31 21:29:36.621547 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.621524    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"]
Jul 31 21:29:36.627400 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.627374    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-5c3fd2-openshift-default-56d58cdfdb-phmbs"]
Jul 31 21:29:36.665812 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.665777    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-envoy\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:36.665812 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.665808    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5e4d378-615e-46d4-8d96-b8f89e50f102-istiod-ca-cert\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:36.665812 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.665817    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-data\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:36.666041 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.665825    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-workload-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:36.666041 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.665833    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-workload-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:36.666041 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.665842    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5e4d378-615e-46d4-8d96-b8f89e50f102-credential-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:36.666041 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.665857    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-podinfo\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:36.666041 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.665866    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5e4d378-615e-46d4-8d96-b8f89e50f102-istio-token\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:36.666041 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:36.665873    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs4j6\" (UniqueName: \"kubernetes.io/projected/e5e4d378-615e-46d4-8d96-b8f89e50f102-kube-api-access-cs4j6\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:37.935621 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:37.935585    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5e4d378-615e-46d4-8d96-b8f89e50f102" path="/var/lib/kubelet/pods/e5e4d378-615e-46d4-8d96-b8f89e50f102/volumes"
Jul 31 21:29:42.457863 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.457826    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"]
Jul 31 21:29:42.458369 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.458107    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk" podUID="427b47d3-43b8-4bc0-8298-17888c5a0e6d" containerName="payload-processing" containerID="cri-o://5533c388c8f9977d7a8828355b28b2814b4154dedc26b82bb9c43a190f8ae753" gracePeriod=30
Jul 31 21:29:42.464847 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.464408    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"]
Jul 31 21:29:42.464847 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.464638    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84" podUID="ce123754-fc78-47d6-ae81-ba787e9ef2fc" containerName="payload-pre-processing" containerID="cri-o://5671c73c67595f310942432cbc47ed330d607cba03fc7a53d9bcf699ca1d6475" gracePeriod=30
Jul 31 21:29:42.626564 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.626518    2566 generic.go:356] "Generic (PLEG): container finished" podID="ce123754-fc78-47d6-ae81-ba787e9ef2fc" containerID="5671c73c67595f310942432cbc47ed330d607cba03fc7a53d9bcf699ca1d6475" exitCode=0
Jul 31 21:29:42.626732 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.626665    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84" event={"ID":"ce123754-fc78-47d6-ae81-ba787e9ef2fc","Type":"ContainerDied","Data":"5671c73c67595f310942432cbc47ed330d607cba03fc7a53d9bcf699ca1d6475"}
Jul 31 21:29:42.628826 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.628588    2566 generic.go:356] "Generic (PLEG): container finished" podID="427b47d3-43b8-4bc0-8298-17888c5a0e6d" containerID="5533c388c8f9977d7a8828355b28b2814b4154dedc26b82bb9c43a190f8ae753" exitCode=0
Jul 31 21:29:42.628826 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.628712    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk" event={"ID":"427b47d3-43b8-4bc0-8298-17888c5a0e6d","Type":"ContainerDied","Data":"5533c388c8f9977d7a8828355b28b2814b4154dedc26b82bb9c43a190f8ae753"}
Jul 31 21:29:42.734457 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.734421    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"
Jul 31 21:29:42.768224 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.768198    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"
Jul 31 21:29:42.826793 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.826758    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dp8l7\" (UniqueName: \"kubernetes.io/projected/427b47d3-43b8-4bc0-8298-17888c5a0e6d-kube-api-access-dp8l7\") pod \"427b47d3-43b8-4bc0-8298-17888c5a0e6d\" (UID: \"427b47d3-43b8-4bc0-8298-17888c5a0e6d\") "
Jul 31 21:29:42.827019 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.826924    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/427b47d3-43b8-4bc0-8298-17888c5a0e6d-plugins-config-volume\") pod \"427b47d3-43b8-4bc0-8298-17888c5a0e6d\" (UID: \"427b47d3-43b8-4bc0-8298-17888c5a0e6d\") "
Jul 31 21:29:42.827297 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.827271    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/427b47d3-43b8-4bc0-8298-17888c5a0e6d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "427b47d3-43b8-4bc0-8298-17888c5a0e6d" (UID: "427b47d3-43b8-4bc0-8298-17888c5a0e6d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:29:42.829889 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.829858    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/427b47d3-43b8-4bc0-8298-17888c5a0e6d-kube-api-access-dp8l7" (OuterVolumeSpecName: "kube-api-access-dp8l7") pod "427b47d3-43b8-4bc0-8298-17888c5a0e6d" (UID: "427b47d3-43b8-4bc0-8298-17888c5a0e6d"). InnerVolumeSpecName "kube-api-access-dp8l7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:29:42.928575 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.928541    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tk5c\" (UniqueName: \"kubernetes.io/projected/ce123754-fc78-47d6-ae81-ba787e9ef2fc-kube-api-access-9tk5c\") pod \"ce123754-fc78-47d6-ae81-ba787e9ef2fc\" (UID: \"ce123754-fc78-47d6-ae81-ba787e9ef2fc\") "
Jul 31 21:29:42.928801 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.928626    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce123754-fc78-47d6-ae81-ba787e9ef2fc-plugins-config-volume\") pod \"ce123754-fc78-47d6-ae81-ba787e9ef2fc\" (UID: \"ce123754-fc78-47d6-ae81-ba787e9ef2fc\") "
Jul 31 21:29:42.928801 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.928792    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/427b47d3-43b8-4bc0-8298-17888c5a0e6d-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:42.928924 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.928805    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dp8l7\" (UniqueName: \"kubernetes.io/projected/427b47d3-43b8-4bc0-8298-17888c5a0e6d-kube-api-access-dp8l7\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:42.928992 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.928966    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce123754-fc78-47d6-ae81-ba787e9ef2fc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ce123754-fc78-47d6-ae81-ba787e9ef2fc" (UID: "ce123754-fc78-47d6-ae81-ba787e9ef2fc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:29:42.931080 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:42.931046    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce123754-fc78-47d6-ae81-ba787e9ef2fc-kube-api-access-9tk5c" (OuterVolumeSpecName: "kube-api-access-9tk5c") pod "ce123754-fc78-47d6-ae81-ba787e9ef2fc" (UID: "ce123754-fc78-47d6-ae81-ba787e9ef2fc"). InnerVolumeSpecName "kube-api-access-9tk5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:29:43.029959 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:43.029871    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tk5c\" (UniqueName: \"kubernetes.io/projected/ce123754-fc78-47d6-ae81-ba787e9ef2fc-kube-api-access-9tk5c\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:43.029959 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:43.029913    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce123754-fc78-47d6-ae81-ba787e9ef2fc-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:43.635042 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:43.635008    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"
Jul 31 21:29:43.635508 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:43.635003    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84" event={"ID":"ce123754-fc78-47d6-ae81-ba787e9ef2fc","Type":"ContainerDied","Data":"a964e00008e5ff2fbc60f590793ac6ae0fc53dbefdbe817c2fc6342def46542a"}
Jul 31 21:29:43.635508 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:43.635199    2566 scope.go:117] "RemoveContainer" containerID="5671c73c67595f310942432cbc47ed330d607cba03fc7a53d9bcf699ca1d6475"
Jul 31 21:29:43.636641 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:43.636523    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"
Jul 31 21:29:43.636641 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:43.636526    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk" event={"ID":"427b47d3-43b8-4bc0-8298-17888c5a0e6d","Type":"ContainerDied","Data":"03ca39565ae1068e2185a3c1dfd487fe84f0041cc2963f8af0ecde9bc8998019"}
Jul 31 21:29:43.645204 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:43.645053    2566 scope.go:117] "RemoveContainer" containerID="5533c388c8f9977d7a8828355b28b2814b4154dedc26b82bb9c43a190f8ae753"
Jul 31 21:29:43.663299 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:43.663268    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"]
Jul 31 21:29:43.675598 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:43.675570    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-8de79c-56fd79dd58-gwdkk"]
Jul 31 21:29:43.702872 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:43.702835    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"]
Jul 31 21:29:43.705686 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:43.705662    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-8de79c-68fdc97ff6-c5b84"]
Jul 31 21:29:43.935892 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:43.935849    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="427b47d3-43b8-4bc0-8298-17888c5a0e6d" path="/var/lib/kubelet/pods/427b47d3-43b8-4bc0-8298-17888c5a0e6d/volumes"
Jul 31 21:29:43.936340 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:43.936319    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce123754-fc78-47d6-ae81-ba787e9ef2fc" path="/var/lib/kubelet/pods/ce123754-fc78-47d6-ae81-ba787e9ef2fc/volumes"
Jul 31 21:29:51.168565 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.168476    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6938c5-285z6"]
Jul 31 21:29:51.169069 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169053    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b" containerName="revoke-keys"
Jul 31 21:29:51.169122 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169072    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b" containerName="revoke-keys"
Jul 31 21:29:51.169122 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169094    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce123754-fc78-47d6-ae81-ba787e9ef2fc" containerName="payload-pre-processing"
Jul 31 21:29:51.169122 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169103    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce123754-fc78-47d6-ae81-ba787e9ef2fc" containerName="payload-pre-processing"
Jul 31 21:29:51.169122 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169117    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5e4d378-615e-46d4-8d96-b8f89e50f102" containerName="istio-proxy"
Jul 31 21:29:51.169316 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169126    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5e4d378-615e-46d4-8d96-b8f89e50f102" containerName="istio-proxy"
Jul 31 21:29:51.169316 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169158    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="427b47d3-43b8-4bc0-8298-17888c5a0e6d" containerName="payload-processing"
Jul 31 21:29:51.169316 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169167    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="427b47d3-43b8-4bc0-8298-17888c5a0e6d" containerName="payload-processing"
Jul 31 21:29:51.169316 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169176    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ceffcde-7db0-43b4-948d-6fb1ace834dd" containerName="istio-proxy"
Jul 31 21:29:51.169316 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169183    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ceffcde-7db0-43b4-948d-6fb1ace834dd" containerName="istio-proxy"
Jul 31 21:29:51.169316 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169197    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7d67e65-1986-408e-84ea-b3f19edc0458" containerName="istio-proxy"
Jul 31 21:29:51.169316 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169205    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7d67e65-1986-408e-84ea-b3f19edc0458" containerName="istio-proxy"
Jul 31 21:29:51.169316 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169216    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7d67e65-1986-408e-84ea-b3f19edc0458" containerName="istio-proxy"
Jul 31 21:29:51.169316 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169223    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7d67e65-1986-408e-84ea-b3f19edc0458" containerName="istio-proxy"
Jul 31 21:29:51.169316 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169236    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5e4d378-615e-46d4-8d96-b8f89e50f102" containerName="istio-proxy"
Jul 31 21:29:51.169316 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169244    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5e4d378-615e-46d4-8d96-b8f89e50f102" containerName="istio-proxy"
Jul 31 21:29:51.169649 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169328    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="af8d0d0b-1e02-4ff9-8d16-2f800c4cb59b" containerName="revoke-keys"
Jul 31 21:29:51.169649 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169341    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ceffcde-7db0-43b4-948d-6fb1ace834dd" containerName="istio-proxy"
Jul 31 21:29:51.169649 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169351    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce123754-fc78-47d6-ae81-ba787e9ef2fc" containerName="payload-pre-processing"
Jul 31 21:29:51.169649 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169358    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ceffcde-7db0-43b4-948d-6fb1ace834dd" containerName="istio-proxy"
Jul 31 21:29:51.169649 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169366    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5e4d378-615e-46d4-8d96-b8f89e50f102" containerName="istio-proxy"
Jul 31 21:29:51.169649 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169374    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5e4d378-615e-46d4-8d96-b8f89e50f102" containerName="istio-proxy"
Jul 31 21:29:51.169649 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169381    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7d67e65-1986-408e-84ea-b3f19edc0458" containerName="istio-proxy"
Jul 31 21:29:51.169649 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169390    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="427b47d3-43b8-4bc0-8298-17888c5a0e6d" containerName="payload-processing"
Jul 31 21:29:51.169649 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.169398    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7d67e65-1986-408e-84ea-b3f19edc0458" containerName="istio-proxy"
Jul 31 21:29:51.174612 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.174582    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6938c5-285z6"
Jul 31 21:29:51.178536 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.178515    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-td8bx\""
Jul 31 21:29:51.193790 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.193762    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8701b372-d148-4010-b467-f3fe6caacb1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-6938c5-285z6\" (UID: \"8701b372-d148-4010-b467-f3fe6caacb1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6938c5-285z6"
Jul 31 21:29:51.229219 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.229183    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6938c5-285z6"]
Jul 31 21:29:51.295237 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.295205    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8701b372-d148-4010-b467-f3fe6caacb1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-6938c5-285z6\" (UID: \"8701b372-d148-4010-b467-f3fe6caacb1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6938c5-285z6"
Jul 31 21:29:51.295784 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.295762    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8701b372-d148-4010-b467-f3fe6caacb1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-6938c5-285z6\" (UID: \"8701b372-d148-4010-b467-f3fe6caacb1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6938c5-285z6"
Jul 31 21:29:51.485224 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.485102    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6938c5-285z6"
Jul 31 21:29:51.633593 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.633411    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6938c5-285z6"]
Jul 31 21:29:51.636306 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:29:51.636278    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8701b372_d148_4010_b467_f3fe6caacb1c.slice/crio-0db147f9c44436b73e01020d83f033b1399bf76dd532c1509a0a80ef2a2e1eab WatchSource:0}: Error finding container 0db147f9c44436b73e01020d83f033b1399bf76dd532c1509a0a80ef2a2e1eab: Status 404 returned error can't find the container with id 0db147f9c44436b73e01020d83f033b1399bf76dd532c1509a0a80ef2a2e1eab
Jul 31 21:29:51.679626 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:51.679597    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6938c5-285z6" event={"ID":"8701b372-d148-4010-b467-f3fe6caacb1c","Type":"ContainerStarted","Data":"0db147f9c44436b73e01020d83f033b1399bf76dd532c1509a0a80ef2a2e1eab"}
Jul 31 21:29:52.686979 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:52.686880    2566 generic.go:356] "Generic (PLEG): container finished" podID="8701b372-d148-4010-b467-f3fe6caacb1c" containerID="f05135fc384b300b83e12ef452aa6cbde1fbd9db06acbe778bbc48246c09f849" exitCode=0
Jul 31 21:29:52.686979 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:52.686926    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6938c5-285z6" event={"ID":"8701b372-d148-4010-b467-f3fe6caacb1c","Type":"ContainerDied","Data":"f05135fc384b300b83e12ef452aa6cbde1fbd9db06acbe778bbc48246c09f849"}
Jul 31 21:29:53.828738 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:53.828708    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6938c5-285z6"
Jul 31 21:29:53.916063 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:53.916032    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8701b372-d148-4010-b467-f3fe6caacb1c-maas-api-service-ca\") pod \"8701b372-d148-4010-b467-f3fe6caacb1c\" (UID: \"8701b372-d148-4010-b467-f3fe6caacb1c\") "
Jul 31 21:29:53.916382 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:53.916359    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8701b372-d148-4010-b467-f3fe6caacb1c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8701b372-d148-4010-b467-f3fe6caacb1c" (UID: "8701b372-d148-4010-b467-f3fe6caacb1c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:29:54.017748 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:54.017708    2566 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8701b372-d148-4010-b467-f3fe6caacb1c-maas-api-service-ca\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:29:54.698476 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:54.698444    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6938c5-285z6"
Jul 31 21:29:54.698673 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:54.698436    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6938c5-285z6" event={"ID":"8701b372-d148-4010-b467-f3fe6caacb1c","Type":"ContainerDied","Data":"0db147f9c44436b73e01020d83f033b1399bf76dd532c1509a0a80ef2a2e1eab"}
Jul 31 21:29:54.698673 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:29:54.698583    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0db147f9c44436b73e01020d83f033b1399bf76dd532c1509a0a80ef2a2e1eab"
Jul 31 21:30:01.724954 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:01.724904    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"]
Jul 31 21:30:01.725447 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:01.725231    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt" podUID="2dea4458-0475-4a69-b7f2-fc4f016758fe" containerName="payload-processing" containerID="cri-o://68d9fc9b69bae1d70a12959dd4ca4e3b9db8493ee9f8c03da7d8a7d84050ecc9" gracePeriod=30
Jul 31 21:30:01.739958 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:01.739898    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"]
Jul 31 21:30:01.740509 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:01.740456    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs" podUID="6efcbbfe-c75d-41be-900e-acdc27a1e048" containerName="payload-pre-processing" containerID="cri-o://77cc2e128f04ab982289934d428e6b43b9bd606979ab11637df737a0a3ee8a18" gracePeriod=30
Jul 31 21:30:01.987744 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:01.987652    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6938c5-285z6"]
Jul 31 21:30:01.990759 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:01.990724    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6938c5-285z6"]
Jul 31 21:30:02.019125 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.019098    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"
Jul 31 21:30:02.053261 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.053235    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"
Jul 31 21:30:02.092954 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.092910    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22njv\" (UniqueName: \"kubernetes.io/projected/2dea4458-0475-4a69-b7f2-fc4f016758fe-kube-api-access-22njv\") pod \"2dea4458-0475-4a69-b7f2-fc4f016758fe\" (UID: \"2dea4458-0475-4a69-b7f2-fc4f016758fe\") "
Jul 31 21:30:02.092954 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.092950    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpmls\" (UniqueName: \"kubernetes.io/projected/6efcbbfe-c75d-41be-900e-acdc27a1e048-kube-api-access-hpmls\") pod \"6efcbbfe-c75d-41be-900e-acdc27a1e048\" (UID: \"6efcbbfe-c75d-41be-900e-acdc27a1e048\") "
Jul 31 21:30:02.092954 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.092968    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6efcbbfe-c75d-41be-900e-acdc27a1e048-plugins-config-volume\") pod \"6efcbbfe-c75d-41be-900e-acdc27a1e048\" (UID: \"6efcbbfe-c75d-41be-900e-acdc27a1e048\") "
Jul 31 21:30:02.093312 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.093015    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dea4458-0475-4a69-b7f2-fc4f016758fe-plugins-config-volume\") pod \"2dea4458-0475-4a69-b7f2-fc4f016758fe\" (UID: \"2dea4458-0475-4a69-b7f2-fc4f016758fe\") "
Jul 31 21:30:02.093493 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.093468    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dea4458-0475-4a69-b7f2-fc4f016758fe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2dea4458-0475-4a69-b7f2-fc4f016758fe" (UID: "2dea4458-0475-4a69-b7f2-fc4f016758fe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:30:02.093493 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.093471    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6efcbbfe-c75d-41be-900e-acdc27a1e048-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6efcbbfe-c75d-41be-900e-acdc27a1e048" (UID: "6efcbbfe-c75d-41be-900e-acdc27a1e048"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:30:02.095365 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.095332    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6efcbbfe-c75d-41be-900e-acdc27a1e048-kube-api-access-hpmls" (OuterVolumeSpecName: "kube-api-access-hpmls") pod "6efcbbfe-c75d-41be-900e-acdc27a1e048" (UID: "6efcbbfe-c75d-41be-900e-acdc27a1e048"). InnerVolumeSpecName "kube-api-access-hpmls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:30:02.095493 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.095404    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dea4458-0475-4a69-b7f2-fc4f016758fe-kube-api-access-22njv" (OuterVolumeSpecName: "kube-api-access-22njv") pod "2dea4458-0475-4a69-b7f2-fc4f016758fe" (UID: "2dea4458-0475-4a69-b7f2-fc4f016758fe"). InnerVolumeSpecName "kube-api-access-22njv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:30:02.194121 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.194080    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22njv\" (UniqueName: \"kubernetes.io/projected/2dea4458-0475-4a69-b7f2-fc4f016758fe-kube-api-access-22njv\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:30:02.194121 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.194110    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpmls\" (UniqueName: \"kubernetes.io/projected/6efcbbfe-c75d-41be-900e-acdc27a1e048-kube-api-access-hpmls\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:30:02.194121 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.194123    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6efcbbfe-c75d-41be-900e-acdc27a1e048-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:30:02.194121 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.194132    2566 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2dea4458-0475-4a69-b7f2-fc4f016758fe-plugins-config-volume\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:30:02.744870 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.744706    2566 generic.go:356] "Generic (PLEG): container finished" podID="2dea4458-0475-4a69-b7f2-fc4f016758fe" containerID="68d9fc9b69bae1d70a12959dd4ca4e3b9db8493ee9f8c03da7d8a7d84050ecc9" exitCode=0
Jul 31 21:30:02.744870 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.744763    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"
Jul 31 21:30:02.744870 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.744783    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt" event={"ID":"2dea4458-0475-4a69-b7f2-fc4f016758fe","Type":"ContainerDied","Data":"68d9fc9b69bae1d70a12959dd4ca4e3b9db8493ee9f8c03da7d8a7d84050ecc9"}
Jul 31 21:30:02.744870 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.744838    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt" event={"ID":"2dea4458-0475-4a69-b7f2-fc4f016758fe","Type":"ContainerDied","Data":"9bd2c9ddb3a65a83cbbf121014fd551d91d444c271f26508ab4dc3770818a8bd"}
Jul 31 21:30:02.744870 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.744865    2566 scope.go:117] "RemoveContainer" containerID="68d9fc9b69bae1d70a12959dd4ca4e3b9db8493ee9f8c03da7d8a7d84050ecc9"
Jul 31 21:30:02.746710 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.746689    2566 generic.go:356] "Generic (PLEG): container finished" podID="6efcbbfe-c75d-41be-900e-acdc27a1e048" containerID="77cc2e128f04ab982289934d428e6b43b9bd606979ab11637df737a0a3ee8a18" exitCode=0
Jul 31 21:30:02.746797 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.746761    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs" event={"ID":"6efcbbfe-c75d-41be-900e-acdc27a1e048","Type":"ContainerDied","Data":"77cc2e128f04ab982289934d428e6b43b9bd606979ab11637df737a0a3ee8a18"}
Jul 31 21:30:02.746861 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.746803    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs" event={"ID":"6efcbbfe-c75d-41be-900e-acdc27a1e048","Type":"ContainerDied","Data":"f948dc6d4bf27839bdf50d0900604f2691f1b66263ac13cc86432fded6cfb983"}
Jul 31 21:30:02.746905 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.746861    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"
Jul 31 21:30:02.756138 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.756114    2566 scope.go:117] "RemoveContainer" containerID="68d9fc9b69bae1d70a12959dd4ca4e3b9db8493ee9f8c03da7d8a7d84050ecc9"
Jul 31 21:30:02.756521 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:30:02.756500    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68d9fc9b69bae1d70a12959dd4ca4e3b9db8493ee9f8c03da7d8a7d84050ecc9\": container with ID starting with 68d9fc9b69bae1d70a12959dd4ca4e3b9db8493ee9f8c03da7d8a7d84050ecc9 not found: ID does not exist" containerID="68d9fc9b69bae1d70a12959dd4ca4e3b9db8493ee9f8c03da7d8a7d84050ecc9"
Jul 31 21:30:02.756605 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.756533    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68d9fc9b69bae1d70a12959dd4ca4e3b9db8493ee9f8c03da7d8a7d84050ecc9"} err="failed to get container status \"68d9fc9b69bae1d70a12959dd4ca4e3b9db8493ee9f8c03da7d8a7d84050ecc9\": rpc error: code = NotFound desc = could not find container \"68d9fc9b69bae1d70a12959dd4ca4e3b9db8493ee9f8c03da7d8a7d84050ecc9\": container with ID starting with 68d9fc9b69bae1d70a12959dd4ca4e3b9db8493ee9f8c03da7d8a7d84050ecc9 not found: ID does not exist"
Jul 31 21:30:02.756605 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.756558    2566 scope.go:117] "RemoveContainer" containerID="77cc2e128f04ab982289934d428e6b43b9bd606979ab11637df737a0a3ee8a18"
Jul 31 21:30:02.764850 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.764830    2566 scope.go:117] "RemoveContainer" containerID="77cc2e128f04ab982289934d428e6b43b9bd606979ab11637df737a0a3ee8a18"
Jul 31 21:30:02.765121 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:30:02.765101    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77cc2e128f04ab982289934d428e6b43b9bd606979ab11637df737a0a3ee8a18\": container with ID starting with 77cc2e128f04ab982289934d428e6b43b9bd606979ab11637df737a0a3ee8a18 not found: ID does not exist" containerID="77cc2e128f04ab982289934d428e6b43b9bd606979ab11637df737a0a3ee8a18"
Jul 31 21:30:02.765227 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.765130    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77cc2e128f04ab982289934d428e6b43b9bd606979ab11637df737a0a3ee8a18"} err="failed to get container status \"77cc2e128f04ab982289934d428e6b43b9bd606979ab11637df737a0a3ee8a18\": rpc error: code = NotFound desc = could not find container \"77cc2e128f04ab982289934d428e6b43b9bd606979ab11637df737a0a3ee8a18\": container with ID starting with 77cc2e128f04ab982289934d428e6b43b9bd606979ab11637df737a0a3ee8a18 not found: ID does not exist"
Jul 31 21:30:02.773553 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.773524    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"]
Jul 31 21:30:02.778946 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.778914    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6938c5-546b498c8b-csrmt"]
Jul 31 21:30:02.793204 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.793170    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"]
Jul 31 21:30:02.804247 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:02.804216    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6938c5-6cf697c6-q62rs"]
Jul 31 21:30:03.214005 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:03.213963    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758845-mcm7j"]
Jul 31 21:30:03.218670 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:03.218639    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29758845-mcm7j"]
Jul 31 21:30:03.935777 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:03.935737    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bbf7038-555a-4aaf-8ac6-14128d9f3b4b" path="/var/lib/kubelet/pods/2bbf7038-555a-4aaf-8ac6-14128d9f3b4b/volumes"
Jul 31 21:30:03.936283 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:03.936100    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dea4458-0475-4a69-b7f2-fc4f016758fe" path="/var/lib/kubelet/pods/2dea4458-0475-4a69-b7f2-fc4f016758fe/volumes"
Jul 31 21:30:03.936660 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:03.936643    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6efcbbfe-c75d-41be-900e-acdc27a1e048" path="/var/lib/kubelet/pods/6efcbbfe-c75d-41be-900e-acdc27a1e048/volumes"
Jul 31 21:30:03.936980 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:03.936966    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8701b372-d148-4010-b467-f3fe6caacb1c" path="/var/lib/kubelet/pods/8701b372-d148-4010-b467-f3fe6caacb1c/volumes"
Jul 31 21:30:09.976741 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:09.976710    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"]
Jul 31 21:30:09.977287 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:09.976922    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r" podUID="1d5e532b-4c49-42a7-9e07-72435dd81bb6" containerName="istio-proxy" containerID="cri-o://b9daa8f66e22ef66111757f7c8c0b97b47e9839c7834df261e46731349dffcee" gracePeriod=30
Jul 31 21:30:15.239426 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.239400    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:30:15.315233 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.315199    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-token\") pod \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") "
Jul 31 21:30:15.315446 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.315255    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-envoy\") pod \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") "
Jul 31 21:30:15.315446 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.315285    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-724tx\" (UniqueName: \"kubernetes.io/projected/1d5e532b-4c49-42a7-9e07-72435dd81bb6-kube-api-access-724tx\") pod \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") "
Jul 31 21:30:15.315446 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.315314    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-data\") pod \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") "
Jul 31 21:30:15.315446 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.315334    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-podinfo\") pod \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") "
Jul 31 21:30:15.315446 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.315351    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-credential-socket\") pod \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") "
Jul 31 21:30:15.315446 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.315401    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-workload-certs\") pod \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") "
Jul 31 21:30:15.315446 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.315440    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-workload-socket\") pod \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") "
Jul 31 21:30:15.315827 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.315486    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istiod-ca-cert\") pod \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\" (UID: \"1d5e532b-4c49-42a7-9e07-72435dd81bb6\") "
Jul 31 21:30:15.315827 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.315686    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d5e532b-4c49-42a7-9e07-72435dd81bb6" (UID: "1d5e532b-4c49-42a7-9e07-72435dd81bb6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:30:15.315827 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.315711    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d5e532b-4c49-42a7-9e07-72435dd81bb6" (UID: "1d5e532b-4c49-42a7-9e07-72435dd81bb6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:30:15.315827 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.315791    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d5e532b-4c49-42a7-9e07-72435dd81bb6" (UID: "1d5e532b-4c49-42a7-9e07-72435dd81bb6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:30:15.316067 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.315892    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d5e532b-4c49-42a7-9e07-72435dd81bb6" (UID: "1d5e532b-4c49-42a7-9e07-72435dd81bb6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:30:15.316067 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.315937    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d5e532b-4c49-42a7-9e07-72435dd81bb6" (UID: "1d5e532b-4c49-42a7-9e07-72435dd81bb6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 31 21:30:15.317699 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.317676    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d5e532b-4c49-42a7-9e07-72435dd81bb6" (UID: "1d5e532b-4c49-42a7-9e07-72435dd81bb6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 31 21:30:15.317819 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.317703    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d5e532b-4c49-42a7-9e07-72435dd81bb6" (UID: "1d5e532b-4c49-42a7-9e07-72435dd81bb6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:30:15.317819 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.317764    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d5e532b-4c49-42a7-9e07-72435dd81bb6-kube-api-access-724tx" (OuterVolumeSpecName: "kube-api-access-724tx") pod "1d5e532b-4c49-42a7-9e07-72435dd81bb6" (UID: "1d5e532b-4c49-42a7-9e07-72435dd81bb6"). InnerVolumeSpecName "kube-api-access-724tx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 31 21:30:15.317896 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.317838    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d5e532b-4c49-42a7-9e07-72435dd81bb6" (UID: "1d5e532b-4c49-42a7-9e07-72435dd81bb6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 31 21:30:15.416310 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.416275    2566 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-envoy\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:30:15.416310 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.416304    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-724tx\" (UniqueName: \"kubernetes.io/projected/1d5e532b-4c49-42a7-9e07-72435dd81bb6-kube-api-access-724tx\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:30:15.416310 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.416314    2566 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-data\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:30:15.416310 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.416322    2566 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-podinfo\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:30:15.416599 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.416333    2566 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-credential-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:30:15.416599 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.416341    2566 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-workload-certs\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:30:15.416599 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.416349    2566 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d5e532b-4c49-42a7-9e07-72435dd81bb6-workload-socket\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:30:15.416599 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.416357    2566 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istiod-ca-cert\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:30:15.416599 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.416366    2566 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d5e532b-4c49-42a7-9e07-72435dd81bb6-istio-token\") on node \"ip-10-0-132-89.ec2.internal\" DevicePath \"\""
Jul 31 21:30:15.817096 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.817063    2566 generic.go:356] "Generic (PLEG): container finished" podID="1d5e532b-4c49-42a7-9e07-72435dd81bb6" containerID="b9daa8f66e22ef66111757f7c8c0b97b47e9839c7834df261e46731349dffcee" exitCode=0
Jul 31 21:30:15.817306 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.817109    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"
Jul 31 21:30:15.817306 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.817175    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r" event={"ID":"1d5e532b-4c49-42a7-9e07-72435dd81bb6","Type":"ContainerDied","Data":"b9daa8f66e22ef66111757f7c8c0b97b47e9839c7834df261e46731349dffcee"}
Jul 31 21:30:15.817306 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.817232    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r" event={"ID":"1d5e532b-4c49-42a7-9e07-72435dd81bb6","Type":"ContainerDied","Data":"aa231da63f97caf5c373b175b3a938aa9a5a764037e3197d918c11f321c77433"}
Jul 31 21:30:15.817306 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.817264    2566 scope.go:117] "RemoveContainer" containerID="b9daa8f66e22ef66111757f7c8c0b97b47e9839c7834df261e46731349dffcee"
Jul 31 21:30:15.826794 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.826775    2566 scope.go:117] "RemoveContainer" containerID="ba9dedc33bdc5e8504c2bca104f4419a7da53afa93f47a5253b2e9eb102ca310"
Jul 31 21:30:15.834600 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.834584    2566 scope.go:117] "RemoveContainer" containerID="b9daa8f66e22ef66111757f7c8c0b97b47e9839c7834df261e46731349dffcee"
Jul 31 21:30:15.834856 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:30:15.834832    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9daa8f66e22ef66111757f7c8c0b97b47e9839c7834df261e46731349dffcee\": container with ID starting with b9daa8f66e22ef66111757f7c8c0b97b47e9839c7834df261e46731349dffcee not found: ID does not exist" containerID="b9daa8f66e22ef66111757f7c8c0b97b47e9839c7834df261e46731349dffcee"
Jul 31 21:30:15.834939 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.834867    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9daa8f66e22ef66111757f7c8c0b97b47e9839c7834df261e46731349dffcee"} err="failed to get container status \"b9daa8f66e22ef66111757f7c8c0b97b47e9839c7834df261e46731349dffcee\": rpc error: code = NotFound desc = could not find container \"b9daa8f66e22ef66111757f7c8c0b97b47e9839c7834df261e46731349dffcee\": container with ID starting with b9daa8f66e22ef66111757f7c8c0b97b47e9839c7834df261e46731349dffcee not found: ID does not exist"
Jul 31 21:30:15.834939 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.834892    2566 scope.go:117] "RemoveContainer" containerID="ba9dedc33bdc5e8504c2bca104f4419a7da53afa93f47a5253b2e9eb102ca310"
Jul 31 21:30:15.835135 ip-10-0-132-89 kubenswrapper[2566]: E0731 21:30:15.835117    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba9dedc33bdc5e8504c2bca104f4419a7da53afa93f47a5253b2e9eb102ca310\": container with ID starting with ba9dedc33bdc5e8504c2bca104f4419a7da53afa93f47a5253b2e9eb102ca310 not found: ID does not exist" containerID="ba9dedc33bdc5e8504c2bca104f4419a7da53afa93f47a5253b2e9eb102ca310"
Jul 31 21:30:15.835256 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.835156    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba9dedc33bdc5e8504c2bca104f4419a7da53afa93f47a5253b2e9eb102ca310"} err="failed to get container status \"ba9dedc33bdc5e8504c2bca104f4419a7da53afa93f47a5253b2e9eb102ca310\": rpc error: code = NotFound desc = could not find container \"ba9dedc33bdc5e8504c2bca104f4419a7da53afa93f47a5253b2e9eb102ca310\": container with ID starting with ba9dedc33bdc5e8504c2bca104f4419a7da53afa93f47a5253b2e9eb102ca310 not found: ID does not exist"
Jul 31 21:30:15.839844 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.839825    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"]
Jul 31 21:30:15.846141 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.846120    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-6938c5-openshift-default-7d5b94fcf6-75w9r"]
Jul 31 21:30:15.936953 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:15.936920    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d5e532b-4c49-42a7-9e07-72435dd81bb6" path="/var/lib/kubelet/pods/1d5e532b-4c49-42a7-9e07-72435dd81bb6/volumes"
Jul 31 21:30:16.290653 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:16.290620    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8kwrp_b0f94072-d0bc-43bb-bea8-a8fdb1aab366/manager/0.log"
Jul 31 21:30:16.415536 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:16.415503    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-l2g8t_0a4e2b6b-8fcb-420a-b9cb-fb95975900b3/manager/0.log"
Jul 31 21:30:16.651026 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:16.650941    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-96ls9_009ff44f-1a56-48bb-b6e2-607feda4ad9f/server/0.log"
Jul 31 21:30:16.775994 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:16.775960    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5wx6h_b87b9f5a-74ab-4ac5-8960-4b38d16c9e66/manager/0.log"
Jul 31 21:30:17.018527 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:17.018444    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786d856849-wrnv2_87ee0c76-8d85-4e82-bd19-67d24055cd43/copy-manifests/0.log"
Jul 31 21:30:17.037160 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:17.037125    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786d856849-wrnv2_87ee0c76-8d85-4e82-bd19-67d24055cd43/manager/0.log"
Jul 31 21:30:17.621440 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:17.621414    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29758860-wrrz9_a533afe9-86c0-4e7c-ad37-706cfd563254/cleanup/0.log"
Jul 31 21:30:17.744503 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:17.744472    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29758875-7zl88_5be70cfd-f757-423d-bc7d-d52e3ba792de/cleanup/0.log"
Jul 31 21:30:17.966335 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:17.966250    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-hb86k_c3c55bf9-ecfb-49f0-b1fc-6b6d7a499cd6/postgres/0.log"
Jul 31 21:30:18.891254 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:18.891224    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-vw6pd_3edddb17-4da3-4c23-9d2e-19d3287b1b91/manager/0.log"
Jul 31 21:30:19.007583 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:19.007556    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-6qssh_be3e0f1f-0660-4a8c-a165-31ded80c882b/manager/0.log"
Jul 31 21:30:19.252688 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:19.252595    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-jm82b_a95aef9d-13dd-477f-a5ed-45ba2159d58e/manager/0.log"
Jul 31 21:30:19.493199 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:19.493124    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-xjhvm_3b417bd1-2a9d-4460-adb7-8b36cf774510/manager/0.log"
Jul 31 21:30:20.191072 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:20.191036    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d469b876d-gtw46_45faa39f-02fc-4802-9cfb-c3b1d2f22b4e/kube-auth-proxy/0.log"
Jul 31 21:30:20.315851 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:20.315800    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-9wfvl_825834e1-0f23-4521-a361-2ee637ff65b6/istio-proxy/1.log"
Jul 31 21:30:20.547376 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:20.547345    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-4vj9m_5436fd36-6c95-4225-8260-8d7ca57f80c3/payload-processing/0.log"
Jul 31 21:30:21.259435 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:21.259408    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-vq59d_9d82e3b4-3c7d-4906-a780-228f83c2ffc1/main/0.log"
Jul 31 21:30:21.605459 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:21.605423    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-vkh42_3005d54f-07e5-4f71-83d2-9ea764dd22b6/main/0.log"
Jul 31 21:30:27.333084 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333050    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hpvlq/must-gather-wqtz8"]
Jul 31 21:30:27.333499 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333421    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dea4458-0475-4a69-b7f2-fc4f016758fe" containerName="payload-processing"
Jul 31 21:30:27.333499 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333432    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dea4458-0475-4a69-b7f2-fc4f016758fe" containerName="payload-processing"
Jul 31 21:30:27.333499 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333448    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d5e532b-4c49-42a7-9e07-72435dd81bb6" containerName="istio-proxy"
Jul 31 21:30:27.333499 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333454    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d5e532b-4c49-42a7-9e07-72435dd81bb6" containerName="istio-proxy"
Jul 31 21:30:27.333499 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333463    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6efcbbfe-c75d-41be-900e-acdc27a1e048" containerName="payload-pre-processing"
Jul 31 21:30:27.333499 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333470    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="6efcbbfe-c75d-41be-900e-acdc27a1e048" containerName="payload-pre-processing"
Jul 31 21:30:27.333499 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333478    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8701b372-d148-4010-b467-f3fe6caacb1c" containerName="revoke-keys"
Jul 31 21:30:27.333499 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333483    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8701b372-d148-4010-b467-f3fe6caacb1c" containerName="revoke-keys"
Jul 31 21:30:27.333499 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333494    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ceffcde-7db0-43b4-948d-6fb1ace834dd" containerName="istio-proxy"
Jul 31 21:30:27.333499 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333499    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ceffcde-7db0-43b4-948d-6fb1ace834dd" containerName="istio-proxy"
Jul 31 21:30:27.333828 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333554    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="6efcbbfe-c75d-41be-900e-acdc27a1e048" containerName="payload-pre-processing"
Jul 31 21:30:27.333828 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333563    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dea4458-0475-4a69-b7f2-fc4f016758fe" containerName="payload-processing"
Jul 31 21:30:27.333828 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333569    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d5e532b-4c49-42a7-9e07-72435dd81bb6" containerName="istio-proxy"
Jul 31 21:30:27.333828 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333573    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8701b372-d148-4010-b467-f3fe6caacb1c" containerName="revoke-keys"
Jul 31 21:30:27.333828 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333631    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d5e532b-4c49-42a7-9e07-72435dd81bb6" containerName="istio-proxy"
Jul 31 21:30:27.333828 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333636    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d5e532b-4c49-42a7-9e07-72435dd81bb6" containerName="istio-proxy"
Jul 31 21:30:27.333828 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.333681    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d5e532b-4c49-42a7-9e07-72435dd81bb6" containerName="istio-proxy"
Jul 31 21:30:27.338212 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.338186    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hpvlq/must-gather-wqtz8"
Jul 31 21:30:27.342774 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.342749    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hpvlq\"/\"openshift-service-ca.crt\""
Jul 31 21:30:27.350510 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.350485    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hpvlq\"/\"kube-root-ca.crt\""
Jul 31 21:30:27.350665 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.350551    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hpvlq\"/\"default-dockercfg-869gk\""
Jul 31 21:30:27.359572 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.359536    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hpvlq/must-gather-wqtz8"]
Jul 31 21:30:27.422526 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.422484    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e098e3b5-4568-47bf-bed4-502fbfc8e2de-must-gather-output\") pod \"must-gather-wqtz8\" (UID: \"e098e3b5-4568-47bf-bed4-502fbfc8e2de\") " pod="openshift-must-gather-hpvlq/must-gather-wqtz8"
Jul 31 21:30:27.422526 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.422520    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmkf7\" (UniqueName: \"kubernetes.io/projected/e098e3b5-4568-47bf-bed4-502fbfc8e2de-kube-api-access-nmkf7\") pod \"must-gather-wqtz8\" (UID: \"e098e3b5-4568-47bf-bed4-502fbfc8e2de\") " pod="openshift-must-gather-hpvlq/must-gather-wqtz8"
Jul 31 21:30:27.523404 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.523361    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e098e3b5-4568-47bf-bed4-502fbfc8e2de-must-gather-output\") pod \"must-gather-wqtz8\" (UID: \"e098e3b5-4568-47bf-bed4-502fbfc8e2de\") " pod="openshift-must-gather-hpvlq/must-gather-wqtz8"
Jul 31 21:30:27.523404 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.523405    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmkf7\" (UniqueName: \"kubernetes.io/projected/e098e3b5-4568-47bf-bed4-502fbfc8e2de-kube-api-access-nmkf7\") pod \"must-gather-wqtz8\" (UID: \"e098e3b5-4568-47bf-bed4-502fbfc8e2de\") " pod="openshift-must-gather-hpvlq/must-gather-wqtz8"
Jul 31 21:30:27.523739 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.523715    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e098e3b5-4568-47bf-bed4-502fbfc8e2de-must-gather-output\") pod \"must-gather-wqtz8\" (UID: \"e098e3b5-4568-47bf-bed4-502fbfc8e2de\") " pod="openshift-must-gather-hpvlq/must-gather-wqtz8"
Jul 31 21:30:27.536168 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.536118    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmkf7\" (UniqueName: \"kubernetes.io/projected/e098e3b5-4568-47bf-bed4-502fbfc8e2de-kube-api-access-nmkf7\") pod \"must-gather-wqtz8\" (UID: \"e098e3b5-4568-47bf-bed4-502fbfc8e2de\") " pod="openshift-must-gather-hpvlq/must-gather-wqtz8"
Jul 31 21:30:27.647947 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.647842    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hpvlq/must-gather-wqtz8"
Jul 31 21:30:27.797386 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.797353    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hpvlq/must-gather-wqtz8"]
Jul 31 21:30:27.800580 ip-10-0-132-89 kubenswrapper[2566]: W0731 21:30:27.800538    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode098e3b5_4568_47bf_bed4_502fbfc8e2de.slice/crio-aa02cdbaa68d9a49e4854b737c6e6125b2d1935d6bf055df16ce4eb4b557a2df WatchSource:0}: Error finding container aa02cdbaa68d9a49e4854b737c6e6125b2d1935d6bf055df16ce4eb4b557a2df: Status 404 returned error can't find the container with id aa02cdbaa68d9a49e4854b737c6e6125b2d1935d6bf055df16ce4eb4b557a2df
Jul 31 21:30:27.802382 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.802364    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 31 21:30:27.878245 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:27.878209    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hpvlq/must-gather-wqtz8" event={"ID":"e098e3b5-4568-47bf-bed4-502fbfc8e2de","Type":"ContainerStarted","Data":"aa02cdbaa68d9a49e4854b737c6e6125b2d1935d6bf055df16ce4eb4b557a2df"}
Jul 31 21:30:28.894230 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:28.893621    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hpvlq/must-gather-wqtz8" event={"ID":"e098e3b5-4568-47bf-bed4-502fbfc8e2de","Type":"ContainerStarted","Data":"83a861e7de25e31ee2e510ee2c87a9d5e9654ea2bbf561ae0c4e49555862083b"}
Jul 31 21:30:28.894230 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:28.893679    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hpvlq/must-gather-wqtz8" event={"ID":"e098e3b5-4568-47bf-bed4-502fbfc8e2de","Type":"ContainerStarted","Data":"a76636ceaec14778fd2ef03e505ada22d396f6ab255616dc6b1aff758a12b6a9"}
Jul 31 21:30:28.919218 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:28.919107    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hpvlq/must-gather-wqtz8" podStartSLOduration=1.190178872 podStartE2EDuration="1.919084359s" totalImagesPullingTime="728.905487ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:30:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:28.915902002 +0000 UTC m=+3633.521294480" watchObservedRunningTime="2026-07-31 21:30:28.919084359 +0000 UTC m=+3633.524476835"
Jul 31 21:30:30.529678 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:30.529647    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zslqn_7bda5031-9205-4c6f-a712-57bfa836841a/global-pull-secret-syncer/0.log"
Jul 31 21:30:30.694113 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:30.694081    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-psqjf_e87137bd-5415-48f4-b38e-ceb5f5e0b126/konnectivity-agent/0.log"
Jul 31 21:30:30.847136 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:30.847105    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-89.ec2.internal_7856e23c54e5bbf471253e5fa19904b5/haproxy/0.log"
Jul 31 21:30:35.600637 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:35.600600    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-vw6pd_3edddb17-4da3-4c23-9d2e-19d3287b1b91/manager/0.log"
Jul 31 21:30:35.672285 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:35.672248    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-6qssh_be3e0f1f-0660-4a8c-a165-31ded80c882b/manager/0.log"
Jul 31 21:30:35.873039 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:35.872947    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-jm82b_a95aef9d-13dd-477f-a5ed-45ba2159d58e/manager/0.log"
Jul 31 21:30:36.107401 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:36.107352    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-xjhvm_3b417bd1-2a9d-4460-adb7-8b36cf774510/manager/0.log"
Jul 31 21:30:38.210389 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:38.210356    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ntvcs_8c244498-e878-4f76-b956-078e288a29ea/node-exporter/0.log"
Jul 31 21:30:38.235293 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:38.235261    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ntvcs_8c244498-e878-4f76-b956-078e288a29ea/kube-rbac-proxy/0.log"
Jul 31 21:30:38.270961 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:38.270937    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ntvcs_8c244498-e878-4f76-b956-078e288a29ea/init-textfile/0.log"
Jul 31 21:30:40.296478 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.296444    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-lf9bg_4cd0d500-315e-42ab-8b88-53c01d76bef0/networking-console-plugin/0.log"
Jul 31 21:30:40.599937 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.599844    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"]
Jul 31 21:30:40.606718 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.606682    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:40.614430 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.614390    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"]
Jul 31 21:30:40.757164 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.756838    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d051dbc-f05c-468d-beb7-4bacf8e10558-lib-modules\") pod \"perf-node-gather-daemonset-p5pgs\" (UID: \"6d051dbc-f05c-468d-beb7-4bacf8e10558\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:40.757164 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.756929    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6d051dbc-f05c-468d-beb7-4bacf8e10558-podres\") pod \"perf-node-gather-daemonset-p5pgs\" (UID: \"6d051dbc-f05c-468d-beb7-4bacf8e10558\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:40.757164 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.756984    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d051dbc-f05c-468d-beb7-4bacf8e10558-sys\") pod \"perf-node-gather-daemonset-p5pgs\" (UID: \"6d051dbc-f05c-468d-beb7-4bacf8e10558\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:40.757164 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.757015    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6d051dbc-f05c-468d-beb7-4bacf8e10558-proc\") pod \"perf-node-gather-daemonset-p5pgs\" (UID: \"6d051dbc-f05c-468d-beb7-4bacf8e10558\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:40.757164 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.757067    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4648\" (UniqueName: \"kubernetes.io/projected/6d051dbc-f05c-468d-beb7-4bacf8e10558-kube-api-access-r4648\") pod \"perf-node-gather-daemonset-p5pgs\" (UID: \"6d051dbc-f05c-468d-beb7-4bacf8e10558\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:40.858098 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.858012    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d051dbc-f05c-468d-beb7-4bacf8e10558-sys\") pod \"perf-node-gather-daemonset-p5pgs\" (UID: \"6d051dbc-f05c-468d-beb7-4bacf8e10558\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:40.858098 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.858054    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6d051dbc-f05c-468d-beb7-4bacf8e10558-proc\") pod \"perf-node-gather-daemonset-p5pgs\" (UID: \"6d051dbc-f05c-468d-beb7-4bacf8e10558\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:40.858098 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.858092    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4648\" (UniqueName: \"kubernetes.io/projected/6d051dbc-f05c-468d-beb7-4bacf8e10558-kube-api-access-r4648\") pod \"perf-node-gather-daemonset-p5pgs\" (UID: \"6d051dbc-f05c-468d-beb7-4bacf8e10558\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:40.858407 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.858125    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d051dbc-f05c-468d-beb7-4bacf8e10558-lib-modules\") pod \"perf-node-gather-daemonset-p5pgs\" (UID: \"6d051dbc-f05c-468d-beb7-4bacf8e10558\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:40.858407 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.858179    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6d051dbc-f05c-468d-beb7-4bacf8e10558-proc\") pod \"perf-node-gather-daemonset-p5pgs\" (UID: \"6d051dbc-f05c-468d-beb7-4bacf8e10558\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:40.858407 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.858183    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d051dbc-f05c-468d-beb7-4bacf8e10558-sys\") pod \"perf-node-gather-daemonset-p5pgs\" (UID: \"6d051dbc-f05c-468d-beb7-4bacf8e10558\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:40.858407 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.858229    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6d051dbc-f05c-468d-beb7-4bacf8e10558-podres\") pod \"perf-node-gather-daemonset-p5pgs\" (UID: \"6d051dbc-f05c-468d-beb7-4bacf8e10558\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:40.858407 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.858310    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d051dbc-f05c-468d-beb7-4bacf8e10558-lib-modules\") pod \"perf-node-gather-daemonset-p5pgs\" (UID: \"6d051dbc-f05c-468d-beb7-4bacf8e10558\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:40.858407 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.858373    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6d051dbc-f05c-468d-beb7-4bacf8e10558-podres\") pod \"perf-node-gather-daemonset-p5pgs\" (UID: \"6d051dbc-f05c-468d-beb7-4bacf8e10558\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:40.867497 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.867441    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4648\" (UniqueName: \"kubernetes.io/projected/6d051dbc-f05c-468d-beb7-4bacf8e10558-kube-api-access-r4648\") pod \"perf-node-gather-daemonset-p5pgs\" (UID: \"6d051dbc-f05c-468d-beb7-4bacf8e10558\") " pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:40.929068 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:40.929029    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:41.127715 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:41.127625    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"]
Jul 31 21:30:42.007465 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:42.007117    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs" event={"ID":"6d051dbc-f05c-468d-beb7-4bacf8e10558","Type":"ContainerStarted","Data":"1553281d76cc1fab38bb28922358efaffbbe43b520db63764435a1366a041e81"}
Jul 31 21:30:42.007465 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:42.007206    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs" event={"ID":"6d051dbc-f05c-468d-beb7-4bacf8e10558","Type":"ContainerStarted","Data":"007dd254237f966d0652fac037d24cf383369d82f355fe358b8013bcb285dd56"}
Jul 31 21:30:42.007465 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:42.007411    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:42.023079 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:42.023018    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs" podStartSLOduration=2.022995695 podStartE2EDuration="2.022995695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:30:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:42.022381621 +0000 UTC m=+3646.627774098" watchObservedRunningTime="2026-07-31 21:30:42.022995695 +0000 UTC m=+3646.628388172"
Jul 31 21:30:43.309041 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:43.309005    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qp9gw_ccbc72eb-a594-4bde-867d-19dfb2f78bf1/dns/0.log"
Jul 31 21:30:43.330388 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:43.330353    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qp9gw_ccbc72eb-a594-4bde-867d-19dfb2f78bf1/kube-rbac-proxy/0.log"
Jul 31 21:30:43.429369 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:43.429335    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7qphl_488c36c4-397a-46d9-a06a-5a6f800e6afb/dns-node-resolver/0.log"
Jul 31 21:30:43.994537 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:43.994505    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-755899888f-568sg_bee5ec02-2c87-47c7-a9e9-d3232b1ab96c/registry/0.log"
Jul 31 21:30:44.043028 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:44.042995    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kjc46_35536ea9-0cd4-4e62-9c3f-df5f2a224bd4/node-ca/0.log"
Jul 31 21:30:45.201907 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:45.201875    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d469b876d-gtw46_45faa39f-02fc-4802-9cfb-c3b1d2f22b4e/kube-auth-proxy/0.log"
Jul 31 21:30:45.233920 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:45.233881    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-9wfvl_825834e1-0f23-4521-a361-2ee637ff65b6/istio-proxy/0.log"
Jul 31 21:30:45.244562 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:45.244527    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-9wfvl_825834e1-0f23-4521-a361-2ee637ff65b6/istio-proxy/1.log"
Jul 31 21:30:45.310694 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:45.310661    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-4vj9m_5436fd36-6c95-4225-8260-8d7ca57f80c3/payload-processing/0.log"
Jul 31 21:30:46.159661 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:46.159633    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qxwsp_5c18b2c8-16d4-4814-81a3-ecc36a1b3482/serve-healthcheck-canary/0.log"
Jul 31 21:30:46.643009 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:46.642981    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f5h8r_bf9b88d6-16ce-40dd-a570-d7671d2d47ba/kube-rbac-proxy/0.log"
Jul 31 21:30:46.662696 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:46.662609    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f5h8r_bf9b88d6-16ce-40dd-a570-d7671d2d47ba/exporter/0.log"
Jul 31 21:30:46.686453 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:46.686400    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f5h8r_bf9b88d6-16ce-40dd-a570-d7671d2d47ba/extractor/0.log"
Jul 31 21:30:48.025379 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:48.025351    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hpvlq/perf-node-gather-daemonset-p5pgs"
Jul 31 21:30:49.106048 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:49.106009    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8kwrp_b0f94072-d0bc-43bb-bea8-a8fdb1aab366/manager/0.log"
Jul 31 21:30:49.534193 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:49.533890    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-l2g8t_0a4e2b6b-8fcb-420a-b9cb-fb95975900b3/manager/0.log"
Jul 31 21:30:49.724323 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:49.724246    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-96ls9_009ff44f-1a56-48bb-b6e2-607feda4ad9f/server/0.log"
Jul 31 21:30:49.862941 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:49.862910    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5wx6h_b87b9f5a-74ab-4ac5-8960-4b38d16c9e66/manager/0.log"
Jul 31 21:30:50.073234 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:50.073202    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786d856849-wrnv2_87ee0c76-8d85-4e82-bd19-67d24055cd43/manager/0.log"
Jul 31 21:30:50.093051 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:50.093022    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-786d856849-wrnv2_87ee0c76-8d85-4e82-bd19-67d24055cd43/copy-manifests/0.log"
Jul 31 21:30:51.610101 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:51.610063    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d469b876d-gtw46_45faa39f-02fc-4802-9cfb-c3b1d2f22b4e/kube-auth-proxy/0.log"
Jul 31 21:30:51.632243 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:51.632205    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-9wfvl_825834e1-0f23-4521-a361-2ee637ff65b6/istio-proxy/0.log"
Jul 31 21:30:51.644224 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:51.644190    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-9wfvl_825834e1-0f23-4521-a361-2ee637ff65b6/istio-proxy/1.log"
Jul 31 21:30:51.699456 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:51.699420    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-4vj9m_5436fd36-6c95-4225-8260-8d7ca57f80c3/payload-processing/0.log"
Jul 31 21:30:53.365108 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:53.365070    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d469b876d-gtw46_45faa39f-02fc-4802-9cfb-c3b1d2f22b4e/kube-auth-proxy/0.log"
Jul 31 21:30:53.386108 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:53.386077    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-9wfvl_825834e1-0f23-4521-a361-2ee637ff65b6/istio-proxy/0.log"
Jul 31 21:30:53.399525 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:53.399486    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-9wfvl_825834e1-0f23-4521-a361-2ee637ff65b6/istio-proxy/1.log"
Jul 31 21:30:53.453973 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:53.453941    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-4vj9m_5436fd36-6c95-4225-8260-8d7ca57f80c3/payload-processing/0.log"
Jul 31 21:30:56.495004 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:56.494975    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-4zmqz_ecc06171-a30a-4a1b-9483-9cb7ec6eac68/migrator/0.log"
Jul 31 21:30:56.514968 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:56.514941    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-4zmqz_ecc06171-a30a-4a1b-9483-9cb7ec6eac68/graceful-termination/0.log"
Jul 31 21:30:56.528922 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:56.528883    2566 scope.go:117] "RemoveContainer" containerID="e6fa274b8c7dca262dc3d468f5801d5de0ef3e3d97c9be0bc0b3a84ad9e43370"
Jul 31 21:30:56.547369 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:56.545556    2566 scope.go:117] "RemoveContainer" containerID="a00f3fad61f561b9540c4caa9d994ce3211ab8f6a14e88ff5d994cdeb4b9e97c"
Jul 31 21:30:56.556845 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:56.556819    2566 scope.go:117] "RemoveContainer" containerID="9853304f160dc2584d98971f0d259296d2787a75e4fc7079828524006111da47"
Jul 31 21:30:57.865774 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:57.865737    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2jz7q_d58cbbfa-0e7c-41b6-ab6b-9ff49744843e/kube-multus/0.log"
Jul 31 21:30:57.918798 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:57.918772    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-22922_cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2/kube-multus-additional-cni-plugins/0.log"
Jul 31 21:30:57.939946 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:57.939875    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-22922_cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2/egress-router-binary-copy/0.log"
Jul 31 21:30:57.961720 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:57.961689    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-22922_cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2/cni-plugins/0.log"
Jul 31 21:30:57.982453 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:57.982425    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-22922_cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2/bond-cni-plugin/0.log"
Jul 31 21:30:58.002665 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:58.002635    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-22922_cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2/routeoverride-cni/0.log"
Jul 31 21:30:58.023707 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:58.023683    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-22922_cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2/whereabouts-cni-bincopy/0.log"
Jul 31 21:30:58.047398 ip-10-0-132-89 kubenswrapper[2566]: I0731 21:30:58.047366    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-22922_cb1a2985-5bf1-43cb-8172-3ee7f2f4afc2/whereabouts-cni/0.log"